-- Logs begin at Wed 2021-10-27 00:54:54 UTC, end at Wed 2021-10-27 02:25:10 UTC. -- Oct 27 01:19:43.735360 dv-cinder-815461-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Oct 27 01:19:43.744170 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 27 01:19:43.748675 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 27 01:19:43 2021] *** Oct 27 01:19:43.748675 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 01:19:43.748675 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 01:19:43.748675 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: nodename: dv-cinder-815461-3-iscsi Oct 27 01:19:43.748675 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: machine: x86_64 Oct 27 01:19:43.748675 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: clock source: unix Oct 27 01:19:43.748675 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: pcre jit disabled Oct 27 01:19:43.748675 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: detected number of CPU cores: 4 Oct 27 01:19:43.748675 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: current working directory: / Oct 27 01:19:43.748675 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: detected binary path: /usr/bin/uwsgi-core Oct 27 01:19:43.748675 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: your processes number limit is 47680 Oct 27 01:19:43.748675 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: your memory page size is 4096 bytes Oct 27 01:19:43.748675 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: detected max file descriptor number: 2048 Oct 27 01:19:43.748675 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: lock engine: pthread robust mutexes Oct 27 01:19:43.748675 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: thunder lock: enabled Oct 27 01:19:43.748675 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 27 01:19:43.748675 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 27 01:19:43.791227 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: Python main interpreter initialized at 0x55e0bdcee9c0 Oct 27 01:19:43.791227 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: python threads support enabled Oct 27 01:19:43.791227 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: your server socket listen backlog is limited to 100 connections Oct 27 01:19:43.791227 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: your mercy for graceful operations on workers is 90 seconds Oct 27 01:19:43.791558 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 01:19:43.791658 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: *** Operational MODE: preforking *** Oct 27 01:19:43.791935 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: *** uWSGI is running in multiple interpreter mode *** Oct 27 01:19:43.791935 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: spawned uWSGI master process (pid: 79463) Oct 27 01:19:43.792132 dv-cinder-815461-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Oct 27 01:19:43.792727 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: spawned uWSGI worker 1 (pid: 79472, cores: 1) Oct 27 01:19:43.793069 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: spawned uWSGI worker 2 (pid: 79473, cores: 1) Oct 27 01:19:43.793218 dv-cinder-815461-3-iscsi devstack@keystone.service[79463]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 01:19:48.924061 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 01:19:48.924061 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: from cryptography.utils import int_from_bytes Oct 27 01:19:48.924845 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 01:19:48.924845 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: from cryptography.utils import int_from_bytes Oct 27 01:19:48.925262 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 01:19:48.925262 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: from cryptography.utils import int_from_bytes Oct 27 01:19:48.925364 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 01:19:48.925364 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: from cryptography.utils import int_from_bytes Oct 27 01:19:48.973844 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 01:19:48.974054 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 01:19:48.974222 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 01:19:48.974329 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] command line args: [] {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 01:19:48.974411 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 01:19:48.974528 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 01:19:48.974654 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] command line args: [] {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 01:19:48.974741 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ================================================================================ {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 01:19:48.974867 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 01:19:48.974956 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] admin_token = **** {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.975074 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ================================================================================ {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 01:19:48.975202 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] config_dir = [] {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.975360 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] admin_token = **** {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.975445 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.975639 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] config_dir = [] {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.975722 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] config_source = [] {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.975854 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.975934 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] debug = True {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.976059 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] config_source = [] {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.976142 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.976320 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] debug = True {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.976444 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.976528 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.976612 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.976723 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.976866 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.976961 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.977124 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.977211 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.977364 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] list_limit = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.977445 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.977579 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] log_config_append = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.977694 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] list_limit = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.977772 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.977881 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] log_config_append = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.977955 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] log_dir = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.978048 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.978120 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] log_file = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.978223 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] log_dir = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.978321 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.978394 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] log_file = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.978573 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.978660 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.978830 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.978921 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.979085 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.979176 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.979294 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.979448 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.979524 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.979595 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.979720 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.979844 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.980570 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.980685 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.980811 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.980924 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.981043 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.981157 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.981277 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.981397 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.981552 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.981677 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.981791 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.981904 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.982016 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.982129 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.982250 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.982371 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.982494 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.982679 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.982866 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] publish_errors = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.982992 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.983107 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] publish_errors = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.983219 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.983341 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.983456 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.983576 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.983695 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.983695 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.983903 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.984094 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.984221 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.984336 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.984455 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] standard_threads = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.984581 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] standard_threads = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.984696 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.984809 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.984927 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.984927 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.985140 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.985261 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] use_journal = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.985376 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.985507 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] use_json = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.985626 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] use_journal = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.985740 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] use_stderr = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.985842 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] use_json = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.985970 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] use_syslog = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.986087 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] use_stderr = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.986087 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] use_syslog = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.986300 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.986419 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:19:48.986533 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.986654 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.986776 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.986897 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.987011 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.987130 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.987244 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.987368 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.987483 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.987596 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.987710 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.987823 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.987941 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.988133 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.988249 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.988362 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.988475 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.988588 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.988707 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.988831 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.988946 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.989060 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.989179 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.989299 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.989414 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.989555 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.989679 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.989795 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.989910 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.990023 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.990151 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.990275 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.990400 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.990521 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.990636 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.990757 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.990873 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.990994 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.991109 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.991228 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.991348 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.991468 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.991582 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.991707 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.991828 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.991944 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.992058 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.992172 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.992297 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.992413 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.992526 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.992640 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.992753 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.992872 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.992999 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.993115 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.993228 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.993347 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.993462 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.993600 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.993796 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.993920 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.994035 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.994149 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.994262 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.994375 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.994496 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.994610 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.994724 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.994837 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.994956 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.995071 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.995195 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.995311 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.995430 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.995544 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.995663 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.995777 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.995901 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.996026 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.996142 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.996255 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.996367 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.996480 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.996601 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.996716 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.996834 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.996949 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.997067 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.997182 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.997306 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.997421 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.997546 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.997649 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.997753 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.997849 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.997955 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.998057 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.998154 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.998249 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.998351 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.998447 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.998572 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.998697 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.998812 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.998917 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.999030 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.999150 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.999271 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.999386 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.999506 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.999621 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.999735 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.999860 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:48.999981 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.000101 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.000218 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.000333 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.000454 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.000585 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.000702 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.000831 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.000947 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.001051 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.001169 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.001293 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.001419 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.001588 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.001708 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.001813 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.001926 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.002040 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.002154 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.002276 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.002393 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.002505 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.002620 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.002744 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.002860 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.002983 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.003098 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.003212 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.003326 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.003441 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.003555 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.003677 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.003793 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.003907 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.004022 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.004136 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.004251 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.004373 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.004491 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.004606 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.004720 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.004835 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.004949 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.005140 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.005264 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.005389 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.005520 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.005638 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.005753 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.005879 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.006000 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.006115 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.006230 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.006344 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.006465 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.006588 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.006711 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.006827 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.006827 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.007041 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.007155 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.007277 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.007277 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.007501 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.007625 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.007749 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.007749 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.007973 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.008100 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.008217 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.008332 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.008447 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.008561 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] auth.external = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.008676 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] auth.external = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.008802 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.008924 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.009040 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.009156 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.009272 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.009387 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.009576 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] auth.password = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.009697 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] auth.password = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.009813 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] auth.token = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.009928 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] auth.token = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.010042 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.010157 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.010283 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.010399 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.010514 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.010628 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.010743 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.010859 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.010981 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.011097 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.011219 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.011334 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.011449 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.011563 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.011685 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] credential.caching = True {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.011834 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] credential.caching = True {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.011964 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.012082 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.012204 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.012321 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.012445 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.012567 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.012692 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.012810 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.012927 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.013042 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.013159 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.013280 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.013405 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.013535 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.013654 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.013770 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.013885 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.014002 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.014130 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.014248 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.014363 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.014479 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.014594 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.014710 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.014834 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.014951 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.015075 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.015191 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.015307 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.015422 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.015546 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] federation.caching = True {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.015663 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] federation.caching = True {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.015779 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.015895 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.016015 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.016131 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.016256 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.016373 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.016489 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.016604 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.016719 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.016835 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.016959 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.017077 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.017193 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.017308 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.017425 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.017566 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.017686 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.017802 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.017918 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.018034 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.018151 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.018274 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.018392 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] identity.caching = True {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.018508 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] identity.caching = True {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.018629 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.018747 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.018863 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.019057 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.019178 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.019295 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.019410 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.019527 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.019643 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.019766 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.019892 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.020009 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.020125 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.020242 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.020364 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.020493 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.020610 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.020725 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.020841 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.020957 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.021072 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.021196 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.021321 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.021438 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.021568 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.021685 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.021801 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.021928 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.022046 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.022162 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.022278 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.022395 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.022511 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.022635 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.022753 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.022869 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.022985 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.023100 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.023216 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.023340 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.023458 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.023573 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.023689 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.023809 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.023926 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.024049 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.024167 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.024282 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.024398 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.024515 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.024630 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.024753 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.024878 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.024988 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.025102 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.025223 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.025340 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.025464 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.025464 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.025776 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.025891 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.026009 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.026125 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.026253 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.026371 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.026488 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.026605 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.027216 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.027335 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.027459 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.027578 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.027693 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.027809 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.027924 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.028039 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.028163 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.028279 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.028394 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.028510 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.028626 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.028741 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.028865 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.028981 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.029097 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.029212 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.029328 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.029452 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.029586 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.029704 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.029819 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.029935 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.030050 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.030177 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.030295 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.030410 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.030525 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.030641 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.030758 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.030881 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.030998 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.031113 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.user = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.031229 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.user = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.031344 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.031466 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.031592 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.031709 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.031827 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.031942 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.032058 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.032174 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.032301 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.032426 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.032542 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.032542 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.032763 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.032880 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.033007 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.033125 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.033240 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.033363 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.033529 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.033659 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.033785 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.033903 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.034019 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.034133 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.034248 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.034363 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.034485 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.034602 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.034718 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.034833 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.034949 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.035065 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.035188 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.035305 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.035420 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.035535 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.035651 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.035765 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.035888 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.036010 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.036125 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.036240 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.036356 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.036471 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.036594 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.036711 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.036826 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.036941 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.037058 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.037174 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.037297 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.037414 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.037542 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.037660 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.037775 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.037890 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.038017 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.038136 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.038251 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.038366 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.038481 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.038596 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.038720 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.038720 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.038928 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.039032 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.039181 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.039181 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.039410 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.039410 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.039629 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.039745 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.039866 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] resource.caching = True {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.039983 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] resource.caching = True {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.040107 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.040225 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.040341 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.040456 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.040572 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.040687 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.040811 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.040928 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.041044 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.041159 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.041276 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.041392 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.041581 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.041702 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.041818 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.041933 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.042049 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.042165 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.042383 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] role.caching = True {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.043025 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] role.caching = True {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.043144 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] role.driver = sql {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.043261 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] role.driver = sql {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.043378 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.043494 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.043619 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.043619 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.043840 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.043956 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.044072 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.044195 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.044313 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.044313 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.044532 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.044648 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.044763 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.044887 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.045004 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.045120 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.045236 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.045236 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.045454 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.045454 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.045706 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.045822 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.045938 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.046059 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.046174 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.046298 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.046416 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.046533 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.046648 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.046778 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.046899 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.047023 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.047141 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.047258 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.047374 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.047491 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.047607 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.047732 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.047849 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.047993 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.048150 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.048272 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.048397 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.048516 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.048633 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.048749 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.048865 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.048981 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.049103 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.049221 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.049337 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.049452 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.049614 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.049732 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.049863 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.049982 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.050099 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.050214 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.050330 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.050445 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.050568 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.050687 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.050802 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.050918 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.051033 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.051149 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.051273 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] token.caching = True {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.051391 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] token.caching = True {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.051506 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.051621 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.051738 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.051854 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.051979 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.052096 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.052212 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.052328 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.052444 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.052560 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.052683 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.052802 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.052918 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.053033 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.053149 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.053265 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.053389 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.053523 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.053642 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.053758 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.053875 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.053991 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.054118 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.054237 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.054354 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.054469 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.054585 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.054701 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.054825 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.054943 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.055059 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.055175 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.055291 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.055407 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.055531 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] database.connection = **** {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.055649 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] database.connection = **** {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.055765 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.055882 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.056002 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.056119 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.056243 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.056361 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.056477 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.056593 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.056709 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.056824 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.056949 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.057067 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.057183 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.057298 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.057414 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.057544 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.057675 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.057794 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.057929 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.058051 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.058168 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.058293 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.058687 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.058816 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.058934 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.059061 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.059180 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.059296 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.059413 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.059529 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.059646 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.059769 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.059887 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.060003 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.060120 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.060236 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:19:49.060352 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 01:19:49.060478 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 01:19:49.090569 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.090726 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.090804 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.090878 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.091025 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.091111 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.099566 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.099654 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.128279 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.128480 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.128563 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.128637 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.183914 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.184587 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.321761 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.322002 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.322515 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.322760 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.390645 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.390884 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.391119 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.391317 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.391413 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.391561 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.391644 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.391788 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.391872 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.392626 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.393289 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.393544 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.418179 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.418388 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.418475 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.418630 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.418713 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.418863 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.418947 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.419082 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.419164 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.419302 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.419385 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.419521 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.419603 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.419741 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.430695 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.430842 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.444463 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.444657 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.444751 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.444890 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.444973 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.445121 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.445203 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.445349 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.445431 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.445597 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.445681 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.445821 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.445903 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79473) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.446042 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79472) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 01:19:49.463082 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.463300 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 01:19:49.463398 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.463524 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 01:19:49.463640 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.463848 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 01:19:49.463928 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.464058 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 01:19:49.464202 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.464367 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.464450 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.464631 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.464712 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.464893 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.464976 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.465154 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.475678 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.475950 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.476034 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.476225 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.476307 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.476515 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.476598 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.476816 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.485116 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.485466 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.488340 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.488627 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.488710 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.488916 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.489000 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.489204 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.489295 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.489508 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.489604 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.489787 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.489871 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.490065 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.490148 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.490342 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.490433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.490619 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.490722 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.491001 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.491082 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.491273 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.491354 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.491545 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.517567 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.517919 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.519151 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.519437 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.519518 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.519789 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.524730 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.525014 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.525107 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.525300 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.525383 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.525689 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.532569 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.532856 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.532964 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.533249 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.537276 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.537600 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.537695 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.537891 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.537975 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.538179 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.538262 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.538497 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.538591 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.538839 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.538920 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.539117 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.539239 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.539401 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.539484 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.539685 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.559513 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.559800 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.559951 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.560234 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.564431 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.564861 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.568017 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.568320 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.568456 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.568773 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.573269 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.573779 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.576834 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.577320 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.580468 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.580770 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.580879 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.581068 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.581162 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.581462 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.581570 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.581856 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.581938 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.582157 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.582242 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.582461 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.600943 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.601231 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.601521 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.601795 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.601875 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.602153 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.602426 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.602696 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.610292 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.611256 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.611967 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.612249 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.612933 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.613214 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.615281 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.615573 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.615859 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.616151 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.616243 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.616434 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.616517 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.616797 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.617095 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.617384 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.630202 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.630485 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.630771 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.631056 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.631343 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.631479 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.631632 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.631764 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.631918 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.632049 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.632334 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.632619 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.632909 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.633196 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.649437 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.650906 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.654412 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.655902 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.657686 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.659235 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.659319 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.660819 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.660903 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.661151 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.661438 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.662468 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.662753 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.663039 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.670245 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.670988 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.671822 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.672570 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.675015 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.675310 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.675601 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.675787 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.675881 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.676082 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.676388 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.676669 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.685264 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.685587 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.685878 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.686021 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.686322 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.686610 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.694205 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79473) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.694543 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.694686 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79472) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 01:19:49.694771 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.694995 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.695078 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.695280 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.695363 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.695559 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.695641 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.695856 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.695946 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.696129 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.696211 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.696415 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.696494 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.696675 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.696757 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.696944 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.697026 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.697221 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.697301 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.697505 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.697591 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.697785 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79473) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.697867 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.698077 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.698350 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79472) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 01:19:49.736678 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e0bdcee9c0 pid: 79473 (default app) Oct 27 01:19:49.737371 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e0bdcee9c0 pid: 79472 (default app) Oct 27 01:19:49.740307 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe43345-e2ae-4ec8-a45e-9cf8a2669440 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:49.741592 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe43345-e2ae-4ec8-a45e-9cf8a2669440 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:49.741884 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe43345-e2ae-4ec8-a45e-9cf8a2669440 None None] PATH_INFO: `/v3` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:49.747519 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Wed Oct 27 01:19:49 2021] GET /identity/v3/ => generated 255 bytes in 10 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:19:57.377555 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d42c9-2739-4957-b455-5a4e3f3de22b None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:57.378136 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d42c9-2739-4957-b455-5a4e3f3de22b None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:57.378415 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d42c9-2739-4957-b455-5a4e3f3de22b None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:57.383509 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:19:57 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:19:57.389321 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd454cd-699c-4711-a901-7eef2e01384a None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:57.389775 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd454cd-699c-4711-a901-7eef2e01384a None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:57.389906 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd454cd-699c-4711-a901-7eef2e01384a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:57.420339 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG oslo_db.sqlalchemy.engines [None req-5fd454cd-699c-4711-a901-7eef2e01384a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79473) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 01:19:57.607330 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG passlib.handlers.bcrypt [None req-5fd454cd-699c-4711-a901-7eef2e01384a None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79473) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 27 01:19:57.607767 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG passlib.handlers.bcrypt [None req-5fd454cd-699c-4711-a901-7eef2e01384a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79473) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 27 01:19:57.663746 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-5fd454cd-699c-4711-a901-7eef2e01384a None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:57.665260 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-5fd454cd-699c-4711-a901-7eef2e01384a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:57.800623 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:19:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:57.931156 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d42c9-2739-4957-b455-5a4e3f3de22b None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:57.964908 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG oslo_db.sqlalchemy.engines [None req-bf3d42c9-2739-4957-b455-5a4e3f3de22b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 01:19:58.096205 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d42c9-2739-4957-b455-5a4e3f3de22b None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:58.100512 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c77cb-dbf8-463a-8ce9-fdb1706b39a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:58.101181 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c77cb-dbf8-463a-8ce9-fdb1706b39a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:58.101471 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c77cb-dbf8-463a-8ce9-fdb1706b39a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:58.101785 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c77cb-dbf8-463a-8ce9-fdb1706b39a4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:58.109830 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c77cb-dbf8-463a-8ce9-fdb1706b39a4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:58.160883 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.common.rbac_enforcer.enforcer [None req-142c77cb-dbf8-463a-8ce9-fdb1706b39a4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 27 01:19:58.161230 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c77cb-dbf8-463a-8ce9-fdb1706b39a4 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:58.170520 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:19:57 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:58.178524 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd454cd-699c-4711-a901-7eef2e01384a None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:58.193381 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd454cd-699c-4711-a901-7eef2e01384a None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:58.197785 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8de7b-0414-4f89-a933-bb284e88e271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:58.199484 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8de7b-0414-4f89-a933-bb284e88e271 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:58.199769 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8de7b-0414-4f89-a933-bb284e88e271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:58.200053 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8de7b-0414-4f89-a933-bb284e88e271 admin admin] PATH_INFO: `/v3/projects/38379d318e5c49acaf4683887f433419` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:58.201583 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8de7b-0414-4f89-a933-bb284e88e271 admin admin] RBAC: Authorizing `identity:get_project(project_id=38379d318e5c49acaf4683887f433419)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:58.253853 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2ce8de7b-0414-4f89-a933-bb284e88e271 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 27 01:19:58.254202 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8de7b-0414-4f89-a933-bb284e88e271 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:58.258745 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:19:58 2021] GET /identity/v3/projects/38379d318e5c49acaf4683887f433419 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:00.475231 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c31b68-6ff9-41d1-84cc-504c55e06c6e None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:00.475801 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c31b68-6ff9-41d1-84cc-504c55e06c6e None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:00.475801 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c31b68-6ff9-41d1-84cc-504c55e06c6e None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:00.480292 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:00 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:20:00.486407 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84c99a-8ad3-4fda-8944-93bc664dfa4a None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:00.486814 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84c99a-8ad3-4fda-8944-93bc664dfa4a None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:00.486982 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84c99a-8ad3-4fda-8944-93bc664dfa4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:00.505650 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-4e84c99a-8ad3-4fda-8944-93bc664dfa4a None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:00.507147 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4e84c99a-8ad3-4fda-8944-93bc664dfa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:00.515457 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:00.537972 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c31b68-6ff9-41d1-84cc-504c55e06c6e None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:00.550286 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c31b68-6ff9-41d1-84cc-504c55e06c6e None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:00.554517 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47139ec-6716-41c9-9e66-c09ca14b95a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:00.555136 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47139ec-6716-41c9-9e66-c09ca14b95a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:00.555426 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47139ec-6716-41c9-9e66-c09ca14b95a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:00.555710 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47139ec-6716-41c9-9e66-c09ca14b95a7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:00.564207 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47139ec-6716-41c9-9e66-c09ca14b95a7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:00.566033 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47139ec-6716-41c9-9e66-c09ca14b95a7 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:00.574638 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:00 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:20:00.580501 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84c99a-8ad3-4fda-8944-93bc664dfa4a None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:00.589353 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84c99a-8ad3-4fda-8944-93bc664dfa4a None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:00.593788 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd58b5-e572-4cbd-8f9b-e0179e6bf9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:00.594632 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd58b5-e572-4cbd-8f9b-e0179e6bf9ce admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:00.594921 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd58b5-e572-4cbd-8f9b-e0179e6bf9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:00.595199 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd58b5-e572-4cbd-8f9b-e0179e6bf9ce admin admin] PATH_INFO: `/v3/users/d48900f443894ac798508f952478760c` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:00.596580 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd58b5-e572-4cbd-8f9b-e0179e6bf9ce admin admin] RBAC: Authorizing `identity:get_user(user_id=d48900f443894ac798508f952478760c)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:00.598434 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd58b5-e572-4cbd-8f9b-e0179e6bf9ce admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:00.599978 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:20:00 2021] GET /identity/v3/users/d48900f443894ac798508f952478760c => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:02.872652 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1319a8e-0690-4369-a8aa-df6a304ba92f None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:02.873170 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1319a8e-0690-4369-a8aa-df6a304ba92f None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:02.873281 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1319a8e-0690-4369-a8aa-df6a304ba92f None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:02.875010 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:02.881227 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79b001-8a7a-4850-8e28-787633805693 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:02.881672 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79b001-8a7a-4850-8e28-787633805693 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:02.881817 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79b001-8a7a-4850-8e28-787633805693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:02.899469 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-2e79b001-8a7a-4850-8e28-787633805693 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:02.900624 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-2e79b001-8a7a-4850-8e28-787633805693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:02.908592 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 6/11] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:02.917768 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3662c-0c44-4513-9d74-10d08b18dccf None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:02.918047 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3662c-0c44-4513-9d74-10d08b18dccf None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:02.918325 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3662c-0c44-4513-9d74-10d08b18dccf None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:02.920051 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 6/12] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:02.925943 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f0d5d-216b-4b2d-86ae-0a2e71068663 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:02.926236 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f0d5d-216b-4b2d-86ae-0a2e71068663 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:02.926520 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f0d5d-216b-4b2d-86ae-0a2e71068663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:02.932227 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3662c-0c44-4513-9d74-10d08b18dccf None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:02.944582 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3662c-0c44-4513-9d74-10d08b18dccf None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:02.944732 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-8d6f0d5d-216b-4b2d-86ae-0a2e71068663 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:02.945895 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-8d6f0d5d-216b-4b2d-86ae-0a2e71068663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:02.948786 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34c02b-9c63-4fd3-a9eb-b99a8a53040a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:02.949566 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34c02b-9c63-4fd3-a9eb-b99a8a53040a admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:02.949851 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34c02b-9c63-4fd3-a9eb-b99a8a53040a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:02.950129 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34c02b-9c63-4fd3-a9eb-b99a8a53040a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:02.953787 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:02.966492 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34c02b-9c63-4fd3-a9eb-b99a8a53040a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:02.973454 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-bb34c02b-9c63-4fd3-a9eb-b99a8a53040a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:20:02.974700 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 7/14] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:20:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:20:02.976466 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f0d5d-216b-4b2d-86ae-0a2e71068663 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:02.981358 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34c02b-9c63-4fd3-a9eb-b99a8a53040a admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:02.985872 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f0d5d-216b-4b2d-86ae-0a2e71068663 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:02.990244 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227cc40-7a89-4e52-a18c-5442133b789e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:02.990881 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227cc40-7a89-4e52-a18c-5442133b789e admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:02.991163 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227cc40-7a89-4e52-a18c-5442133b789e admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:02.991440 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227cc40-7a89-4e52-a18c-5442133b789e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:02.991959 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34c02b-9c63-4fd3-a9eb-b99a8a53040a admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:02.996788 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e2fb0-7175-4f5b-9efe-ec891a86633d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:02.997397 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e2fb0-7175-4f5b-9efe-ec891a86633d admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:02.997716 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e2fb0-7175-4f5b-9efe-ec891a86633d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:02.997996 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e2fb0-7175-4f5b-9efe-ec891a86633d admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:02.998743 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e2fb0-7175-4f5b-9efe-ec891a86633d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:02.999045 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e2fb0-7175-4f5b-9efe-ec891a86633d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:02.999876 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227cc40-7a89-4e52-a18c-5442133b789e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:03.000712 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING py.warnings [None req-be1e2fb0-7175-4f5b-9efe-ec891a86633d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:03.000712 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: warnings.warn(msg) Oct 27 01:20:03.000712 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: Oct 27 01:20:03.001637 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e2fb0-7175-4f5b-9efe-ec891a86633d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:03.001736 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227cc40-7a89-4e52-a18c-5442133b789e admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:03.010432 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 8/15] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:02 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:03.015045 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 8/16] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:03.016504 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227cc40-7a89-4e52-a18c-5442133b789e admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:03.020816 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e2fb0-7175-4f5b-9efe-ec891a86633d admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:03.024938 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227cc40-7a89-4e52-a18c-5442133b789e admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:03.029313 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb639e9b-a5ca-4f7b-aaf7-dcf3df3105ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:03.030075 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e2fb0-7175-4f5b-9efe-ec891a86633d admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:03.030174 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb639e9b-a5ca-4f7b-aaf7-dcf3df3105ba admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:03.030379 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb639e9b-a5ca-4f7b-aaf7-dcf3df3105ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:03.030654 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb639e9b-a5ca-4f7b-aaf7-dcf3df3105ba admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:03.031818 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb639e9b-a5ca-4f7b-aaf7-dcf3df3105ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:03.033532 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb639e9b-a5ca-4f7b-aaf7-dcf3df3105ba admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:03.034378 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811be87b-e1ff-4edb-b856-6fb162a862ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:03.035228 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 9/17] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:03 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:03.035345 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811be87b-e1ff-4edb-b856-6fb162a862ec admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:03.035473 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811be87b-e1ff-4edb-b856-6fb162a862ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:03.035752 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811be87b-e1ff-4edb-b856-6fb162a862ec admin admin] PATH_INFO: `/v3/users/d48900f443894ac798508f952478760c` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:03.037432 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811be87b-e1ff-4edb-b856-6fb162a862ec admin admin] RBAC: Authorizing `identity:get_user(user_id=d48900f443894ac798508f952478760c)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:03.039293 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811be87b-e1ff-4edb-b856-6fb162a862ec admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:03.040933 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 9/18] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:20:03 2021] GET /identity/v3/users/d48900f443894ac798508f952478760c => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:03.047683 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb639e9b-a5ca-4f7b-aaf7-dcf3df3105ba admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:03.058011 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb639e9b-a5ca-4f7b-aaf7-dcf3df3105ba admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:03.062907 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a48371-9aae-44b5-aa3b-9cef5d6c008c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:03.063722 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a48371-9aae-44b5-aa3b-9cef5d6c008c admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:03.064009 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a48371-9aae-44b5-aa3b-9cef5d6c008c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:03.064291 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a48371-9aae-44b5-aa3b-9cef5d6c008c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:03.065586 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a48371-9aae-44b5-aa3b-9cef5d6c008c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:03.067325 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a48371-9aae-44b5-aa3b-9cef5d6c008c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:03.068982 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 10/19] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:03 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:03.076270 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811be87b-e1ff-4edb-b856-6fb162a862ec admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:03.086228 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811be87b-e1ff-4edb-b856-6fb162a862ec admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:03.091412 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d93068-4e04-4f05-a320-f347c308718d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:03.092092 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d93068-4e04-4f05-a320-f347c308718d admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:03.092382 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d93068-4e04-4f05-a320-f347c308718d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:03.092663 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d93068-4e04-4f05-a320-f347c308718d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:03.093555 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d93068-4e04-4f05-a320-f347c308718d admin admin] RBAC: Adding query filter params (role.id=df3a437e6ea14518a9c1b9a348e18c99, scope.domain.id=default, user.id=d48900f443894ac798508f952478760c) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:03.093873 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d93068-4e04-4f05-a320-f347c308718d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:03.094899 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING py.warnings [None req-66d93068-4e04-4f05-a320-f347c308718d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:03.094899 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: warnings.warn(msg) Oct 27 01:20:03.094899 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: Oct 27 01:20:03.096108 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d93068-4e04-4f05-a320-f347c308718d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:03.106189 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 10/20] 10.222.0.25 () {56 vars in 1343 bytes} [Wed Oct 27 01:20:03 2021] GET /identity/v3/role_assignments?user.id=d48900f443894ac798508f952478760c&scope.domain.id=default&role.id=df3a437e6ea14518a9c1b9a348e18c99 => generated 233 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:05.697566 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549ec48-52fd-4de5-8bfe-dd9634a44e35 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:05.698690 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549ec48-52fd-4de5-8bfe-dd9634a44e35 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:05.699181 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549ec48-52fd-4de5-8bfe-dd9634a44e35 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:05.701823 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 11/21] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:05.708654 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91852b6-759c-43b9-ae5a-e93121ce64b0 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:05.709580 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91852b6-759c-43b9-ae5a-e93121ce64b0 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:05.710073 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91852b6-759c-43b9-ae5a-e93121ce64b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:05.749519 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG passlib.handlers.bcrypt [None req-e91852b6-759c-43b9-ae5a-e93121ce64b0 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79472) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 27 01:20:05.750319 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG passlib.handlers.bcrypt [None req-e91852b6-759c-43b9-ae5a-e93121ce64b0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79472) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 27 01:20:05.797466 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-e91852b6-759c-43b9-ae5a-e93121ce64b0 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:05.799555 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-e91852b6-759c-43b9-ae5a-e93121ce64b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:05.833619 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 11/22] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:05.846934 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0048e-cd06-4d44-a569-472ff3509ee5 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:05.847523 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0048e-cd06-4d44-a569-472ff3509ee5 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:05.848053 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0048e-cd06-4d44-a569-472ff3509ee5 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:05.850491 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 12/23] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:05.857165 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd88c3-1c4e-4295-ba1e-713834b2b7f5 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:05.857573 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd88c3-1c4e-4295-ba1e-713834b2b7f5 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:05.857783 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd88c3-1c4e-4295-ba1e-713834b2b7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:05.859152 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0048e-cd06-4d44-a569-472ff3509ee5 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:05.873974 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0048e-cd06-4d44-a569-472ff3509ee5 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:05.878778 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45566f-27c7-402d-8737-0108d5b469fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:05.879806 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45566f-27c7-402d-8737-0108d5b469fe admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:05.880316 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45566f-27c7-402d-8737-0108d5b469fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:05.880791 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45566f-27c7-402d-8737-0108d5b469fe admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:05.895425 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45566f-27c7-402d-8737-0108d5b469fe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:05.902543 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-0afd88c3-1c4e-4295-ba1e-713834b2b7f5 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:05.903468 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-4e45566f-27c7-402d-8737-0108d5b469fe admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:20:05.903783 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-0afd88c3-1c4e-4295-ba1e-713834b2b7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:05.909683 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 13/24] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:20:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:05.912483 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45566f-27c7-402d-8737-0108d5b469fe admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:05.923627 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45566f-27c7-402d-8737-0108d5b469fe admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:05.924135 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 12/25] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:05.929040 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6f44e-288e-4770-9cd9-0af0b607f850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:05.930062 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6f44e-288e-4770-9cd9-0af0b607f850 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:05.930563 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6f44e-288e-4770-9cd9-0af0b607f850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:05.931037 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6f44e-288e-4770-9cd9-0af0b607f850 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:05.932007 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6f44e-288e-4770-9cd9-0af0b607f850 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:05.932626 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6f44e-288e-4770-9cd9-0af0b607f850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:05.934859 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING py.warnings [None req-37a6f44e-288e-4770-9cd9-0af0b607f850 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:05.934859 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: warnings.warn(msg) Oct 27 01:20:05.934859 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: Oct 27 01:20:05.936091 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6f44e-288e-4770-9cd9-0af0b607f850 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:05.955997 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 14/26] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:05.957693 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd88c3-1c4e-4295-ba1e-713834b2b7f5 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:05.970972 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd88c3-1c4e-4295-ba1e-713834b2b7f5 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:05.972529 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6f44e-288e-4770-9cd9-0af0b607f850 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:05.983918 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6f44e-288e-4770-9cd9-0af0b607f850 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:05.988886 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0548d7-6556-4d31-aac8-2580ee62dc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:05.989838 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0548d7-6556-4d31-aac8-2580ee62dc2d admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:05.990180 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ac9e2-0835-452e-8cdf-c376d66521e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:05.990555 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0548d7-6556-4d31-aac8-2580ee62dc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:05.991027 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0548d7-6556-4d31-aac8-2580ee62dc2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:05.991146 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ac9e2-0835-452e-8cdf-c376d66521e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:05.991342 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ac9e2-0835-452e-8cdf-c376d66521e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:05.991621 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ac9e2-0835-452e-8cdf-c376d66521e7 admin admin] PATH_INFO: `/v3/users/d48900f443894ac798508f952478760c` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:05.992604 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0548d7-6556-4d31-aac8-2580ee62dc2d admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:05.993203 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ac9e2-0835-452e-8cdf-c376d66521e7 admin admin] RBAC: Authorizing `identity:get_user(user_id=d48900f443894ac798508f952478760c)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:05.994064 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING py.warnings [None req-ee0548d7-6556-4d31-aac8-2580ee62dc2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:05.994064 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: warnings.warn(msg) Oct 27 01:20:05.994064 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: Oct 27 01:20:05.995181 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ac9e2-0835-452e-8cdf-c376d66521e7 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:05.995803 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0548d7-6556-4d31-aac8-2580ee62dc2d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:06.001505 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 13/27] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:20:05 2021] GET /identity/v3/users/d48900f443894ac798508f952478760c => generated 247 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:06.008676 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ac9e2-0835-452e-8cdf-c376d66521e7 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:06.023424 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ac9e2-0835-452e-8cdf-c376d66521e7 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:06.042284 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a5700-7650-4fd1-bc18-4d874182d9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:06.043100 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a5700-7650-4fd1-bc18-4d874182d9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:06.043385 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a5700-7650-4fd1-bc18-4d874182d9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:06.043662 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a5700-7650-4fd1-bc18-4d874182d9d9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:06.044952 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a5700-7650-4fd1-bc18-4d874182d9d9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:06.046695 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a5700-7650-4fd1-bc18-4d874182d9d9 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:06.048668 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 14/28] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:06 2021] GET /identity/v3/domains/default => generated 199 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:06.055135 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a5700-7650-4fd1-bc18-4d874182d9d9 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:06.079643 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a5700-7650-4fd1-bc18-4d874182d9d9 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:06.098226 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60926791-12c4-44a5-b496-d69f3f98756c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:06.099355 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60926791-12c4-44a5-b496-d69f3f98756c admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:06.099789 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60926791-12c4-44a5-b496-d69f3f98756c admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:06.100214 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60926791-12c4-44a5-b496-d69f3f98756c admin admin] PATH_INFO: `/v3/domains/default/users/d48900f443894ac798508f952478760c/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:06.102602 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60926791-12c4-44a5-b496-d69f3f98756c admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d48900f443894ac798508f952478760c, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:06.103850 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING py.warnings [None req-60926791-12c4-44a5-b496-d69f3f98756c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:06.103850 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: warnings.warn(msg) Oct 27 01:20:06.103850 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: Oct 27 01:20:06.106728 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60926791-12c4-44a5-b496-d69f3f98756c admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:06.154886 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 15/29] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:05 2021] POST /identity/v3/roles => generated 219 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:20:06.276953 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 15/30] 10.222.0.25 () {58 vars in 1382 bytes} [Wed Oct 27 01:20:06 2021] PUT /identity/v3/domains/default/users/d48900f443894ac798508f952478760c/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:06.327251 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4ef35-2867-41dc-9ada-a9051cdc9a06 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:06.327905 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4ef35-2867-41dc-9ada-a9051cdc9a06 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:06.328396 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4ef35-2867-41dc-9ada-a9051cdc9a06 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:06.330831 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 16/31] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:06.342340 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e58f8e-3071-4451-836a-0185b9fab3d1 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:06.342648 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e58f8e-3071-4451-836a-0185b9fab3d1 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:06.342929 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e58f8e-3071-4451-836a-0185b9fab3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:06.375111 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-88e58f8e-3071-4451-836a-0185b9fab3d1 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:06.376709 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-88e58f8e-3071-4451-836a-0185b9fab3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:06.468757 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 16/32] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:06.508515 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4ef35-2867-41dc-9ada-a9051cdc9a06 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:06.530831 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c7a84-593c-4477-83ab-93d54fe74af0 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:06.531119 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c7a84-593c-4477-83ab-93d54fe74af0 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:06.531326 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c7a84-593c-4477-83ab-93d54fe74af0 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:06.531576 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4ef35-2867-41dc-9ada-a9051cdc9a06 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:06.536482 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 17/33] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:06 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:06.538693 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90a0eb-4d28-4d3a-9144-96fd9e9efe69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:06.539391 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90a0eb-4d28-4d3a-9144-96fd9e9efe69 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:06.539683 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90a0eb-4d28-4d3a-9144-96fd9e9efe69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:06.539969 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90a0eb-4d28-4d3a-9144-96fd9e9efe69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:06.540762 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90a0eb-4d28-4d3a-9144-96fd9e9efe69 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:06.542870 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90a0eb-4d28-4d3a-9144-96fd9e9efe69 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:06.544611 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacb476-0357-49a6-8815-dbc142411d04 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:06.545127 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacb476-0357-49a6-8815-dbc142411d04 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:06.545664 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacb476-0357-49a6-8815-dbc142411d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:06.571293 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 17/34] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:06 2021] POST /identity/v3/roles => generated 225 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:06.579008 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-6eacb476-0357-49a6-8815-dbc142411d04 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:06.580901 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-6eacb476-0357-49a6-8815-dbc142411d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:06.597285 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 18/35] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:06.624869 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90a0eb-4d28-4d3a-9144-96fd9e9efe69 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:06.637668 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90a0eb-4d28-4d3a-9144-96fd9e9efe69 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:06.642845 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386a190-fca4-483e-ac8d-afbece469622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:06.643982 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386a190-fca4-483e-ac8d-afbece469622 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:06.644524 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386a190-fca4-483e-ac8d-afbece469622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:06.645049 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386a190-fca4-483e-ac8d-afbece469622 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:06.659532 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386a190-fca4-483e-ac8d-afbece469622 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:06.661899 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386a190-fca4-483e-ac8d-afbece469622 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:06.680701 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-a386a190-fca4-483e-ac8d-afbece469622 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:06.682842 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 18/36] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:06.691890 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacb476-0357-49a6-8815-dbc142411d04 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:06.706972 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacb476-0357-49a6-8815-dbc142411d04 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:06.715035 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a976a2-8821-42ce-84fd-f6b255c3e454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:06.716564 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a976a2-8821-42ce-84fd-f6b255c3e454 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:06.717099 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a976a2-8821-42ce-84fd-f6b255c3e454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:06.717701 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a976a2-8821-42ce-84fd-f6b255c3e454 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:06.718679 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a976a2-8821-42ce-84fd-f6b255c3e454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:06.719210 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a976a2-8821-42ce-84fd-f6b255c3e454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:06.720642 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING py.warnings [None req-b7a976a2-8821-42ce-84fd-f6b255c3e454 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:06.720642 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: warnings.warn(msg) Oct 27 01:20:06.720642 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: Oct 27 01:20:06.722075 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a976a2-8821-42ce-84fd-f6b255c3e454 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:06.742752 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 19/37] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:06.749770 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386a190-fca4-483e-ac8d-afbece469622 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:06.761932 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386a190-fca4-483e-ac8d-afbece469622 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:06.770083 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b8860-a7d5-406b-8358-52134a53df56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:06.771161 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b8860-a7d5-406b-8358-52134a53df56 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:06.771656 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b8860-a7d5-406b-8358-52134a53df56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:06.772141 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b8860-a7d5-406b-8358-52134a53df56 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:06.773180 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b8860-a7d5-406b-8358-52134a53df56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:06.774457 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING py.warnings [None req-d07b8860-a7d5-406b-8358-52134a53df56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:06.774457 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: warnings.warn(msg) Oct 27 01:20:06.774457 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: Oct 27 01:20:06.776180 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b8860-a7d5-406b-8358-52134a53df56 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:06.811621 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 19/38] 10.222.0.25 () {60 vars in 1162 bytes} [Wed Oct 27 01:20:06 2021] POST /identity/v3/projects => generated 301 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:07.271447 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5183e-4aac-4053-8c7c-52293b8c5303 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:07.271741 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5183e-4aac-4053-8c7c-52293b8c5303 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:07.272186 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5183e-4aac-4053-8c7c-52293b8c5303 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:07.274172 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 20/39] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:07.280651 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639de7d9-fc7d-4098-9585-2b2e7920194d None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:07.280950 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639de7d9-fc7d-4098-9585-2b2e7920194d None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:07.281235 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639de7d9-fc7d-4098-9585-2b2e7920194d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:07.299853 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-639de7d9-fc7d-4098-9585-2b2e7920194d None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:07.301385 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-639de7d9-fc7d-4098-9585-2b2e7920194d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:07.357142 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 20/40] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:07.380231 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5183e-4aac-4053-8c7c-52293b8c5303 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:07.393658 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5183e-4aac-4053-8c7c-52293b8c5303 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:07.398347 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4185fb8-5618-44a6-8683-7c7eb870cb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:07.399224 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4185fb8-5618-44a6-8683-7c7eb870cb17 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:07.399691 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4185fb8-5618-44a6-8683-7c7eb870cb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:07.400159 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4185fb8-5618-44a6-8683-7c7eb870cb17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:07.401765 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4185fb8-5618-44a6-8683-7c7eb870cb17 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:07.402991 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING py.warnings [None req-c4185fb8-5618-44a6-8683-7c7eb870cb17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:07.402991 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: warnings.warn(msg) Oct 27 01:20:07.402991 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: Oct 27 01:20:07.403995 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4185fb8-5618-44a6-8683-7c7eb870cb17 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:07.421173 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 21/41] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:07 2021] POST /identity/v3/roles => generated 223 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:07.563118 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816d774-8e25-4357-a3c8-dc0948db767a None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:07.563322 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816d774-8e25-4357-a3c8-dc0948db767a None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:07.563778 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816d774-8e25-4357-a3c8-dc0948db767a None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:07.565996 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 21/42] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:07.572326 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8068687-4842-484d-85e6-d8d70fd3acf4 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:07.572618 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8068687-4842-484d-85e6-d8d70fd3acf4 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:07.573625 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8068687-4842-484d-85e6-d8d70fd3acf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:07.592839 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-f8068687-4842-484d-85e6-d8d70fd3acf4 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:07.594123 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-f8068687-4842-484d-85e6-d8d70fd3acf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:07.602242 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 22/43] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:07.625762 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816d774-8e25-4357-a3c8-dc0948db767a None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:07.643641 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816d774-8e25-4357-a3c8-dc0948db767a None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:07.648965 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161fbf5-360e-47f8-b2b6-b169e594dd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:07.649818 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161fbf5-360e-47f8-b2b6-b169e594dd53 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:07.650292 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161fbf5-360e-47f8-b2b6-b169e594dd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:07.650741 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161fbf5-360e-47f8-b2b6-b169e594dd53 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:07.653319 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161fbf5-360e-47f8-b2b6-b169e594dd53 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:07.655124 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161fbf5-360e-47f8-b2b6-b169e594dd53 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:07.656789 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 22/44] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:07 2021] GET /identity/v3/domains/default => generated 199 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:07.663206 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8068687-4842-484d-85e6-d8d70fd3acf4 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:07.672554 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8068687-4842-484d-85e6-d8d70fd3acf4 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:07.679636 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7cd22-f691-44dd-8eaf-a728daf57528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:07.680303 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7cd22-f691-44dd-8eaf-a728daf57528 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:07.680597 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7cd22-f691-44dd-8eaf-a728daf57528 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:07.680882 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7cd22-f691-44dd-8eaf-a728daf57528 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:07.681663 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7cd22-f691-44dd-8eaf-a728daf57528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:07.683488 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING py.warnings [None req-d7c7cd22-f691-44dd-8eaf-a728daf57528 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:07.683488 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: warnings.warn(msg) Oct 27 01:20:07.683488 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: Oct 27 01:20:07.684729 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7cd22-f691-44dd-8eaf-a728daf57528 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:07.711415 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 23/45] 10.222.0.25 () {60 vars in 1162 bytes} [Wed Oct 27 01:20:07 2021] POST /identity/v3/projects => generated 312 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:08.805990 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e61e0-824f-4669-930d-c7412f506f76 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:08.806518 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e61e0-824f-4669-930d-c7412f506f76 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:08.806601 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e61e0-824f-4669-930d-c7412f506f76 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:08.808746 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 23/46] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:08.814939 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539233c-1dc5-465f-918b-6c41867472bc None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:08.815383 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539233c-1dc5-465f-918b-6c41867472bc None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:08.815650 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539233c-1dc5-465f-918b-6c41867472bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:08.833470 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-5539233c-1dc5-465f-918b-6c41867472bc None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:08.834677 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-5539233c-1dc5-465f-918b-6c41867472bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:08.890723 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 24/47] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:08.915186 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e61e0-824f-4669-930d-c7412f506f76 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:08.926938 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e61e0-824f-4669-930d-c7412f506f76 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:08.931134 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfaea2-f55f-40fe-8ca7-236e968b0670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:08.931907 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfaea2-f55f-40fe-8ca7-236e968b0670 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:08.932191 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfaea2-f55f-40fe-8ca7-236e968b0670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:08.932468 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfaea2-f55f-40fe-8ca7-236e968b0670 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:08.942508 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcfaea2-f55f-40fe-8ca7-236e968b0670 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:08.949813 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-1fcfaea2-f55f-40fe-8ca7-236e968b0670 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:20:08.953645 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 24/48] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:20:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:08.957366 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539233c-1dc5-465f-918b-6c41867472bc None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:08.966990 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539233c-1dc5-465f-918b-6c41867472bc None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:08.971513 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1dfaf-7d11-4c7a-8c13-cc131292dbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:08.972181 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1dfaf-7d11-4c7a-8c13-cc131292dbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:08.972474 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1dfaf-7d11-4c7a-8c13-cc131292dbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:08.972756 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1dfaf-7d11-4c7a-8c13-cc131292dbf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:08.973575 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1dfaf-7d11-4c7a-8c13-cc131292dbf0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:08.973894 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1dfaf-7d11-4c7a-8c13-cc131292dbf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:08.975511 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1dfaf-7d11-4c7a-8c13-cc131292dbf0 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:08.984124 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 25/49] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:08.990239 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfaea2-f55f-40fe-8ca7-236e968b0670 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:09.000381 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfaea2-f55f-40fe-8ca7-236e968b0670 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:09.004805 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06036094-0e75-46e1-8f8f-d61457811d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:09.005699 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06036094-0e75-46e1-8f8f-d61457811d21 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:09.006121 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06036094-0e75-46e1-8f8f-d61457811d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:09.006404 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06036094-0e75-46e1-8f8f-d61457811d21 admin admin] PATH_INFO: `/v3/users/d48900f443894ac798508f952478760c` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:09.007651 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06036094-0e75-46e1-8f8f-d61457811d21 admin admin] RBAC: Authorizing `identity:get_user(user_id=d48900f443894ac798508f952478760c)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:09.009496 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06036094-0e75-46e1-8f8f-d61457811d21 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:09.011615 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 25/50] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:20:08 2021] GET /identity/v3/users/d48900f443894ac798508f952478760c => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:09.017446 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1dfaf-7d11-4c7a-8c13-cc131292dbf0 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:09.027431 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1dfaf-7d11-4c7a-8c13-cc131292dbf0 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:09.031696 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7ef22-cc70-4388-9921-8470a28040ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:09.032469 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7ef22-cc70-4388-9921-8470a28040ef admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:09.032756 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7ef22-cc70-4388-9921-8470a28040ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:09.033035 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7ef22-cc70-4388-9921-8470a28040ef admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:09.034224 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7ef22-cc70-4388-9921-8470a28040ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:09.035930 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7ef22-cc70-4388-9921-8470a28040ef admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:09.037476 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 26/51] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:09 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:09.043534 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06036094-0e75-46e1-8f8f-d61457811d21 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:09.053123 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06036094-0e75-46e1-8f8f-d61457811d21 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:09.057612 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9a8c4-712e-4f85-bd11-eb3633a63bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:09.058454 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9a8c4-712e-4f85-bd11-eb3633a63bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:09.058746 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9a8c4-712e-4f85-bd11-eb3633a63bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:09.059031 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9a8c4-712e-4f85-bd11-eb3633a63bb0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:09.059874 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9a8c4-712e-4f85-bd11-eb3633a63bb0 admin admin] RBAC: Adding query filter params (role.id=df3a437e6ea14518a9c1b9a348e18c99, scope.domain.id=default, user.id=d48900f443894ac798508f952478760c) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:09.060190 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9a8c4-712e-4f85-bd11-eb3633a63bb0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:09.061196 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING py.warnings [None req-fee9a8c4-712e-4f85-bd11-eb3633a63bb0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:09.061196 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: warnings.warn(msg) Oct 27 01:20:09.061196 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: Oct 27 01:20:09.062392 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9a8c4-712e-4f85-bd11-eb3633a63bb0 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:09.069465 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 26/52] 10.222.0.25 () {56 vars in 1343 bytes} [Wed Oct 27 01:20:09 2021] GET /identity/v3/role_assignments?user.id=d48900f443894ac798508f952478760c&scope.domain.id=default&role.id=df3a437e6ea14518a9c1b9a348e18c99 => generated 530 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:09.965001 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee666ce-831e-4a9b-a61e-1efee19ec418 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:09.965527 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee666ce-831e-4a9b-a61e-1efee19ec418 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:09.965612 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee666ce-831e-4a9b-a61e-1efee19ec418 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:09.967399 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 27/53] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:09.973408 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bf023-6ebb-4667-9135-2565e1be7d3d None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:09.973829 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bf023-6ebb-4667-9135-2565e1be7d3d None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:09.974007 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bf023-6ebb-4667-9135-2565e1be7d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:09.991942 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-9e0bf023-6ebb-4667-9135-2565e1be7d3d None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:09.993140 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-9e0bf023-6ebb-4667-9135-2565e1be7d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:10.000664 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 27/54] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:10.024151 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee666ce-831e-4a9b-a61e-1efee19ec418 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:10.036405 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee666ce-831e-4a9b-a61e-1efee19ec418 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:10.040617 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed74a2-bf2c-4880-bb7b-22f62931f9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:10.041391 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed74a2-bf2c-4880-bb7b-22f62931f9cd admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:10.042338 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed74a2-bf2c-4880-bb7b-22f62931f9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:10.042678 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed74a2-bf2c-4880-bb7b-22f62931f9cd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:10.043857 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed74a2-bf2c-4880-bb7b-22f62931f9cd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:10.045606 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed74a2-bf2c-4880-bb7b-22f62931f9cd admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:10.047168 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 28/55] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:10 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:10.052802 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bf023-6ebb-4667-9135-2565e1be7d3d None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:10.061652 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bf023-6ebb-4667-9135-2565e1be7d3d None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:10.066014 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94685ef-88ce-4e75-bf14-8d50a9c04e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:10.066659 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94685ef-88ce-4e75-bf14-8d50a9c04e88 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:10.066948 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94685ef-88ce-4e75-bf14-8d50a9c04e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:10.067233 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94685ef-88ce-4e75-bf14-8d50a9c04e88 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:10.067954 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94685ef-88ce-4e75-bf14-8d50a9c04e88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:10.069898 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94685ef-88ce-4e75-bf14-8d50a9c04e88 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:10.094205 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 28/56] 10.222.0.25 () {60 vars in 1161 bytes} [Wed Oct 27 01:20:10 2021] POST /identity/v3/projects => generated 298 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:20:12.298717 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e4619-2d51-486b-98a9-4dfc8e83f13f None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:12.299216 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e4619-2d51-486b-98a9-4dfc8e83f13f None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:12.299216 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e4619-2d51-486b-98a9-4dfc8e83f13f None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:12.300970 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 29/57] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:12.306919 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5dbd0a-8062-4c33-91cd-862ea4d5c582 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:12.307847 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5dbd0a-8062-4c33-91cd-862ea4d5c582 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:12.307998 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5dbd0a-8062-4c33-91cd-862ea4d5c582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:12.326144 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-4e5dbd0a-8062-4c33-91cd-862ea4d5c582 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:12.327347 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4e5dbd0a-8062-4c33-91cd-862ea4d5c582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:12.381723 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 29/58] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:12.406815 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e4619-2d51-486b-98a9-4dfc8e83f13f None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:12.419287 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e4619-2d51-486b-98a9-4dfc8e83f13f None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:12.423590 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d452521-970f-4eb6-824f-77217598f71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:12.424356 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d452521-970f-4eb6-824f-77217598f71b admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:12.424646 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d452521-970f-4eb6-824f-77217598f71b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:12.424927 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d452521-970f-4eb6-824f-77217598f71b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:12.426153 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d452521-970f-4eb6-824f-77217598f71b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:12.427838 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d452521-970f-4eb6-824f-77217598f71b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:12.429398 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 30/59] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:12 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:12.435165 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5dbd0a-8062-4c33-91cd-862ea4d5c582 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:12.443669 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5dbd0a-8062-4c33-91cd-862ea4d5c582 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:12.448126 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d59fc-c1ce-44ac-9c78-18b75aead9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:12.448773 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d59fc-c1ce-44ac-9c78-18b75aead9b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:12.449064 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d59fc-c1ce-44ac-9c78-18b75aead9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:12.449350 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d59fc-c1ce-44ac-9c78-18b75aead9b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:12.450113 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d59fc-c1ce-44ac-9c78-18b75aead9b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:12.451120 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING py.warnings [None req-457d59fc-c1ce-44ac-9c78-18b75aead9b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:12.451120 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: warnings.warn(msg) Oct 27 01:20:12.451120 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: Oct 27 01:20:12.452359 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d59fc-c1ce-44ac-9c78-18b75aead9b7 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:12.476399 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 30/60] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Oct 27 01:20:12 2021] POST /identity/v3/users => generated 275 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:20:15.813448 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f567bf-5615-40e4-a03f-0f567af13272 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:15.814593 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f567bf-5615-40e4-a03f-0f567af13272 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:15.815087 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f567bf-5615-40e4-a03f-0f567af13272 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:15.817633 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 31/61] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:15.824156 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d9753-f816-43b8-a792-5a5ab7d23ea3 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:15.825129 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d9753-f816-43b8-a792-5a5ab7d23ea3 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:15.825692 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d9753-f816-43b8-a792-5a5ab7d23ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:15.851013 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-709d9753-f816-43b8-a792-5a5ab7d23ea3 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:15.852640 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-709d9753-f816-43b8-a792-5a5ab7d23ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:15.864751 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 31/62] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:15.910935 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f567bf-5615-40e4-a03f-0f567af13272 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:15.927295 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f567bf-5615-40e4-a03f-0f567af13272 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:15.938116 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a13ff-145b-4e59-b003-9b59fb3351b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:15.939168 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a13ff-145b-4e59-b003-9b59fb3351b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:15.939658 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a13ff-145b-4e59-b003-9b59fb3351b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:15.940134 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a13ff-145b-4e59-b003-9b59fb3351b5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:15.954806 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a13ff-145b-4e59-b003-9b59fb3351b5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:15.962437 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-279a13ff-145b-4e59-b003-9b59fb3351b5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:20:15.964659 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 32/63] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:15 2021] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:15.973704 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d9753-f816-43b8-a792-5a5ab7d23ea3 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:15.985407 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d9753-f816-43b8-a792-5a5ab7d23ea3 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:15.993083 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd19e7-c02f-40ff-a307-af64539d9dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:15.993839 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd19e7-c02f-40ff-a307-af64539d9dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:15.994128 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd19e7-c02f-40ff-a307-af64539d9dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:15.994451 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd19e7-c02f-40ff-a307-af64539d9dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:15.995254 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd19e7-c02f-40ff-a307-af64539d9dd7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:15.995591 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd19e7-c02f-40ff-a307-af64539d9dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:15.997225 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd19e7-c02f-40ff-a307-af64539d9dd7 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.015761 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 32/64] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Oct 27 01:20:15 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:16.019012 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10e95b-53cc-4f90-b3a9-fd97446c9854 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.019533 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10e95b-53cc-4f90-b3a9-fd97446c9854 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.020031 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10e95b-53cc-4f90-b3a9-fd97446c9854 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.021946 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd19e7-c02f-40ff-a307-af64539d9dd7 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.022549 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 33/65] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:16.029129 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33bef5-5964-4eea-9667-1cc9bbe04335 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.029758 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33bef5-5964-4eea-9667-1cc9bbe04335 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.030265 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33bef5-5964-4eea-9667-1cc9bbe04335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.042141 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd19e7-c02f-40ff-a307-af64539d9dd7 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.053471 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b8c7b-d218-4859-9d91-7c3663222c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.053471 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b8c7b-d218-4859-9d91-7c3663222c8d admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.053471 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b8c7b-d218-4859-9d91-7c3663222c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.053471 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b8c7b-d218-4859-9d91-7c3663222c8d admin admin] PATH_INFO: `/v3/users/ec851783eb6e47d286a7d11681c3f75a` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.061896 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-2e33bef5-5964-4eea-9667-1cc9bbe04335 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:16.061896 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-2e33bef5-5964-4eea-9667-1cc9bbe04335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:16.076188 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 34/66] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:16.083138 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b8c7b-d218-4859-9d91-7c3663222c8d admin admin] RBAC: Authorizing `identity:get_user(user_id=ec851783eb6e47d286a7d11681c3f75a)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.085324 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b8c7b-d218-4859-9d91-7c3663222c8d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.087136 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 33/67] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:20:16 2021] GET /identity/v3/users/ec851783eb6e47d286a7d11681c3f75a => generated 275 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:16.093898 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33bef5-5964-4eea-9667-1cc9bbe04335 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.102424 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b8c7b-d218-4859-9d91-7c3663222c8d admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.107014 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33bef5-5964-4eea-9667-1cc9bbe04335 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.115236 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b8c7b-d218-4859-9d91-7c3663222c8d admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.117931 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40dc2a-b445-42f1-9abe-9f32fbe41882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.118824 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40dc2a-b445-42f1-9abe-9f32fbe41882 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.119346 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40dc2a-b445-42f1-9abe-9f32fbe41882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.119865 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40dc2a-b445-42f1-9abe-9f32fbe41882 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.129670 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e532b0-7e79-444d-85ea-819390327db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.130734 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e532b0-7e79-444d-85ea-819390327db3 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.131221 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e532b0-7e79-444d-85ea-819390327db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.131698 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e532b0-7e79-444d-85ea-819390327db3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.135594 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40dc2a-b445-42f1-9abe-9f32fbe41882 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.138325 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40dc2a-b445-42f1-9abe-9f32fbe41882 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.148029 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 35/68] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:16 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:16.153806 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e532b0-7e79-444d-85ea-819390327db3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:16.155646 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40dc2a-b445-42f1-9abe-9f32fbe41882 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.167455 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-40e532b0-7e79-444d-85ea-819390327db3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:20:16.172946 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40dc2a-b445-42f1-9abe-9f32fbe41882 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.177504 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:20:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:16.177504 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba62cf1-44b5-46cf-8e5b-9278871397d0 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.177504 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba62cf1-44b5-46cf-8e5b-9278871397d0 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.177504 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba62cf1-44b5-46cf-8e5b-9278871397d0 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.179814 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 35/70] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:16.182585 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba62cf1-44b5-46cf-8e5b-9278871397d0 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.185610 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2767b8-e2ba-4a17-aae2-e075ba6937f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.186808 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2767b8-e2ba-4a17-aae2-e075ba6937f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.187379 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2767b8-e2ba-4a17-aae2-e075ba6937f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.187923 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2767b8-e2ba-4a17-aae2-e075ba6937f3 admin admin] PATH_INFO: `/v3/projects/f405caf5e07a413190b7459d3015b944` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.189347 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2767b8-e2ba-4a17-aae2-e075ba6937f3 admin admin] RBAC: Authorizing `identity:get_project(project_id=f405caf5e07a413190b7459d3015b944)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.191646 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2767b8-e2ba-4a17-aae2-e075ba6937f3 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.193821 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 36/71] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:16 2021] GET /identity/v3/projects/f405caf5e07a413190b7459d3015b944 => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:16.195266 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0e7dd-3e13-4150-846c-b7e1f1844be7 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.195775 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0e7dd-3e13-4150-846c-b7e1f1844be7 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.196252 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0e7dd-3e13-4150-846c-b7e1f1844be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.202228 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba62cf1-44b5-46cf-8e5b-9278871397d0 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.207370 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1faf04-dfd5-4956-b34b-34b8829f6d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.208036 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1faf04-dfd5-4956-b34b-34b8829f6d05 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.208327 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1faf04-dfd5-4956-b34b-34b8829f6d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.208613 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1faf04-dfd5-4956-b34b-34b8829f6d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.209439 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1faf04-dfd5-4956-b34b-34b8829f6d05 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:16.209787 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1faf04-dfd5-4956-b34b-34b8829f6d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.211466 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1faf04-dfd5-4956-b34b-34b8829f6d05 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.217188 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-42d0e7dd-3e13-4150-846c-b7e1f1844be7 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:16.218666 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-42d0e7dd-3e13-4150-846c-b7e1f1844be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:16.220886 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 36/72] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:16.225517 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1faf04-dfd5-4956-b34b-34b8829f6d05 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.232986 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1faf04-dfd5-4956-b34b-34b8829f6d05 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.233754 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 37/73] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:16.234814 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0e7dd-3e13-4150-846c-b7e1f1844be7 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.245557 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0e7dd-3e13-4150-846c-b7e1f1844be7 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.250650 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62e604-83a3-4837-9344-bc9c838f252c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.251737 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c689e1-f86c-4e95-bb8f-9c645fa58722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.252272 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62e604-83a3-4837-9344-bc9c838f252c admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.252447 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c689e1-f86c-4e95-bb8f-9c645fa58722 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.252704 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c689e1-f86c-4e95-bb8f-9c645fa58722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.252992 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c689e1-f86c-4e95-bb8f-9c645fa58722 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.253326 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62e604-83a3-4837-9344-bc9c838f252c admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.253830 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62e604-83a3-4837-9344-bc9c838f252c admin admin] PATH_INFO: `/v3/users/d48900f443894ac798508f952478760c` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.253930 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c689e1-f86c-4e95-bb8f-9c645fa58722 admin admin] RBAC: Adding query filter params (role.id=540999ece4154e6ba219007ddda3f8f9, scope.project.id=f405caf5e07a413190b7459d3015b944, user.id=ec851783eb6e47d286a7d11681c3f75a) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:16.254193 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c689e1-f86c-4e95-bb8f-9c645fa58722 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.255716 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62e604-83a3-4837-9344-bc9c838f252c admin admin] RBAC: Authorizing `identity:get_user(user_id=d48900f443894ac798508f952478760c)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.256113 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c689e1-f86c-4e95-bb8f-9c645fa58722 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.258111 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62e604-83a3-4837-9344-bc9c838f252c admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.260457 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 38/74] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:20:16 2021] GET /identity/v3/users/d48900f443894ac798508f952478760c => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:16.266790 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62e604-83a3-4837-9344-bc9c838f252c admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.270126 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 37/75] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:20:16 2021] GET /identity/v3/role_assignments?user.id=ec851783eb6e47d286a7d11681c3f75a&scope.project.id=f405caf5e07a413190b7459d3015b944&role.id=540999ece4154e6ba219007ddda3f8f9 => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:16.278186 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62e604-83a3-4837-9344-bc9c838f252c admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.283349 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a87ef-9f90-4000-b5e4-ffb1809657a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.284336 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a87ef-9f90-4000-b5e4-ffb1809657a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.284823 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a87ef-9f90-4000-b5e4-ffb1809657a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.285299 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a87ef-9f90-4000-b5e4-ffb1809657a5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.295261 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a87ef-9f90-4000-b5e4-ffb1809657a5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.297438 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a87ef-9f90-4000-b5e4-ffb1809657a5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.298932 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c689e1-f86c-4e95-bb8f-9c645fa58722 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.308583 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 39/76] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:16 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:20:16.315447 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a87ef-9f90-4000-b5e4-ffb1809657a5 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.324832 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c689e1-f86c-4e95-bb8f-9c645fa58722 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.326258 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a87ef-9f90-4000-b5e4-ffb1809657a5 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.331552 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3a5e7-3e85-4d2b-a742-7009e8502f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.332778 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3a5e7-3e85-4d2b-a742-7009e8502f0b admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.333292 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3a5e7-3e85-4d2b-a742-7009e8502f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.333817 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3a5e7-3e85-4d2b-a742-7009e8502f0b admin admin] PATH_INFO: `/v3/projects/f405caf5e07a413190b7459d3015b944` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.335440 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3a5e7-3e85-4d2b-a742-7009e8502f0b admin admin] RBAC: Authorizing `identity:get_project(project_id=f405caf5e07a413190b7459d3015b944)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.336912 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3059fe0-17be-44b7-bd50-4ade6eeaa5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.337792 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3059fe0-17be-44b7-bd50-4ade6eeaa5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.338157 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3059fe0-17be-44b7-bd50-4ade6eeaa5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.338941 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3059fe0-17be-44b7-bd50-4ade6eeaa5f6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.339604 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3a5e7-3e85-4d2b-a742-7009e8502f0b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.342042 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 40/77] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:16 2021] GET /identity/v3/projects/f405caf5e07a413190b7459d3015b944 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:16.348909 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3a5e7-3e85-4d2b-a742-7009e8502f0b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.359711 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3a5e7-3e85-4d2b-a742-7009e8502f0b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.364985 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d91c0-3e66-4035-b9a6-8d01a64439ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.366069 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d91c0-3e66-4035-b9a6-8d01a64439ae admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.366560 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d91c0-3e66-4035-b9a6-8d01a64439ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.367039 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d91c0-3e66-4035-b9a6-8d01a64439ae admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.368137 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d91c0-3e66-4035-b9a6-8d01a64439ae admin admin] RBAC: Adding query filter params (role.id=df3a437e6ea14518a9c1b9a348e18c99, scope.project.id=f405caf5e07a413190b7459d3015b944, user.id=d48900f443894ac798508f952478760c) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:16.368661 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d91c0-3e66-4035-b9a6-8d01a64439ae admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.370543 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3059fe0-17be-44b7-bd50-4ade6eeaa5f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:16.371093 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d91c0-3e66-4035-b9a6-8d01a64439ae admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.377891 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 41/78] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:20:16 2021] GET /identity/v3/role_assignments?user.id=d48900f443894ac798508f952478760c&scope.project.id=f405caf5e07a413190b7459d3015b944&role.id=df3a437e6ea14518a9c1b9a348e18c99 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:16.378113 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-e3059fe0-17be-44b7-bd50-4ade6eeaa5f6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:20:16.379985 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 38/79] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Oct 27 01:20:16 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:20:16.382194 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab411d-18c4-41df-afd3-cdfb6bc5eaa7 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.382787 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab411d-18c4-41df-afd3-cdfb6bc5eaa7 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.383276 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab411d-18c4-41df-afd3-cdfb6bc5eaa7 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.386062 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 42/80] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:16.389559 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3059fe0-17be-44b7-bd50-4ade6eeaa5f6 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.393195 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dddc3-477c-44ba-8644-963befe8c64f None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.393859 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dddc3-477c-44ba-8644-963befe8c64f None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.394351 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dddc3-477c-44ba-8644-963befe8c64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.409993 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3059fe0-17be-44b7-bd50-4ade6eeaa5f6 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.419875 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-3f9dddc3-477c-44ba-8644-963befe8c64f None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:16.421165 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-3f9dddc3-477c-44ba-8644-963befe8c64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:16.427265 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc4326-777b-4502-9616-43f7132c8879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.428319 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc4326-777b-4502-9616-43f7132c8879 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.428840 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc4326-777b-4502-9616-43f7132c8879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.429316 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc4326-777b-4502-9616-43f7132c8879 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.429677 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 43/81] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:16.430505 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc4326-777b-4502-9616-43f7132c8879 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:16.430822 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc4326-777b-4502-9616-43f7132c8879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.432527 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc4326-777b-4502-9616-43f7132c8879 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.453178 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 39/82] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:16 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:16.459733 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dddc3-477c-44ba-8644-963befe8c64f None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.468302 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc4326-777b-4502-9616-43f7132c8879 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.481174 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dddc3-477c-44ba-8644-963befe8c64f None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.488599 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc4326-777b-4502-9616-43f7132c8879 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.492179 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3747c-807b-457b-9f2f-48d0cc330034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.493404 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3747c-807b-457b-9f2f-48d0cc330034 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.493961 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3747c-807b-457b-9f2f-48d0cc330034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.494487 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3747c-807b-457b-9f2f-48d0cc330034 admin admin] PATH_INFO: `/v3/users/ec851783eb6e47d286a7d11681c3f75a` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.496471 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3747c-807b-457b-9f2f-48d0cc330034 admin admin] RBAC: Authorizing `identity:get_user(user_id=ec851783eb6e47d286a7d11681c3f75a)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.498987 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3747c-807b-457b-9f2f-48d0cc330034 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.501616 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 44/83] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:20:16 2021] GET /identity/v3/users/ec851783eb6e47d286a7d11681c3f75a => generated 275 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:16.505528 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe0657-10de-40ab-9488-7e85230cfcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.506681 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe0657-10de-40ab-9488-7e85230cfcff admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.507293 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe0657-10de-40ab-9488-7e85230cfcff admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.508460 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3747c-807b-457b-9f2f-48d0cc330034 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.509450 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe0657-10de-40ab-9488-7e85230cfcff admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.524810 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3747c-807b-457b-9f2f-48d0cc330034 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.534623 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe0657-10de-40ab-9488-7e85230cfcff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:16.539316 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687d052-6597-426c-877e-a8b7944c4118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.539988 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687d052-6597-426c-877e-a8b7944c4118 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.540278 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687d052-6597-426c-877e-a8b7944c4118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.540567 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687d052-6597-426c-877e-a8b7944c4118 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.543660 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-2abe0657-10de-40ab-9488-7e85230cfcff admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:20:16.545535 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 40/84] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:16 2021] GET /identity/v3/roles/member => generated 84 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:20:16.555877 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe0657-10de-40ab-9488-7e85230cfcff admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.557439 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687d052-6597-426c-877e-a8b7944c4118 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.559849 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687d052-6597-426c-877e-a8b7944c4118 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.570327 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 45/85] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:16 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:16.570762 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe0657-10de-40ab-9488-7e85230cfcff admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.572967 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d6474-d0ac-48e9-ac63-f5a074285fb5 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.573512 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d6474-d0ac-48e9-ac63-f5a074285fb5 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.574018 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d6474-d0ac-48e9-ac63-f5a074285fb5 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.576487 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 46/86] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:16.577686 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d6474-d0ac-48e9-ac63-f5a074285fb5 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.588076 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c537de-c884-4a93-b7ce-a84e145b0e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.589322 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c537de-c884-4a93-b7ce-a84e145b0e59 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.589654 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c537de-c884-4a93-b7ce-a84e145b0e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.589939 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c537de-c884-4a93-b7ce-a84e145b0e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.590725 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c537de-c884-4a93-b7ce-a84e145b0e59 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:16.591051 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c537de-c884-4a93-b7ce-a84e145b0e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.592782 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d6474-d0ac-48e9-ac63-f5a074285fb5 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.592994 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c537de-c884-4a93-b7ce-a84e145b0e59 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.598316 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bebb21-05d3-4434-89ab-a6b46a00ff41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.599539 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bebb21-05d3-4434-89ab-a6b46a00ff41 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.600048 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bebb21-05d3-4434-89ab-a6b46a00ff41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.600405 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bebb21-05d3-4434-89ab-a6b46a00ff41 admin admin] PATH_INFO: `/v3/projects/f405caf5e07a413190b7459d3015b944` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.601815 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bebb21-05d3-4434-89ab-a6b46a00ff41 admin admin] RBAC: Authorizing `identity:get_project(project_id=f405caf5e07a413190b7459d3015b944)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.604053 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bebb21-05d3-4434-89ab-a6b46a00ff41 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.604370 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 41/87] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Oct 27 01:20:16 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:16.605974 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb2465-30ac-4be1-9659-48775ccac4c4 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.606085 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 47/88] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:16 2021] GET /identity/v3/projects/f405caf5e07a413190b7459d3015b944 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:16.606738 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb2465-30ac-4be1-9659-48775ccac4c4 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.607261 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb2465-30ac-4be1-9659-48775ccac4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.610404 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bebb21-05d3-4434-89ab-a6b46a00ff41 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.623244 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bebb21-05d3-4434-89ab-a6b46a00ff41 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.628146 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dca8d-8c9e-4464-8085-89a5bfcdca90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.629014 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dca8d-8c9e-4464-8085-89a5bfcdca90 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.629305 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dca8d-8c9e-4464-8085-89a5bfcdca90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.629655 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dca8d-8c9e-4464-8085-89a5bfcdca90 admin admin] PATH_INFO: `/v3/users/ec851783eb6e47d286a7d11681c3f75a` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.630885 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8dca8d-8c9e-4464-8085-89a5bfcdca90 admin admin] RBAC: Authorizing `identity:get_user(user_id=ec851783eb6e47d286a7d11681c3f75a)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.631209 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-9fcb2465-30ac-4be1-9659-48775ccac4c4 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:16.632427 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-9fcb2465-30ac-4be1-9659-48775ccac4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:16.633085 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8dca8d-8c9e-4464-8085-89a5bfcdca90 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.635468 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 48/89] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:20:16 2021] GET /identity/v3/users/ec851783eb6e47d286a7d11681c3f75a => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:16.636039 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dca8d-8c9e-4464-8085-89a5bfcdca90 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.641330 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 42/90] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:16.642287 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb2465-30ac-4be1-9659-48775ccac4c4 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.655779 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb2465-30ac-4be1-9659-48775ccac4c4 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.657099 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dca8d-8c9e-4464-8085-89a5bfcdca90 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.660419 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038864c-d662-40dd-817f-b3776b4adeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.661170 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038864c-d662-40dd-817f-b3776b4adeab admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.661604 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038864c-d662-40dd-817f-b3776b4adeab admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.662005 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038864c-d662-40dd-817f-b3776b4adeab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.670309 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038864c-d662-40dd-817f-b3776b4adeab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.672089 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038864c-d662-40dd-817f-b3776b4adeab admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.674172 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f036a-fa44-4bc4-899e-e10225ae1d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.675086 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f036a-fa44-4bc4-899e-e10225ae1d02 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.675648 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f036a-fa44-4bc4-899e-e10225ae1d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.676294 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f036a-fa44-4bc4-899e-e10225ae1d02 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.677894 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f036a-fa44-4bc4-899e-e10225ae1d02 admin admin] RBAC: Adding query filter params (role.id=22382371cf4846fe84d1403e3ab1785e, scope.project.id=f405caf5e07a413190b7459d3015b944, user.id=ec851783eb6e47d286a7d11681c3f75a) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:16.678708 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f036a-fa44-4bc4-899e-e10225ae1d02 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.680767 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f036a-fa44-4bc4-899e-e10225ae1d02 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.681203 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 43/91] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:16 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:16.682426 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038864c-d662-40dd-817f-b3776b4adeab admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.689380 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 49/92] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:20:16 2021] GET /identity/v3/role_assignments?user.id=ec851783eb6e47d286a7d11681c3f75a&scope.project.id=f405caf5e07a413190b7459d3015b944&role.id=22382371cf4846fe84d1403e3ab1785e => generated 259 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:16.690531 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f036a-fa44-4bc4-899e-e10225ae1d02 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.692078 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038864c-d662-40dd-817f-b3776b4adeab admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.697000 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c686c41-7115-4b9e-b0b0-71209d538e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.698452 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c686c41-7115-4b9e-b0b0-71209d538e40 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.698806 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c686c41-7115-4b9e-b0b0-71209d538e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.699155 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c686c41-7115-4b9e-b0b0-71209d538e40 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.700918 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c686c41-7115-4b9e-b0b0-71209d538e40 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.702778 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c686c41-7115-4b9e-b0b0-71209d538e40 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.704686 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f036a-fa44-4bc4-899e-e10225ae1d02 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.704800 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 44/93] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:16 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:16.709965 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da4318-1426-4f7f-aeac-d11a7f59ddd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.710584 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c686c41-7115-4b9e-b0b0-71209d538e40 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.711498 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da4318-1426-4f7f-aeac-d11a7f59ddd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.712064 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da4318-1426-4f7f-aeac-d11a7f59ddd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.712524 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da4318-1426-4f7f-aeac-d11a7f59ddd9 admin admin] PATH_INFO: `/v3/projects/2de0e1d9ce084c8abbb7235e6f290e29` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.714171 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da4318-1426-4f7f-aeac-d11a7f59ddd9 admin admin] RBAC: Authorizing `identity:get_project(project_id=2de0e1d9ce084c8abbb7235e6f290e29)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.716608 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da4318-1426-4f7f-aeac-d11a7f59ddd9 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.718785 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 50/94] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:16 2021] GET /identity/v3/projects/2de0e1d9ce084c8abbb7235e6f290e29 => generated 312 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:16.725620 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c686c41-7115-4b9e-b0b0-71209d538e40 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.726842 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da4318-1426-4f7f-aeac-d11a7f59ddd9 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.736308 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9325d-a53b-40cf-91f4-340519176a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.737268 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9325d-a53b-40cf-91f4-340519176a26 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.737730 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9325d-a53b-40cf-91f4-340519176a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.738155 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9325d-a53b-40cf-91f4-340519176a26 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.739040 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9325d-a53b-40cf-91f4-340519176a26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.742427 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9325d-a53b-40cf-91f4-340519176a26 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.748503 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da4318-1426-4f7f-aeac-d11a7f59ddd9 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.761335 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c4ebe-6ed5-42a5-94ea-7bf6fcc6dd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.762308 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c4ebe-6ed5-42a5-94ea-7bf6fcc6dd80 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.762747 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c4ebe-6ed5-42a5-94ea-7bf6fcc6dd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.763794 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c4ebe-6ed5-42a5-94ea-7bf6fcc6dd80 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.764875 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c4ebe-6ed5-42a5-94ea-7bf6fcc6dd80 admin admin] RBAC: Adding query filter params (role.id=540999ece4154e6ba219007ddda3f8f9, scope.project.id=2de0e1d9ce084c8abbb7235e6f290e29, user.id=ec851783eb6e47d286a7d11681c3f75a) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:16.765345 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c4ebe-6ed5-42a5-94ea-7bf6fcc6dd80 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.767771 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c4ebe-6ed5-42a5-94ea-7bf6fcc6dd80 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.774966 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 51/95] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:20:16 2021] GET /identity/v3/role_assignments?user.id=ec851783eb6e47d286a7d11681c3f75a&scope.project.id=2de0e1d9ce084c8abbb7235e6f290e29&role.id=540999ece4154e6ba219007ddda3f8f9 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:16.794947 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 45/96] 10.222.0.25 () {60 vars in 1162 bytes} [Wed Oct 27 01:20:16 2021] POST /identity/v3/projects => generated 302 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:20:18.993931 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6baf277-196e-4ca5-8809-584d33f31631 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:18.994478 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6baf277-196e-4ca5-8809-584d33f31631 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:18.994551 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6baf277-196e-4ca5-8809-584d33f31631 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:18.996315 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 52/97] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:19.015700 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc401aa7-44cd-4ac5-a847-7ca6709a40f2 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.016205 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc401aa7-44cd-4ac5-a847-7ca6709a40f2 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.016279 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc401aa7-44cd-4ac5-a847-7ca6709a40f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.045024 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-fc401aa7-44cd-4ac5-a847-7ca6709a40f2 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:19.046370 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-fc401aa7-44cd-4ac5-a847-7ca6709a40f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:19.116413 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 46/98] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:19.163046 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6baf277-196e-4ca5-8809-584d33f31631 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.179903 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6baf277-196e-4ca5-8809-584d33f31631 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.187247 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3527b05-be89-4712-90e8-985063208cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.188079 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3527b05-be89-4712-90e8-985063208cec admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.188376 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3527b05-be89-4712-90e8-985063208cec admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.188662 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3527b05-be89-4712-90e8-985063208cec admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.203598 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3527b05-be89-4712-90e8-985063208cec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:19.210701 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-d3527b05-be89-4712-90e8-985063208cec admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:20:19.211903 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 53/99] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:19 2021] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:19.219074 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc401aa7-44cd-4ac5-a847-7ca6709a40f2 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.228131 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc401aa7-44cd-4ac5-a847-7ca6709a40f2 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.231997 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1e4cb-e29d-4d06-b97b-93bd221dea9a None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.232296 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1e4cb-e29d-4d06-b97b-93bd221dea9a None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.232582 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1e4cb-e29d-4d06-b97b-93bd221dea9a None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.234530 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 54/100] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:20:19.239962 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b55ec-2359-4791-bce9-d578344d880a None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.240252 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b55ec-2359-4791-bce9-d578344d880a None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.240447 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb60de9-75ad-49d7-9eca-77a06ec36b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.240580 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b55ec-2359-4791-bce9-d578344d880a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.241123 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb60de9-75ad-49d7-9eca-77a06ec36b3f admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.241411 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb60de9-75ad-49d7-9eca-77a06ec36b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.241720 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb60de9-75ad-49d7-9eca-77a06ec36b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.242498 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb60de9-75ad-49d7-9eca-77a06ec36b3f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:19.242808 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb60de9-75ad-49d7-9eca-77a06ec36b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.244974 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb60de9-75ad-49d7-9eca-77a06ec36b3f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:19.254574 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 47/101] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Oct 27 01:20:19 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:19.261167 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb60de9-75ad-49d7-9eca-77a06ec36b3f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.273517 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-841b55ec-2359-4791-bce9-d578344d880a None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:19.274741 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-841b55ec-2359-4791-bce9-d578344d880a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:19.280058 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb60de9-75ad-49d7-9eca-77a06ec36b3f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.290236 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e582951-25cd-46ff-a391-dcd4525a8663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.291766 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e582951-25cd-46ff-a391-dcd4525a8663 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.292064 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e582951-25cd-46ff-a391-dcd4525a8663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.292346 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e582951-25cd-46ff-a391-dcd4525a8663 admin admin] PATH_INFO: `/v3/users/ec851783eb6e47d286a7d11681c3f75a` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.295227 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 55/102] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:19.295865 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e582951-25cd-46ff-a391-dcd4525a8663 admin admin] RBAC: Authorizing `identity:get_user(user_id=ec851783eb6e47d286a7d11681c3f75a)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.298125 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e582951-25cd-46ff-a391-dcd4525a8663 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:19.300093 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 48/103] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:20:19 2021] GET /identity/v3/users/ec851783eb6e47d286a7d11681c3f75a => generated 275 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:19.306426 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b55ec-2359-4791-bce9-d578344d880a None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.318668 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b55ec-2359-4791-bce9-d578344d880a None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.323701 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cdfeb-edc0-4d5e-9718-7ff455983c9a None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.324077 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cdfeb-edc0-4d5e-9718-7ff455983c9a None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.324486 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cdfeb-edc0-4d5e-9718-7ff455983c9a None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.326384 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 49/104] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:20:19.327082 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761cdfeb-edc0-4d5e-9718-7ff455983c9a None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.327282 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e6d61-4afd-4548-a83e-331027c488b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.328353 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e6d61-4afd-4548-a83e-331027c488b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.328836 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e6d61-4afd-4548-a83e-331027c488b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.329328 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e6d61-4afd-4548-a83e-331027c488b7 admin admin] PATH_INFO: `/v3/projects/f405caf5e07a413190b7459d3015b944` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.330811 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e6d61-4afd-4548-a83e-331027c488b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=f405caf5e07a413190b7459d3015b944)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.333251 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e6d61-4afd-4548-a83e-331027c488b7 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:19.335696 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 56/105] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:19 2021] GET /identity/v3/projects/f405caf5e07a413190b7459d3015b944 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:19.337028 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbc167-53ae-435d-8527-388b99cb8b01 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.337561 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbc167-53ae-435d-8527-388b99cb8b01 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.338592 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbc167-53ae-435d-8527-388b99cb8b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.345046 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761cdfeb-edc0-4d5e-9718-7ff455983c9a None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.351159 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16325df-7a52-4b18-b3c3-8f2787ff544e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.352399 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16325df-7a52-4b18-b3c3-8f2787ff544e admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.352695 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16325df-7a52-4b18-b3c3-8f2787ff544e admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.352980 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16325df-7a52-4b18-b3c3-8f2787ff544e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.358614 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-accbc167-53ae-435d-8527-388b99cb8b01 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:19.360216 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-accbc167-53ae-435d-8527-388b99cb8b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:19.364449 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16325df-7a52-4b18-b3c3-8f2787ff544e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:19.368547 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 57/106] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:19.369636 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbc167-53ae-435d-8527-388b99cb8b01 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.371697 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-d16325df-7a52-4b18-b3c3-8f2787ff544e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:20:19.373243 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 50/107] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:20:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:19.380924 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16325df-7a52-4b18-b3c3-8f2787ff544e admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.387869 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbc167-53ae-435d-8527-388b99cb8b01 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.392578 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16325df-7a52-4b18-b3c3-8f2787ff544e admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.393304 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b4281-54d3-459d-a6be-7c1ffc521808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.394640 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b4281-54d3-459d-a6be-7c1ffc521808 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.395197 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b4281-54d3-459d-a6be-7c1ffc521808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.395744 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b4281-54d3-459d-a6be-7c1ffc521808 admin admin] PATH_INFO: `/v3/projects/f405caf5e07a413190b7459d3015b944/users/ec851783eb6e47d286a7d11681c3f75a/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.397327 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47bb96-f48a-4953-b27a-f748beac6c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.398085 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47bb96-f48a-4953-b27a-f748beac6c4b admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.398463 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47bb96-f48a-4953-b27a-f748beac6c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.398732 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b4281-54d3-459d-a6be-7c1ffc521808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f405caf5e07a413190b7459d3015b944, user_id=ec851783eb6e47d286a7d11681c3f75a, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.398833 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47bb96-f48a-4953-b27a-f748beac6c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.399641 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47bb96-f48a-4953-b27a-f748beac6c4b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:19.400022 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47bb96-f48a-4953-b27a-f748beac6c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.401817 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47bb96-f48a-4953-b27a-f748beac6c4b admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:19.402438 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b4281-54d3-459d-a6be-7c1ffc521808 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:19.412456 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 51/108] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:19 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:19.417518 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47bb96-f48a-4953-b27a-f748beac6c4b admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.425522 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 58/109] 10.222.0.25 () {58 vars in 1460 bytes} [Wed Oct 27 01:20:19 2021] PUT /identity/v3/projects/f405caf5e07a413190b7459d3015b944/users/ec851783eb6e47d286a7d11681c3f75a/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:19.426880 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b4281-54d3-459d-a6be-7c1ffc521808 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.428146 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47bb96-f48a-4953-b27a-f748beac6c4b admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.489406 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1070473-ff51-41f5-9116-0c982406fb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.490178 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1070473-ff51-41f5-9116-0c982406fb25 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.490512 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1070473-ff51-41f5-9116-0c982406fb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.490965 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1070473-ff51-41f5-9116-0c982406fb25 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.504590 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1070473-ff51-41f5-9116-0c982406fb25 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:19.509933 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b4281-54d3-459d-a6be-7c1ffc521808 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.512423 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-b1070473-ff51-41f5-9116-0c982406fb25 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:20:19.513769 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 52/110] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:19 2021] GET /identity/v3/roles/member => generated 84 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:19.515206 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a61609-8c1f-4040-bd36-7d01dc06f585 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.515501 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a61609-8c1f-4040-bd36-7d01dc06f585 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.515783 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a61609-8c1f-4040-bd36-7d01dc06f585 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.515919 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d45e27-5daf-438a-9652-18276be1ca32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.517018 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d45e27-5daf-438a-9652-18276be1ca32 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.517515 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d45e27-5daf-438a-9652-18276be1ca32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.517690 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 53/111] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:19.518123 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d45e27-5daf-438a-9652-18276be1ca32 admin admin] PATH_INFO: `/v3/users/d48900f443894ac798508f952478760c` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.519565 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d45e27-5daf-438a-9652-18276be1ca32 admin admin] RBAC: Authorizing `identity:get_user(user_id=d48900f443894ac798508f952478760c)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.520597 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a61609-8c1f-4040-bd36-7d01dc06f585 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.521370 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d45e27-5daf-438a-9652-18276be1ca32 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:19.523252 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 59/112] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:20:19 2021] GET /identity/v3/users/d48900f443894ac798508f952478760c => generated 247 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:19.526015 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ae0c4-9cf7-494d-9510-0d44dfaa0554 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.526591 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ae0c4-9cf7-494d-9510-0d44dfaa0554 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.527066 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ae0c4-9cf7-494d-9510-0d44dfaa0554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.540784 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a61609-8c1f-4040-bd36-7d01dc06f585 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.546492 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1601a0-e871-4b02-be9c-ba12515f36c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.547551 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1601a0-e871-4b02-be9c-ba12515f36c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.548334 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1601a0-e871-4b02-be9c-ba12515f36c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.548811 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1601a0-e871-4b02-be9c-ba12515f36c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.549157 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-3e5ae0c4-9cf7-494d-9510-0d44dfaa0554 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:19.550082 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1601a0-e871-4b02-be9c-ba12515f36c0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:19.550424 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-3e5ae0c4-9cf7-494d-9510-0d44dfaa0554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:19.550903 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1601a0-e871-4b02-be9c-ba12515f36c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.553288 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1601a0-e871-4b02-be9c-ba12515f36c0 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:19.559513 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 60/113] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:19.560263 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ae0c4-9cf7-494d-9510-0d44dfaa0554 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.565349 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 54/114] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Oct 27 01:20:19 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:19.577643 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ae0c4-9cf7-494d-9510-0d44dfaa0554 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.577856 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1601a0-e871-4b02-be9c-ba12515f36c0 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.583592 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc812fdd-151f-4b4c-8adc-f0be05258474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.584822 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc812fdd-151f-4b4c-8adc-f0be05258474 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.585256 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc812fdd-151f-4b4c-8adc-f0be05258474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.585705 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc812fdd-151f-4b4c-8adc-f0be05258474 admin admin] PATH_INFO: `/v3/projects/f405caf5e07a413190b7459d3015b944` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.587493 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc812fdd-151f-4b4c-8adc-f0be05258474 admin admin] RBAC: Authorizing `identity:get_project(project_id=f405caf5e07a413190b7459d3015b944)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.590081 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc812fdd-151f-4b4c-8adc-f0be05258474 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:19.592085 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 61/115] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:19 2021] GET /identity/v3/projects/f405caf5e07a413190b7459d3015b944 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:19.592191 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1601a0-e871-4b02-be9c-ba12515f36c0 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.593167 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc812fdd-151f-4b4c-8adc-f0be05258474 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.604797 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae951b05-5a47-4eec-9f63-8715001afd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.605709 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae951b05-5a47-4eec-9f63-8715001afd48 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.606000 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae951b05-5a47-4eec-9f63-8715001afd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.606290 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae951b05-5a47-4eec-9f63-8715001afd48 admin admin] PATH_INFO: `/v3/users/ec851783eb6e47d286a7d11681c3f75a` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.607555 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae951b05-5a47-4eec-9f63-8715001afd48 admin admin] RBAC: Authorizing `identity:get_user(user_id=ec851783eb6e47d286a7d11681c3f75a)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.608623 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc812fdd-151f-4b4c-8adc-f0be05258474 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.609979 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae951b05-5a47-4eec-9f63-8715001afd48 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:19.611867 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 55/116] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:20:19 2021] GET /identity/v3/users/ec851783eb6e47d286a7d11681c3f75a => generated 275 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:19.612443 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae951b05-5a47-4eec-9f63-8715001afd48 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.614849 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a45c66-03bb-4811-a404-84f9c940eb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.616015 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a45c66-03bb-4811-a404-84f9c940eb50 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.616622 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a45c66-03bb-4811-a404-84f9c940eb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.617083 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a45c66-03bb-4811-a404-84f9c940eb50 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.622968 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae951b05-5a47-4eec-9f63-8715001afd48 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.629179 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62683efb-bbbb-43e2-b483-4212fc8efaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.630174 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62683efb-bbbb-43e2-b483-4212fc8efaed admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.630462 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62683efb-bbbb-43e2-b483-4212fc8efaed admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.630740 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62683efb-bbbb-43e2-b483-4212fc8efaed admin admin] PATH_INFO: `/v3/projects/f405caf5e07a413190b7459d3015b944/users/d48900f443894ac798508f952478760c/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.632197 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a45c66-03bb-4811-a404-84f9c940eb50 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:19.633247 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62683efb-bbbb-43e2-b483-4212fc8efaed admin admin] RBAC: Authorizing `identity:create_grant(project_id=f405caf5e07a413190b7459d3015b944, user_id=d48900f443894ac798508f952478760c, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.634302 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING py.warnings [None req-62683efb-bbbb-43e2-b483-4212fc8efaed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:19.634302 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: warnings.warn(msg) Oct 27 01:20:19.634302 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: Oct 27 01:20:19.637074 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62683efb-bbbb-43e2-b483-4212fc8efaed admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:19.641344 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-f9a45c66-03bb-4811-a404-84f9c940eb50 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:20:19.649405 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 62/117] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Oct 27 01:20:19 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:19.649405 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a45c66-03bb-4811-a404-84f9c940eb50 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.664129 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a45c66-03bb-4811-a404-84f9c940eb50 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.664466 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 56/118] 10.222.0.25 () {58 vars in 1460 bytes} [Wed Oct 27 01:20:19 2021] PUT /identity/v3/projects/f405caf5e07a413190b7459d3015b944/users/d48900f443894ac798508f952478760c/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:19.665799 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62683efb-bbbb-43e2-b483-4212fc8efaed admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.748483 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389493c-80ee-4c2c-9a71-9793c2e66cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.749476 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389493c-80ee-4c2c-9a71-9793c2e66cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.749907 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389493c-80ee-4c2c-9a71-9793c2e66cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.750261 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389493c-80ee-4c2c-9a71-9793c2e66cf3 admin admin] PATH_INFO: `/v3/projects/2de0e1d9ce084c8abbb7235e6f290e29` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.751712 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389493c-80ee-4c2c-9a71-9793c2e66cf3 admin admin] RBAC: Authorizing `identity:get_project(project_id=2de0e1d9ce084c8abbb7235e6f290e29)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.754144 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389493c-80ee-4c2c-9a71-9793c2e66cf3 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:19.756392 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 63/119] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:19 2021] GET /identity/v3/projects/2de0e1d9ce084c8abbb7235e6f290e29 => generated 312 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:19.765519 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389493c-80ee-4c2c-9a71-9793c2e66cf3 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.778299 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389493c-80ee-4c2c-9a71-9793c2e66cf3 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.778493 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62683efb-bbbb-43e2-b483-4212fc8efaed admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.783468 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4c762-32c7-4c33-9ea7-bf002a3561bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.783743 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52765b83-fc74-433a-bd42-bcd66b2b8234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.784650 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52765b83-fc74-433a-bd42-bcd66b2b8234 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.784764 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4c762-32c7-4c33-9ea7-bf002a3561bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.785067 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52765b83-fc74-433a-bd42-bcd66b2b8234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.785175 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4c762-32c7-4c33-9ea7-bf002a3561bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.785476 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4c762-32c7-4c33-9ea7-bf002a3561bc admin admin] PATH_INFO: `/v3/projects/2de0e1d9ce084c8abbb7235e6f290e29/users/ec851783eb6e47d286a7d11681c3f75a/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.785599 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52765b83-fc74-433a-bd42-bcd66b2b8234 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.786435 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52765b83-fc74-433a-bd42-bcd66b2b8234 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:19.786814 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52765b83-fc74-433a-bd42-bcd66b2b8234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.787890 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4c762-32c7-4c33-9ea7-bf002a3561bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2de0e1d9ce084c8abbb7235e6f290e29, user_id=ec851783eb6e47d286a7d11681c3f75a, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.788602 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52765b83-fc74-433a-bd42-bcd66b2b8234 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:19.792011 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c4c762-32c7-4c33-9ea7-bf002a3561bc admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:19.799048 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 57/120] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:19 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:19.805556 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52765b83-fc74-433a-bd42-bcd66b2b8234 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.809566 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 64/121] 10.222.0.25 () {58 vars in 1460 bytes} [Wed Oct 27 01:20:19 2021] PUT /identity/v3/projects/2de0e1d9ce084c8abbb7235e6f290e29/users/ec851783eb6e47d286a7d11681c3f75a/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:19.819868 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52765b83-fc74-433a-bd42-bcd66b2b8234 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.911365 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628488d7-6884-49df-948b-305a6b91e291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.912535 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628488d7-6884-49df-948b-305a6b91e291 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.912975 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628488d7-6884-49df-948b-305a6b91e291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.913402 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628488d7-6884-49df-948b-305a6b91e291 admin admin] PATH_INFO: `/v3/users/ec851783eb6e47d286a7d11681c3f75a` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.915008 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628488d7-6884-49df-948b-305a6b91e291 admin admin] RBAC: Authorizing `identity:get_user(user_id=ec851783eb6e47d286a7d11681c3f75a)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.917528 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628488d7-6884-49df-948b-305a6b91e291 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:19.919465 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 58/122] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:20:19 2021] GET /identity/v3/users/ec851783eb6e47d286a7d11681c3f75a => generated 275 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:19.925928 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4c762-32c7-4c33-9ea7-bf002a3561bc admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.942099 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4c762-32c7-4c33-9ea7-bf002a3561bc admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.952157 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955498d-384d-4dfd-8faf-4b75911023f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.953043 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955498d-384d-4dfd-8faf-4b75911023f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.953332 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955498d-384d-4dfd-8faf-4b75911023f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.953647 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955498d-384d-4dfd-8faf-4b75911023f9 admin admin] PATH_INFO: `/v3/projects/f405caf5e07a413190b7459d3015b944` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.954958 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955498d-384d-4dfd-8faf-4b75911023f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=f405caf5e07a413190b7459d3015b944)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.957093 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955498d-384d-4dfd-8faf-4b75911023f9 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:19.958887 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 65/123] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:19 2021] GET /identity/v3/projects/f405caf5e07a413190b7459d3015b944 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:19.966010 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628488d7-6884-49df-948b-305a6b91e291 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.978850 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628488d7-6884-49df-948b-305a6b91e291 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.983675 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbfa62-ab41-4396-aec5-280884e1d413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.984594 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbfa62-ab41-4396-aec5-280884e1d413 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.984883 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbfa62-ab41-4396-aec5-280884e1d413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.985165 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbfa62-ab41-4396-aec5-280884e1d413 admin admin] PATH_INFO: `/v3/projects/f405caf5e07a413190b7459d3015b944/users/ec851783eb6e47d286a7d11681c3f75a/roles/22382371cf4846fe84d1403e3ab1785e` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.987546 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbfa62-ab41-4396-aec5-280884e1d413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f405caf5e07a413190b7459d3015b944, user_id=ec851783eb6e47d286a7d11681c3f75a, role_id=22382371cf4846fe84d1403e3ab1785e)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.990368 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbfa62-ab41-4396-aec5-280884e1d413 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:20.008385 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 59/124] 10.222.0.25 () {58 vars in 1460 bytes} [Wed Oct 27 01:20:19 2021] PUT /identity/v3/projects/f405caf5e07a413190b7459d3015b944/users/ec851783eb6e47d286a7d11681c3f75a/roles/22382371cf4846fe84d1403e3ab1785e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:20.195814 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d2e23-de0a-4bd0-8573-f3060c24f552 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:20.196315 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d2e23-de0a-4bd0-8573-f3060c24f552 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:20.196385 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d2e23-de0a-4bd0-8573-f3060c24f552 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:20.198720 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 66/125] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:20.205358 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edbcce-6cb7-471e-a24a-bc0560a8a8a4 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:20.205854 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edbcce-6cb7-471e-a24a-bc0560a8a8a4 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:20.206046 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edbcce-6cb7-471e-a24a-bc0560a8a8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:20.227090 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-23edbcce-6cb7-471e-a24a-bc0560a8a8a4 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:20.228348 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-23edbcce-6cb7-471e-a24a-bc0560a8a8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:20.301807 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 60/126] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:20.328410 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d2e23-de0a-4bd0-8573-f3060c24f552 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:20.341441 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d2e23-de0a-4bd0-8573-f3060c24f552 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:20.345892 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881a212-b52b-4630-b6a1-639ff48c2ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:20.346733 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881a212-b52b-4630-b6a1-639ff48c2ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:20.347025 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881a212-b52b-4630-b6a1-639ff48c2ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:20.347362 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881a212-b52b-4630-b6a1-639ff48c2ae4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:20.348624 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881a212-b52b-4630-b6a1-639ff48c2ae4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:20.350372 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881a212-b52b-4630-b6a1-639ff48c2ae4 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:20.352131 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 67/127] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:20 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:20.358048 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23edbcce-6cb7-471e-a24a-bc0560a8a8a4 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:20.367126 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23edbcce-6cb7-471e-a24a-bc0560a8a8a4 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:20.371705 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8e7f9-d2d8-4767-87e9-e3c20bdc72fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:20.372379 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8e7f9-d2d8-4767-87e9-e3c20bdc72fb admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:20.372644 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8e7f9-d2d8-4767-87e9-e3c20bdc72fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:20.372929 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8e7f9-d2d8-4767-87e9-e3c20bdc72fb admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:20.373705 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8e7f9-d2d8-4767-87e9-e3c20bdc72fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:20.375628 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8e7f9-d2d8-4767-87e9-e3c20bdc72fb admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:20.396520 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 61/128] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Oct 27 01:20:20 2021] POST /identity/v3/users => generated 283 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:20:22.351411 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f79919-1ac9-4cae-a1f3-0554d73fa7af None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:22.352100 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f79919-1ac9-4cae-a1f3-0554d73fa7af None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:22.352100 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f79919-1ac9-4cae-a1f3-0554d73fa7af None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:22.353746 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 68/129] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:22.360121 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9391a8-0947-4feb-a9e9-f55f5526b6fd None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:22.361007 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9391a8-0947-4feb-a9e9-f55f5526b6fd None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:22.361596 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9391a8-0947-4feb-a9e9-f55f5526b6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:22.382375 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-3b9391a8-0947-4feb-a9e9-f55f5526b6fd None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:22.383931 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3b9391a8-0947-4feb-a9e9-f55f5526b6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:22.394575 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003cf5b-024f-4747-b8af-d9a59e577c13 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:22.394881 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003cf5b-024f-4747-b8af-d9a59e577c13 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:22.395145 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003cf5b-024f-4747-b8af-d9a59e577c13 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:22.396860 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 62/130] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:22.397342 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 69/131] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:20:22.415865 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa929877-53a7-46d0-9513-1c6240ba1120 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:22.416524 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa929877-53a7-46d0-9513-1c6240ba1120 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:22.417032 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa929877-53a7-46d0-9513-1c6240ba1120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:22.426094 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003cf5b-024f-4747-b8af-d9a59e577c13 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:22.444202 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003cf5b-024f-4747-b8af-d9a59e577c13 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:22.453442 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217caa09-65fe-469a-8dc3-81992aeb5563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:22.454259 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217caa09-65fe-469a-8dc3-81992aeb5563 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:22.454550 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217caa09-65fe-469a-8dc3-81992aeb5563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:22.454831 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217caa09-65fe-469a-8dc3-81992aeb5563 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:22.456094 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-fa929877-53a7-46d0-9513-1c6240ba1120 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:22.457284 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-fa929877-53a7-46d0-9513-1c6240ba1120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:22.466004 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 63/132] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:22.474472 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217caa09-65fe-469a-8dc3-81992aeb5563 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:22.481831 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-217caa09-65fe-469a-8dc3-81992aeb5563 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:20:22.483267 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 70/133] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:20:22 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:20:22.489719 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa929877-53a7-46d0-9513-1c6240ba1120 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:22.503879 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa929877-53a7-46d0-9513-1c6240ba1120 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:22.507541 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217caa09-65fe-469a-8dc3-81992aeb5563 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:22.510709 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79650e7d-87c9-428e-b160-dad75c79797c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:22.511392 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79650e7d-87c9-428e-b160-dad75c79797c admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:22.511684 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79650e7d-87c9-428e-b160-dad75c79797c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:22.511971 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79650e7d-87c9-428e-b160-dad75c79797c admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:22.512748 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79650e7d-87c9-428e-b160-dad75c79797c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:22.513062 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79650e7d-87c9-428e-b160-dad75c79797c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:22.514734 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79650e7d-87c9-428e-b160-dad75c79797c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:22.521158 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217caa09-65fe-469a-8dc3-81992aeb5563 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:22.530139 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 64/134] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:22 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:22.535194 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048daa1-3ae8-49ba-94e3-ac3f4b6c8dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:22.536012 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048daa1-3ae8-49ba-94e3-ac3f4b6c8dbb admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:22.536306 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048daa1-3ae8-49ba-94e3-ac3f4b6c8dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:22.536593 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048daa1-3ae8-49ba-94e3-ac3f4b6c8dbb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:22.547927 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4377700-703b-4867-9ec9-feda9437fb65 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:22.548223 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4377700-703b-4867-9ec9-feda9437fb65 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:22.548512 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4377700-703b-4867-9ec9-feda9437fb65 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:22.550594 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 65/135] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:22.551323 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4377700-703b-4867-9ec9-feda9437fb65 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:22.563419 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048daa1-3ae8-49ba-94e3-ac3f4b6c8dbb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:22.570544 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-f048daa1-3ae8-49ba-94e3-ac3f4b6c8dbb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:20:22.571941 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 71/136] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:22 2021] GET /identity/v3/roles/member => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:22.573027 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c2411-79fc-47b3-9ab9-ad49eb550656 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:22.573321 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c2411-79fc-47b3-9ab9-ad49eb550656 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:22.575011 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c2411-79fc-47b3-9ab9-ad49eb550656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:22.578171 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4377700-703b-4867-9ec9-feda9437fb65 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:22.583737 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31152a9c-ea6c-4516-97d9-ce7083546e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:22.584614 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31152a9c-ea6c-4516-97d9-ce7083546e23 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:22.584903 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31152a9c-ea6c-4516-97d9-ce7083546e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:22.585186 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31152a9c-ea6c-4516-97d9-ce7083546e23 admin admin] PATH_INFO: `/v3/users/d48900f443894ac798508f952478760c` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:22.586444 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31152a9c-ea6c-4516-97d9-ce7083546e23 admin admin] RBAC: Authorizing `identity:get_user(user_id=d48900f443894ac798508f952478760c)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:22.588329 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31152a9c-ea6c-4516-97d9-ce7083546e23 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:22.592204 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 66/137] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:20:22 2021] GET /identity/v3/users/d48900f443894ac798508f952478760c => generated 247 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:22.593065 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31152a9c-ea6c-4516-97d9-ce7083546e23 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:22.609528 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31152a9c-ea6c-4516-97d9-ce7083546e23 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:22.612581 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-df5c2411-79fc-47b3-9ab9-ad49eb550656 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:22.613838 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-df5c2411-79fc-47b3-9ab9-ad49eb550656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:22.615926 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7bd88-e978-42e3-88b9-810fb55ee2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:22.616697 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7bd88-e978-42e3-88b9-810fb55ee2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:22.617061 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7bd88-e978-42e3-88b9-810fb55ee2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:22.617418 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7bd88-e978-42e3-88b9-810fb55ee2e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:22.618306 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7bd88-e978-42e3-88b9-810fb55ee2e5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:22.618677 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7bd88-e978-42e3-88b9-810fb55ee2e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:22.620939 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7bd88-e978-42e3-88b9-810fb55ee2e5 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:22.630393 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 72/138] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:22.630765 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 67/139] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Oct 27 01:20:22 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:22.631259 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c2411-79fc-47b3-9ab9-ad49eb550656 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:22.638046 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7bd88-e978-42e3-88b9-810fb55ee2e5 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:22.646938 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c2411-79fc-47b3-9ab9-ad49eb550656 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:22.648646 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7bd88-e978-42e3-88b9-810fb55ee2e5 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:22.653828 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805eca9a-5785-4d50-8989-6a7ab1139e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:22.654709 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805eca9a-5785-4d50-8989-6a7ab1139e1b admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:22.655019 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805eca9a-5785-4d50-8989-6a7ab1139e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:22.655278 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805eca9a-5785-4d50-8989-6a7ab1139e1b admin admin] PATH_INFO: `/v3/users/ec851783eb6e47d286a7d11681c3f75a` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:22.656503 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805eca9a-5785-4d50-8989-6a7ab1139e1b admin admin] RBAC: Authorizing `identity:get_user(user_id=ec851783eb6e47d286a7d11681c3f75a)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:22.656677 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9d9c1-a0c9-4f67-be79-0f598e2aabeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:22.657293 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9d9c1-a0c9-4f67-be79-0f598e2aabeb admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:22.657606 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9d9c1-a0c9-4f67-be79-0f598e2aabeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:22.657893 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9d9c1-a0c9-4f67-be79-0f598e2aabeb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:22.658738 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805eca9a-5785-4d50-8989-6a7ab1139e1b admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:22.660539 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 68/140] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:20:22 2021] GET /identity/v3/users/ec851783eb6e47d286a7d11681c3f75a => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:22.667388 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805eca9a-5785-4d50-8989-6a7ab1139e1b admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:22.671971 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9d9c1-a0c9-4f67-be79-0f598e2aabeb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:22.674095 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9d9c1-a0c9-4f67-be79-0f598e2aabeb admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:22.687838 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805eca9a-5785-4d50-8989-6a7ab1139e1b admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:22.691003 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 73/141] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:22 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:22.691841 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9d9c1-a0c9-4f67-be79-0f598e2aabeb admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:22.702648 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b065285-293e-445e-9549-646c16d12220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:22.703323 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b065285-293e-445e-9549-646c16d12220 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:22.703615 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b065285-293e-445e-9549-646c16d12220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:22.703901 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b065285-293e-445e-9549-646c16d12220 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:22.713533 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9d9c1-a0c9-4f67-be79-0f598e2aabeb admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:22.719170 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b065285-293e-445e-9549-646c16d12220 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:22.721962 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b065285-293e-445e-9549-646c16d12220 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:22.727343 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5a66b-f37f-441b-a845-daa9ab09d9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:22.728214 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5a66b-f37f-441b-a845-daa9ab09d9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:22.729092 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5a66b-f37f-441b-a845-daa9ab09d9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:22.729349 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5a66b-f37f-441b-a845-daa9ab09d9f1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:22.743133 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 69/142] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:22 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:22.743750 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5a66b-f37f-441b-a845-daa9ab09d9f1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:22.743973 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b065285-293e-445e-9549-646c16d12220 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:22.755195 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-cce5a66b-f37f-441b-a845-daa9ab09d9f1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:20:22.756418 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 74/143] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:22 2021] GET /identity/v3/roles/member => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:22.760699 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5a66b-f37f-441b-a845-daa9ab09d9f1 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:22.761589 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b065285-293e-445e-9549-646c16d12220 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:22.774454 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4368b0f-0e51-412d-b1cf-a7b14daef5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:22.775878 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4368b0f-0e51-412d-b1cf-a7b14daef5dc admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:22.776175 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4368b0f-0e51-412d-b1cf-a7b14daef5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:22.776464 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4368b0f-0e51-412d-b1cf-a7b14daef5dc admin admin] PATH_INFO: `/v3/projects/f405caf5e07a413190b7459d3015b944` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:22.778064 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5a66b-f37f-441b-a845-daa9ab09d9f1 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:22.778879 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4368b0f-0e51-412d-b1cf-a7b14daef5dc admin admin] RBAC: Authorizing `identity:get_project(project_id=f405caf5e07a413190b7459d3015b944)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:22.781027 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4368b0f-0e51-412d-b1cf-a7b14daef5dc admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:22.783438 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 70/144] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:22 2021] GET /identity/v3/projects/f405caf5e07a413190b7459d3015b944 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:22.784204 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4368b0f-0e51-412d-b1cf-a7b14daef5dc admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:22.792109 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c361582-a3e6-4834-859a-de03a26bf566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:22.793053 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c361582-a3e6-4834-859a-de03a26bf566 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:22.793347 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c361582-a3e6-4834-859a-de03a26bf566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:22.793681 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c361582-a3e6-4834-859a-de03a26bf566 admin admin] PATH_INFO: `/v3/projects/2de0e1d9ce084c8abbb7235e6f290e29` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:22.795206 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c361582-a3e6-4834-859a-de03a26bf566 admin admin] RBAC: Authorizing `identity:get_project(project_id=2de0e1d9ce084c8abbb7235e6f290e29)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:22.798149 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c361582-a3e6-4834-859a-de03a26bf566 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:22.801414 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 75/145] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:22 2021] GET /identity/v3/projects/2de0e1d9ce084c8abbb7235e6f290e29 => generated 312 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:22.802215 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c361582-a3e6-4834-859a-de03a26bf566 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:22.806164 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4368b0f-0e51-412d-b1cf-a7b14daef5dc admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:22.817983 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379c6c8-b459-4beb-996e-c1f701a7482a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:22.818766 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379c6c8-b459-4beb-996e-c1f701a7482a admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:22.819054 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379c6c8-b459-4beb-996e-c1f701a7482a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:22.819338 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379c6c8-b459-4beb-996e-c1f701a7482a admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:22.821382 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379c6c8-b459-4beb-996e-c1f701a7482a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:22.821735 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379c6c8-b459-4beb-996e-c1f701a7482a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:22.824629 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379c6c8-b459-4beb-996e-c1f701a7482a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:22.828104 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c361582-a3e6-4834-859a-de03a26bf566 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:22.837031 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e892a-31c3-4154-ae01-859fb0f479d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:22.838691 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e892a-31c3-4154-ae01-859fb0f479d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:22.838985 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e892a-31c3-4154-ae01-859fb0f479d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:22.839268 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e892a-31c3-4154-ae01-859fb0f479d7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:22.840705 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e892a-31c3-4154-ae01-859fb0f479d7 admin admin] RBAC: Adding query filter params (role.id=df3a437e6ea14518a9c1b9a348e18c99, scope.project.id=f405caf5e07a413190b7459d3015b944, user.id=d48900f443894ac798508f952478760c) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:22.843169 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e892a-31c3-4154-ae01-859fb0f479d7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:22.845163 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e892a-31c3-4154-ae01-859fb0f479d7 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:22.846082 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 71/146] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Oct 27 01:20:22 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:22.846987 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379c6c8-b459-4beb-996e-c1f701a7482a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:22.860037 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 76/147] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:20:22 2021] GET /identity/v3/role_assignments?user.id=d48900f443894ac798508f952478760c&scope.project.id=f405caf5e07a413190b7459d3015b944&role.id=df3a437e6ea14518a9c1b9a348e18c99 => generated 608 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:22.860804 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e892a-31c3-4154-ae01-859fb0f479d7 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:22.865897 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379c6c8-b459-4beb-996e-c1f701a7482a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:22.878756 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d0982-8037-41b3-897e-830ab217ffd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:22.879536 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d0982-8037-41b3-897e-830ab217ffd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:22.879833 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d0982-8037-41b3-897e-830ab217ffd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:22.880119 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d0982-8037-41b3-897e-830ab217ffd1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:22.882405 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d0982-8037-41b3-897e-830ab217ffd1 admin admin] RBAC: Adding query filter params (role.id=540999ece4154e6ba219007ddda3f8f9, scope.project.id=2de0e1d9ce084c8abbb7235e6f290e29, user.id=ec851783eb6e47d286a7d11681c3f75a) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:22.882728 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d0982-8037-41b3-897e-830ab217ffd1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:22.885563 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e892a-31c3-4154-ae01-859fb0f479d7 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:22.886763 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d0982-8037-41b3-897e-830ab217ffd1 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:22.894211 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed70a0-4b25-4ff7-ace3-ed70f41095c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:22.895158 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed70a0-4b25-4ff7-ace3-ed70f41095c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:22.895444 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed70a0-4b25-4ff7-ace3-ed70f41095c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:22.896764 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed70a0-4b25-4ff7-ace3-ed70f41095c7 admin admin] PATH_INFO: `/v3/users/ec851783eb6e47d286a7d11681c3f75a` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:22.899439 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed70a0-4b25-4ff7-ace3-ed70f41095c7 admin admin] RBAC: Authorizing `identity:get_user(user_id=ec851783eb6e47d286a7d11681c3f75a)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:22.900567 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 72/148] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:20:22 2021] GET /identity/v3/role_assignments?user.id=ec851783eb6e47d286a7d11681c3f75a&scope.project.id=2de0e1d9ce084c8abbb7235e6f290e29&role.id=540999ece4154e6ba219007ddda3f8f9 => generated 608 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:22.903033 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed70a0-4b25-4ff7-ace3-ed70f41095c7 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:22.904873 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 77/149] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:20:22 2021] GET /identity/v3/users/ec851783eb6e47d286a7d11681c3f75a => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:22.919092 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d0982-8037-41b3-897e-830ab217ffd1 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:22.929999 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d0982-8037-41b3-897e-830ab217ffd1 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:22.937283 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e3303-8003-47af-9424-0c18d698145a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:22.938052 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e3303-8003-47af-9424-0c18d698145a admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:22.938406 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e3303-8003-47af-9424-0c18d698145a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:22.938692 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e3303-8003-47af-9424-0c18d698145a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:22.949108 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e3303-8003-47af-9424-0c18d698145a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:22.956530 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e3303-8003-47af-9424-0c18d698145a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:22.973346 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 73/150] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:22 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:20:22.980221 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed70a0-4b25-4ff7-ace3-ed70f41095c7 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:22.990834 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed70a0-4b25-4ff7-ace3-ed70f41095c7 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:22.996430 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f3f9e-a269-4eb5-b61c-dbe5461da6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:22.997459 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f3f9e-a269-4eb5-b61c-dbe5461da6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:22.997790 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f3f9e-a269-4eb5-b61c-dbe5461da6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:22.998131 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f3f9e-a269-4eb5-b61c-dbe5461da6b1 admin admin] PATH_INFO: `/v3/projects/f405caf5e07a413190b7459d3015b944` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:22.999643 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f3f9e-a269-4eb5-b61c-dbe5461da6b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=f405caf5e07a413190b7459d3015b944)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:23.002150 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f3f9e-a269-4eb5-b61c-dbe5461da6b1 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:23.004111 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 78/151] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:22 2021] GET /identity/v3/projects/f405caf5e07a413190b7459d3015b944 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:23.011246 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e3303-8003-47af-9424-0c18d698145a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:23.021127 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e3303-8003-47af-9424-0c18d698145a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:23.030027 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc4b72-06b8-4de5-b798-9612c7ac97ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:23.030773 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc4b72-06b8-4de5-b798-9612c7ac97ae admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:23.031065 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc4b72-06b8-4de5-b798-9612c7ac97ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:23.031457 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc4b72-06b8-4de5-b798-9612c7ac97ae admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:23.032356 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc4b72-06b8-4de5-b798-9612c7ac97ae admin admin] RBAC: Adding query filter params (role.id=540999ece4154e6ba219007ddda3f8f9, scope.project.id=f405caf5e07a413190b7459d3015b944, user.id=ec851783eb6e47d286a7d11681c3f75a) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:23.032733 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc4b72-06b8-4de5-b798-9612c7ac97ae admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:23.034781 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc4b72-06b8-4de5-b798-9612c7ac97ae admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:23.044358 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 74/152] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:20:23 2021] GET /identity/v3/role_assignments?user.id=ec851783eb6e47d286a7d11681c3f75a&scope.project.id=f405caf5e07a413190b7459d3015b944&role.id=540999ece4154e6ba219007ddda3f8f9 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:23.096136 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25881b02-a9b7-454a-af20-f32be79a5636 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:23.096455 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25881b02-a9b7-454a-af20-f32be79a5636 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:23.096685 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25881b02-a9b7-454a-af20-f32be79a5636 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:23.098510 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 79/153] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:23.105896 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe0113-2f84-4ce9-9daa-dccd5d83a896 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:23.106232 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe0113-2f84-4ce9-9daa-dccd5d83a896 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:23.106443 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe0113-2f84-4ce9-9daa-dccd5d83a896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:23.125331 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-e1fe0113-2f84-4ce9-9daa-dccd5d83a896 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:23.126598 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-e1fe0113-2f84-4ce9-9daa-dccd5d83a896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:23.135292 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 75/154] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:23.160444 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25881b02-a9b7-454a-af20-f32be79a5636 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:23.173719 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25881b02-a9b7-454a-af20-f32be79a5636 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:23.178410 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b516a-875e-4e89-b702-3cd3661f7936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:23.179277 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b516a-875e-4e89-b702-3cd3661f7936 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:23.179609 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b516a-875e-4e89-b702-3cd3661f7936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:23.179940 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b516a-875e-4e89-b702-3cd3661f7936 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:23.192967 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b516a-875e-4e89-b702-3cd3661f7936 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:23.201640 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-e52b516a-875e-4e89-b702-3cd3661f7936 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:20:23.202991 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 80/155] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Oct 27 01:20:23 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:23.209807 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe0113-2f84-4ce9-9daa-dccd5d83a896 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:23.220212 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe0113-2f84-4ce9-9daa-dccd5d83a896 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:23.224918 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414cfbd-c766-4b21-8f67-5dc39097cc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:23.225643 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414cfbd-c766-4b21-8f67-5dc39097cc5a admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:23.225976 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414cfbd-c766-4b21-8f67-5dc39097cc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:23.226246 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414cfbd-c766-4b21-8f67-5dc39097cc5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:23.227021 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414cfbd-c766-4b21-8f67-5dc39097cc5a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:23.227321 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414cfbd-c766-4b21-8f67-5dc39097cc5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:23.229163 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414cfbd-c766-4b21-8f67-5dc39097cc5a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:23.238591 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 76/156] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:23 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:23.245031 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b516a-875e-4e89-b702-3cd3661f7936 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:23.256335 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b516a-875e-4e89-b702-3cd3661f7936 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:23.261739 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d78f53-f5d6-4ba9-9c88-124c976ff0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:23.262697 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d78f53-f5d6-4ba9-9c88-124c976ff0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:23.262979 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d78f53-f5d6-4ba9-9c88-124c976ff0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:23.263254 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d78f53-f5d6-4ba9-9c88-124c976ff0d6 admin admin] PATH_INFO: `/v3/users/ec851783eb6e47d286a7d11681c3f75a` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:23.264715 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d78f53-f5d6-4ba9-9c88-124c976ff0d6 admin admin] RBAC: Authorizing `identity:get_user(user_id=ec851783eb6e47d286a7d11681c3f75a)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:23.267142 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d78f53-f5d6-4ba9-9c88-124c976ff0d6 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:23.268909 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 81/157] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:20:23 2021] GET /identity/v3/users/ec851783eb6e47d286a7d11681c3f75a => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:23.276168 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414cfbd-c766-4b21-8f67-5dc39097cc5a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:23.291142 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414cfbd-c766-4b21-8f67-5dc39097cc5a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:23.296465 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94849708-0854-430c-bee3-8c655e9019e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:23.297192 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94849708-0854-430c-bee3-8c655e9019e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:23.297477 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94849708-0854-430c-bee3-8c655e9019e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:23.297774 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94849708-0854-430c-bee3-8c655e9019e1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:23.308611 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94849708-0854-430c-bee3-8c655e9019e1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:23.310500 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94849708-0854-430c-bee3-8c655e9019e1 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:23.323617 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 77/158] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:23.330400 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d78f53-f5d6-4ba9-9c88-124c976ff0d6 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:23.341213 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d78f53-f5d6-4ba9-9c88-124c976ff0d6 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:23.349045 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304a455-f0e4-446f-9e26-721f488f71c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:23.349987 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304a455-f0e4-446f-9e26-721f488f71c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:23.350265 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304a455-f0e4-446f-9e26-721f488f71c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:23.350591 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304a455-f0e4-446f-9e26-721f488f71c7 admin admin] PATH_INFO: `/v3/projects/f405caf5e07a413190b7459d3015b944` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:23.351849 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304a455-f0e4-446f-9e26-721f488f71c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=f405caf5e07a413190b7459d3015b944)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:23.354600 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304a455-f0e4-446f-9e26-721f488f71c7 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:23.356577 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 82/159] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:23 2021] GET /identity/v3/projects/f405caf5e07a413190b7459d3015b944 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:23.363030 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94849708-0854-430c-bee3-8c655e9019e1 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:23.372760 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94849708-0854-430c-bee3-8c655e9019e1 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:23.380884 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81e897-e475-40c7-bf38-bbaa7211afac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:23.381605 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81e897-e475-40c7-bf38-bbaa7211afac admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:23.381886 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81e897-e475-40c7-bf38-bbaa7211afac admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:23.382163 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81e897-e475-40c7-bf38-bbaa7211afac admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:23.383060 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81e897-e475-40c7-bf38-bbaa7211afac admin admin] RBAC: Adding query filter params (role.id=22382371cf4846fe84d1403e3ab1785e, scope.project.id=f405caf5e07a413190b7459d3015b944, user.id=ec851783eb6e47d286a7d11681c3f75a) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:23.383366 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81e897-e475-40c7-bf38-bbaa7211afac admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:23.385919 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81e897-e475-40c7-bf38-bbaa7211afac admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:23.393755 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 78/160] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:20:23 2021] GET /identity/v3/role_assignments?user.id=ec851783eb6e47d286a7d11681c3f75a&scope.project.id=f405caf5e07a413190b7459d3015b944&role.id=22382371cf4846fe84d1403e3ab1785e => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:24.641652 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0842e-7cc8-46b8-849d-74ced9cd2add None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:24.642300 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0842e-7cc8-46b8-849d-74ced9cd2add None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:24.642300 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0842e-7cc8-46b8-849d-74ced9cd2add None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:24.644064 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 83/161] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:24.651306 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff4943-536b-43d0-be96-44965dadaa4b None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:24.651306 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff4943-536b-43d0-be96-44965dadaa4b None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:24.651306 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff4943-536b-43d0-be96-44965dadaa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:24.669663 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-11ff4943-536b-43d0-be96-44965dadaa4b None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:24.671107 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-11ff4943-536b-43d0-be96-44965dadaa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:24.679174 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 79/162] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:24.703766 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0842e-7cc8-46b8-849d-74ced9cd2add None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:24.716920 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0842e-7cc8-46b8-849d-74ced9cd2add None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:24.721622 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a784f82-dd67-44c4-bea3-5203b2bd0daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:24.722627 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a784f82-dd67-44c4-bea3-5203b2bd0daf admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:24.723119 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a784f82-dd67-44c4-bea3-5203b2bd0daf admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:24.723600 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a784f82-dd67-44c4-bea3-5203b2bd0daf admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:24.734190 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a784f82-dd67-44c4-bea3-5203b2bd0daf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:24.741388 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-4a784f82-dd67-44c4-bea3-5203b2bd0daf admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:20:24.742785 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 84/163] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:24 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:24.751894 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff4943-536b-43d0-be96-44965dadaa4b None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:24.761707 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff4943-536b-43d0-be96-44965dadaa4b None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:24.766512 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4e13a-7f53-4b4e-adcd-397af1db9a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:24.767442 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4e13a-7f53-4b4e-adcd-397af1db9a53 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:24.767933 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4e13a-7f53-4b4e-adcd-397af1db9a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:24.768416 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4e13a-7f53-4b4e-adcd-397af1db9a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:24.769373 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4e13a-7f53-4b4e-adcd-397af1db9a53 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:24.770014 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4e13a-7f53-4b4e-adcd-397af1db9a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:24.771924 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4e13a-7f53-4b4e-adcd-397af1db9a53 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:24.782208 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 80/164] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Oct 27 01:20:24 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:24.792026 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a784f82-dd67-44c4-bea3-5203b2bd0daf admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:24.802655 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a784f82-dd67-44c4-bea3-5203b2bd0daf admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:24.808265 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b3de6-0c4b-420c-a083-df0d0a0dde88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:24.809623 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b3de6-0c4b-420c-a083-df0d0a0dde88 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:24.810122 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b3de6-0c4b-420c-a083-df0d0a0dde88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:24.810590 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b3de6-0c4b-420c-a083-df0d0a0dde88 admin admin] PATH_INFO: `/v3/users/f4e70afd8b1544f39207d23608348872` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:24.827346 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b3de6-0c4b-420c-a083-df0d0a0dde88 admin admin] RBAC: Authorizing `identity:get_user(user_id=f4e70afd8b1544f39207d23608348872)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:24.829823 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b3de6-0c4b-420c-a083-df0d0a0dde88 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:24.831800 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 85/165] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:20:24 2021] GET /identity/v3/users/f4e70afd8b1544f39207d23608348872 => generated 283 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:24.838359 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4e13a-7f53-4b4e-adcd-397af1db9a53 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:24.849470 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4e13a-7f53-4b4e-adcd-397af1db9a53 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:24.854807 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2342a-4ed0-4bf5-a805-e206d2e17d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:24.855864 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2342a-4ed0-4bf5-a805-e206d2e17d95 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:24.856377 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2342a-4ed0-4bf5-a805-e206d2e17d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:24.856879 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2342a-4ed0-4bf5-a805-e206d2e17d95 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:24.866304 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb2342a-4ed0-4bf5-a805-e206d2e17d95 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:24.869086 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb2342a-4ed0-4bf5-a805-e206d2e17d95 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:24.879316 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 81/166] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:24 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:24.887750 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b3de6-0c4b-420c-a083-df0d0a0dde88 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:24.898040 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b3de6-0c4b-420c-a083-df0d0a0dde88 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:24.903415 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281c6ee-c47c-42be-a4b5-c4a75230c7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:24.904520 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281c6ee-c47c-42be-a4b5-c4a75230c7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:24.905058 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281c6ee-c47c-42be-a4b5-c4a75230c7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:24.905561 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281c6ee-c47c-42be-a4b5-c4a75230c7e0 admin admin] PATH_INFO: `/v3/projects/34499f5a2c02434b979288e28f14fe69` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:24.907161 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281c6ee-c47c-42be-a4b5-c4a75230c7e0 admin admin] RBAC: Authorizing `identity:get_project(project_id=34499f5a2c02434b979288e28f14fe69)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:24.909538 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281c6ee-c47c-42be-a4b5-c4a75230c7e0 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:24.911461 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 86/167] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:24 2021] GET /identity/v3/projects/34499f5a2c02434b979288e28f14fe69 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:24.920506 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2342a-4ed0-4bf5-a805-e206d2e17d95 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:24.929932 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2342a-4ed0-4bf5-a805-e206d2e17d95 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:24.935136 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c0381-393c-44f9-941f-db1fe8d1915e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:24.935777 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20b1bf-b947-4b9f-9268-b9b60290dd4c None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:24.936071 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20b1bf-b947-4b9f-9268-b9b60290dd4c None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:24.936354 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20b1bf-b947-4b9f-9268-b9b60290dd4c None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:24.936744 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c0381-393c-44f9-941f-db1fe8d1915e admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:24.937237 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c0381-393c-44f9-941f-db1fe8d1915e admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:24.937749 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c0381-393c-44f9-941f-db1fe8d1915e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:24.938150 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 87/168] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:20:24.939062 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c0381-393c-44f9-941f-db1fe8d1915e admin admin] RBAC: Adding query filter params (role.id=540999ece4154e6ba219007ddda3f8f9, scope.project.id=34499f5a2c02434b979288e28f14fe69, user.id=f4e70afd8b1544f39207d23608348872) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:24.939619 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c0381-393c-44f9-941f-db1fe8d1915e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:24.941806 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c0381-393c-44f9-941f-db1fe8d1915e admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:24.943798 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b2ec9-2642-4936-8d2b-ba362c0bad3e None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:24.944068 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b2ec9-2642-4936-8d2b-ba362c0bad3e None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:24.944356 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b2ec9-2642-4936-8d2b-ba362c0bad3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:24.948891 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 82/169] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:20:24 2021] GET /identity/v3/role_assignments?user.id=f4e70afd8b1544f39207d23608348872&scope.project.id=34499f5a2c02434b979288e28f14fe69&role.id=540999ece4154e6ba219007ddda3f8f9 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:24.970244 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-dc0b2ec9-2642-4936-8d2b-ba362c0bad3e None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:24.971464 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-dc0b2ec9-2642-4936-8d2b-ba362c0bad3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:24.980139 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 88/170] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:25.004978 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c0381-393c-44f9-941f-db1fe8d1915e admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:25.015856 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c0381-393c-44f9-941f-db1fe8d1915e admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:25.020665 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7175e-55cf-4e60-9f22-fdc70a585ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:25.021603 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7175e-55cf-4e60-9f22-fdc70a585ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.021889 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7175e-55cf-4e60-9f22-fdc70a585ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.022163 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7175e-55cf-4e60-9f22-fdc70a585ff8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.034784 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7175e-55cf-4e60-9f22-fdc70a585ff8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:25.042848 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-37e7175e-55cf-4e60-9f22-fdc70a585ff8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:20:25.044700 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 83/171] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:20:25 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:25.051144 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b2ec9-2642-4936-8d2b-ba362c0bad3e None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:25.061340 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b2ec9-2642-4936-8d2b-ba362c0bad3e None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:25.066093 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c641a2-770f-44e2-8670-2096b414c921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:25.066766 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c641a2-770f-44e2-8670-2096b414c921 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.067106 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c641a2-770f-44e2-8670-2096b414c921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.067381 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c641a2-770f-44e2-8670-2096b414c921 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.068200 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c641a2-770f-44e2-8670-2096b414c921 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:25.068507 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c641a2-770f-44e2-8670-2096b414c921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:25.070228 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c641a2-770f-44e2-8670-2096b414c921 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:25.084949 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 89/172] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:25 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:25.091320 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7175e-55cf-4e60-9f22-fdc70a585ff8 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:25.102227 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7175e-55cf-4e60-9f22-fdc70a585ff8 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:25.106990 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346c6d2-a43d-45cd-b3d3-f324de31fd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:25.107921 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346c6d2-a43d-45cd-b3d3-f324de31fd3a admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.108252 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346c6d2-a43d-45cd-b3d3-f324de31fd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.108521 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346c6d2-a43d-45cd-b3d3-f324de31fd3a admin admin] PATH_INFO: `/v3/users/d48900f443894ac798508f952478760c` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.109802 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346c6d2-a43d-45cd-b3d3-f324de31fd3a admin admin] RBAC: Authorizing `identity:get_user(user_id=d48900f443894ac798508f952478760c)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:25.111787 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346c6d2-a43d-45cd-b3d3-f324de31fd3a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:25.113705 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 84/173] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:20:25 2021] GET /identity/v3/users/d48900f443894ac798508f952478760c => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:25.120573 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c641a2-770f-44e2-8670-2096b414c921 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:25.131154 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c641a2-770f-44e2-8670-2096b414c921 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:25.136478 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf3592-c8e8-45ae-8d49-77dfd3bbe300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:25.137184 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf3592-c8e8-45ae-8d49-77dfd3bbe300 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.137469 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf3592-c8e8-45ae-8d49-77dfd3bbe300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.137856 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf3592-c8e8-45ae-8d49-77dfd3bbe300 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.147201 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf3592-c8e8-45ae-8d49-77dfd3bbe300 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:25.149184 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf3592-c8e8-45ae-8d49-77dfd3bbe300 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:25.159322 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 90/174] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:25 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:25.165626 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346c6d2-a43d-45cd-b3d3-f324de31fd3a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:25.175761 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346c6d2-a43d-45cd-b3d3-f324de31fd3a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:25.180350 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed34e09-80f0-46fb-ba47-fdf22ed8dc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:25.181249 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed34e09-80f0-46fb-ba47-fdf22ed8dc15 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.182218 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed34e09-80f0-46fb-ba47-fdf22ed8dc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.182545 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed34e09-80f0-46fb-ba47-fdf22ed8dc15 admin admin] PATH_INFO: `/v3/projects/34499f5a2c02434b979288e28f14fe69` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.184039 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed34e09-80f0-46fb-ba47-fdf22ed8dc15 admin admin] RBAC: Authorizing `identity:get_project(project_id=34499f5a2c02434b979288e28f14fe69)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:25.186335 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed34e09-80f0-46fb-ba47-fdf22ed8dc15 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:25.188032 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 85/175] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:25 2021] GET /identity/v3/projects/34499f5a2c02434b979288e28f14fe69 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:25.194423 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf3592-c8e8-45ae-8d49-77dfd3bbe300 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:25.204115 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf3592-c8e8-45ae-8d49-77dfd3bbe300 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:25.208606 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351096aa-a1c1-4ed6-a95f-6e5cbff1b044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:25.209246 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351096aa-a1c1-4ed6-a95f-6e5cbff1b044 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.209546 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351096aa-a1c1-4ed6-a95f-6e5cbff1b044 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.209827 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351096aa-a1c1-4ed6-a95f-6e5cbff1b044 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.210716 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351096aa-a1c1-4ed6-a95f-6e5cbff1b044 admin admin] RBAC: Adding query filter params (role.id=df3a437e6ea14518a9c1b9a348e18c99, scope.project.id=34499f5a2c02434b979288e28f14fe69, user.id=d48900f443894ac798508f952478760c) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:25.211012 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351096aa-a1c1-4ed6-a95f-6e5cbff1b044 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:25.212871 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351096aa-a1c1-4ed6-a95f-6e5cbff1b044 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:25.218863 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 91/176] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:20:25 2021] GET /identity/v3/role_assignments?user.id=d48900f443894ac798508f952478760c&scope.project.id=34499f5a2c02434b979288e28f14fe69&role.id=df3a437e6ea14518a9c1b9a348e18c99 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:25.517445 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d587a2b-cddc-4b6d-acb4-9370bf1c2279 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.517905 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d587a2b-cddc-4b6d-acb4-9370bf1c2279 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.518300 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d587a2b-cddc-4b6d-acb4-9370bf1c2279 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.520212 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 86/177] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:25.526294 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8873c1c-0d30-46f6-90e8-e28dfa450573 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.526581 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8873c1c-0d30-46f6-90e8-e28dfa450573 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.526856 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8873c1c-0d30-46f6-90e8-e28dfa450573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.544836 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-b8873c1c-0d30-46f6-90e8-e28dfa450573 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:25.546047 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-b8873c1c-0d30-46f6-90e8-e28dfa450573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:25.553542 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 92/178] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:25.577866 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d587a2b-cddc-4b6d-acb4-9370bf1c2279 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:25.591031 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d587a2b-cddc-4b6d-acb4-9370bf1c2279 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:25.596022 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591b347-aedf-4232-98d0-d568768f45f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:25.597231 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591b347-aedf-4232-98d0-d568768f45f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.597748 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591b347-aedf-4232-98d0-d568768f45f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.598226 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591b347-aedf-4232-98d0-d568768f45f6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.611003 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7591b347-aedf-4232-98d0-d568768f45f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:25.618811 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-7591b347-aedf-4232-98d0-d568768f45f6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:20:25.620883 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 87/179] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Oct 27 01:20:25 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:25.627333 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8873c1c-0d30-46f6-90e8-e28dfa450573 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:25.636864 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8873c1c-0d30-46f6-90e8-e28dfa450573 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:25.641330 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa593fc-1da2-4a3d-81c0-6dba02588e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:25.649529 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa593fc-1da2-4a3d-81c0-6dba02588e42 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.650139 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa593fc-1da2-4a3d-81c0-6dba02588e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.650454 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa593fc-1da2-4a3d-81c0-6dba02588e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.651240 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa593fc-1da2-4a3d-81c0-6dba02588e42 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:25.651547 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa593fc-1da2-4a3d-81c0-6dba02588e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:25.653803 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa593fc-1da2-4a3d-81c0-6dba02588e42 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:25.662933 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 93/180] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:25 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:25.668926 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591b347-aedf-4232-98d0-d568768f45f6 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:25.678903 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591b347-aedf-4232-98d0-d568768f45f6 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:25.684285 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3fb7a-fc88-437e-bed1-354b776b8d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:25.685204 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3fb7a-fc88-437e-bed1-354b776b8d8e admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.685516 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3fb7a-fc88-437e-bed1-354b776b8d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.685847 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3fb7a-fc88-437e-bed1-354b776b8d8e admin admin] PATH_INFO: `/v3/users/f4e70afd8b1544f39207d23608348872` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.687160 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3fb7a-fc88-437e-bed1-354b776b8d8e admin admin] RBAC: Authorizing `identity:get_user(user_id=f4e70afd8b1544f39207d23608348872)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:25.689526 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3fb7a-fc88-437e-bed1-354b776b8d8e admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:25.691276 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 88/181] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:20:25 2021] GET /identity/v3/users/f4e70afd8b1544f39207d23608348872 => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:25.698035 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa593fc-1da2-4a3d-81c0-6dba02588e42 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:25.708477 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa593fc-1da2-4a3d-81c0-6dba02588e42 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:25.713079 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b00ef-d0df-4845-97e0-e2d1aeae4821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:25.713747 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b00ef-d0df-4845-97e0-e2d1aeae4821 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.714092 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b00ef-d0df-4845-97e0-e2d1aeae4821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.714382 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b00ef-d0df-4845-97e0-e2d1aeae4821 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.722869 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b00ef-d0df-4845-97e0-e2d1aeae4821 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:25.724674 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b00ef-d0df-4845-97e0-e2d1aeae4821 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:25.731644 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aeb897-e8bb-482f-950f-bb37a47020be None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.731935 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aeb897-e8bb-482f-950f-bb37a47020be None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.732219 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aeb897-e8bb-482f-950f-bb37a47020be None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.734199 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 89/182] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:25.739794 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c1ecb-85eb-48f8-b208-bd0e6f22076e None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.740088 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c1ecb-85eb-48f8-b208-bd0e6f22076e None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.740369 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c1ecb-85eb-48f8-b208-bd0e6f22076e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.741401 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 94/183] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:25 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:25.748262 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b00ef-d0df-4845-97e0-e2d1aeae4821 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:25.759585 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b00ef-d0df-4845-97e0-e2d1aeae4821 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:25.759789 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-951c1ecb-85eb-48f8-b208-bd0e6f22076e None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:25.760911 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-951c1ecb-85eb-48f8-b208-bd0e6f22076e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:25.764665 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3dc9ff-b8dd-4237-9c81-aef06d3ae336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:25.765816 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3dc9ff-b8dd-4237-9c81-aef06d3ae336 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.766323 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3dc9ff-b8dd-4237-9c81-aef06d3ae336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.766836 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3dc9ff-b8dd-4237-9c81-aef06d3ae336 admin admin] PATH_INFO: `/v3/projects/34499f5a2c02434b979288e28f14fe69` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.768290 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3dc9ff-b8dd-4237-9c81-aef06d3ae336 admin admin] RBAC: Authorizing `identity:get_project(project_id=34499f5a2c02434b979288e28f14fe69)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:25.768666 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 90/184] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:25.770925 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3dc9ff-b8dd-4237-9c81-aef06d3ae336 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:25.772854 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 95/185] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:25 2021] GET /identity/v3/projects/34499f5a2c02434b979288e28f14fe69 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:25.780453 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c1ecb-85eb-48f8-b208-bd0e6f22076e None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:25.790886 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c1ecb-85eb-48f8-b208-bd0e6f22076e None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:25.793377 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3dc9ff-b8dd-4237-9c81-aef06d3ae336 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:25.796374 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ed89f-fc5b-4d9f-8b91-166c8166efc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:25.797324 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ed89f-fc5b-4d9f-8b91-166c8166efc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.797932 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ed89f-fc5b-4d9f-8b91-166c8166efc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.798688 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ed89f-fc5b-4d9f-8b91-166c8166efc0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.800389 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ed89f-fc5b-4d9f-8b91-166c8166efc0 admin admin] RBAC: Adding query filter params (role.id=22382371cf4846fe84d1403e3ab1785e, scope.project.id=34499f5a2c02434b979288e28f14fe69, user.id=f4e70afd8b1544f39207d23608348872) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:25.801217 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ed89f-fc5b-4d9f-8b91-166c8166efc0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:25.803069 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3dc9ff-b8dd-4237-9c81-aef06d3ae336 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:25.803530 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ed89f-fc5b-4d9f-8b91-166c8166efc0 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:25.808656 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47ff74-85ef-45e5-8502-b11e2efff146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:25.809433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47ff74-85ef-45e5-8502-b11e2efff146 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.809769 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47ff74-85ef-45e5-8502-b11e2efff146 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.810050 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47ff74-85ef-45e5-8502-b11e2efff146 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.810897 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 91/186] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:20:25 2021] GET /identity/v3/role_assignments?user.id=f4e70afd8b1544f39207d23608348872&scope.project.id=34499f5a2c02434b979288e28f14fe69&role.id=22382371cf4846fe84d1403e3ab1785e => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:25.811219 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47ff74-85ef-45e5-8502-b11e2efff146 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:25.812867 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47ff74-85ef-45e5-8502-b11e2efff146 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:25.817608 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 96/187] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:25 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:25.820805 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ed89f-fc5b-4d9f-8b91-166c8166efc0 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:25.831487 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ed89f-fc5b-4d9f-8b91-166c8166efc0 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:25.836152 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1e6ad-dfa4-44f0-804b-258da4dff24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:25.836902 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1e6ad-dfa4-44f0-804b-258da4dff24f admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.837191 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1e6ad-dfa4-44f0-804b-258da4dff24f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.837475 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1e6ad-dfa4-44f0-804b-258da4dff24f admin admin] PATH_INFO: `/v3/groups` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.838768 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1e6ad-dfa4-44f0-804b-258da4dff24f admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:25.839786 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING py.warnings [None req-25d1e6ad-dfa4-44f0-804b-258da4dff24f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:25.839786 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: warnings.warn(msg) Oct 27 01:20:25.839786 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: Oct 27 01:20:25.840990 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1e6ad-dfa4-44f0-804b-258da4dff24f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:25.858295 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 92/188] 10.222.0.25 () {60 vars in 1155 bytes} [Wed Oct 27 01:20:25 2021] POST /identity/v3/groups => generated 229 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:27.272688 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8180d4c-60d2-40b2-bc8c-b9e3ee358f13 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.273183 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8180d4c-60d2-40b2-bc8c-b9e3ee358f13 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.273183 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8180d4c-60d2-40b2-bc8c-b9e3ee358f13 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.274989 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 97/189] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:27.281509 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382f07d-9b29-456b-b983-561455bafde5 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.281894 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382f07d-9b29-456b-b983-561455bafde5 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.282086 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382f07d-9b29-456b-b983-561455bafde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.300322 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-2382f07d-9b29-456b-b983-561455bafde5 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:27.301615 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-2382f07d-9b29-456b-b983-561455bafde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:27.309526 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 93/190] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:27.332349 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8180d4c-60d2-40b2-bc8c-b9e3ee358f13 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:27.344945 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8180d4c-60d2-40b2-bc8c-b9e3ee358f13 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:27.349373 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ec6ce-6e56-4bff-88ba-1c379b504597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:27.350176 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ec6ce-6e56-4bff-88ba-1c379b504597 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.350458 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ec6ce-6e56-4bff-88ba-1c379b504597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.350736 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ec6ce-6e56-4bff-88ba-1c379b504597 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.361441 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ec6ce-6e56-4bff-88ba-1c379b504597 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:27.368480 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-4b5ec6ce-6e56-4bff-88ba-1c379b504597 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:20:27.369715 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 98/191] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:27 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:27.376441 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382f07d-9b29-456b-b983-561455bafde5 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:27.386762 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382f07d-9b29-456b-b983-561455bafde5 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:27.391445 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688f4e3-d290-4ec4-bc40-1d8f1c93920d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:27.392151 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688f4e3-d290-4ec4-bc40-1d8f1c93920d admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.392436 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688f4e3-d290-4ec4-bc40-1d8f1c93920d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.392711 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688f4e3-d290-4ec4-bc40-1d8f1c93920d admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.393511 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688f4e3-d290-4ec4-bc40-1d8f1c93920d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:27.393837 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688f4e3-d290-4ec4-bc40-1d8f1c93920d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:27.395501 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688f4e3-d290-4ec4-bc40-1d8f1c93920d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:27.405992 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 94/192] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Oct 27 01:20:27 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:27.412285 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ec6ce-6e56-4bff-88ba-1c379b504597 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:27.423414 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ec6ce-6e56-4bff-88ba-1c379b504597 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:27.427827 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb32c9-3d79-4fd7-8c76-f9c18b4218fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:27.428672 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb32c9-3d79-4fd7-8c76-f9c18b4218fb admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.428956 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb32c9-3d79-4fd7-8c76-f9c18b4218fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.429234 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb32c9-3d79-4fd7-8c76-f9c18b4218fb admin admin] PATH_INFO: `/v3/users/f4e70afd8b1544f39207d23608348872` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.430472 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb32c9-3d79-4fd7-8c76-f9c18b4218fb admin admin] RBAC: Authorizing `identity:get_user(user_id=f4e70afd8b1544f39207d23608348872)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:27.432601 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb32c9-3d79-4fd7-8c76-f9c18b4218fb admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:27.434823 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 99/193] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:20:27 2021] GET /identity/v3/users/f4e70afd8b1544f39207d23608348872 => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:27.440755 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688f4e3-d290-4ec4-bc40-1d8f1c93920d admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:27.450679 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688f4e3-d290-4ec4-bc40-1d8f1c93920d admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:27.455129 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c628184-0632-4836-800a-2d3949ff054e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:27.455986 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c628184-0632-4836-800a-2d3949ff054e admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.456269 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c628184-0632-4836-800a-2d3949ff054e admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.456545 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c628184-0632-4836-800a-2d3949ff054e admin admin] PATH_INFO: `/v3/projects/34499f5a2c02434b979288e28f14fe69` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.457776 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c628184-0632-4836-800a-2d3949ff054e admin admin] RBAC: Authorizing `identity:get_project(project_id=34499f5a2c02434b979288e28f14fe69)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:27.459814 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c628184-0632-4836-800a-2d3949ff054e admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:27.461472 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 95/194] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:27 2021] GET /identity/v3/projects/34499f5a2c02434b979288e28f14fe69 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:27.468238 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb32c9-3d79-4fd7-8c76-f9c18b4218fb admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:27.478171 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb32c9-3d79-4fd7-8c76-f9c18b4218fb admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:27.483139 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740aaac-4a99-448e-bef9-1e5222460615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:27.484014 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740aaac-4a99-448e-bef9-1e5222460615 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.484298 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740aaac-4a99-448e-bef9-1e5222460615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.484579 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740aaac-4a99-448e-bef9-1e5222460615 admin admin] PATH_INFO: `/v3/projects/34499f5a2c02434b979288e28f14fe69/users/f4e70afd8b1544f39207d23608348872/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.486680 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740aaac-4a99-448e-bef9-1e5222460615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34499f5a2c02434b979288e28f14fe69, user_id=f4e70afd8b1544f39207d23608348872, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:27.489361 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740aaac-4a99-448e-bef9-1e5222460615 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:27.503115 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 100/195] 10.222.0.25 () {58 vars in 1460 bytes} [Wed Oct 27 01:20:27 2021] PUT /identity/v3/projects/34499f5a2c02434b979288e28f14fe69/users/f4e70afd8b1544f39207d23608348872/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:27.528597 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552ae7b-cc97-4564-aec4-94a670dc556c None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.528876 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552ae7b-cc97-4564-aec4-94a670dc556c None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.529067 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552ae7b-cc97-4564-aec4-94a670dc556c None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.530981 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 96/196] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:27.537898 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a8e8c-1d44-4c6c-a56c-e05439485246 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.538204 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a8e8c-1d44-4c6c-a56c-e05439485246 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.538486 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a8e8c-1d44-4c6c-a56c-e05439485246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.557740 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-c84a8e8c-1d44-4c6c-a56c-e05439485246 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:27.559206 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-c84a8e8c-1d44-4c6c-a56c-e05439485246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:27.623823 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 101/197] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:27.647480 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552ae7b-cc97-4564-aec4-94a670dc556c None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:27.662423 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552ae7b-cc97-4564-aec4-94a670dc556c None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:27.667486 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921289d-6971-4726-ab5c-29becedf35ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:27.668421 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921289d-6971-4726-ab5c-29becedf35ad admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.668709 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921289d-6971-4726-ab5c-29becedf35ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.669049 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921289d-6971-4726-ab5c-29becedf35ad admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.681560 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921289d-6971-4726-ab5c-29becedf35ad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:27.688744 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-e921289d-6971-4726-ab5c-29becedf35ad admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:20:27.690049 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 97/198] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:20:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:27.696654 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a8e8c-1d44-4c6c-a56c-e05439485246 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:27.706975 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a8e8c-1d44-4c6c-a56c-e05439485246 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:27.711967 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ced83-bfb4-49e7-9039-33965512429e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:27.712676 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ced83-bfb4-49e7-9039-33965512429e admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.713515 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ced83-bfb4-49e7-9039-33965512429e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.713803 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ced83-bfb4-49e7-9039-33965512429e admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.714617 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ced83-bfb4-49e7-9039-33965512429e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:27.714944 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ced83-bfb4-49e7-9039-33965512429e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:27.716536 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ced83-bfb4-49e7-9039-33965512429e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:27.727243 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 102/199] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:27.732373 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921289d-6971-4726-ab5c-29becedf35ad admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:27.743739 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921289d-6971-4726-ab5c-29becedf35ad admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:27.748399 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5fc73-795c-471c-b6b8-a4e2779fca6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:27.749264 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5fc73-795c-471c-b6b8-a4e2779fca6b admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.749581 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5fc73-795c-471c-b6b8-a4e2779fca6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.749863 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5fc73-795c-471c-b6b8-a4e2779fca6b admin admin] PATH_INFO: `/v3/users/d48900f443894ac798508f952478760c` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.751157 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5fc73-795c-471c-b6b8-a4e2779fca6b admin admin] RBAC: Authorizing `identity:get_user(user_id=d48900f443894ac798508f952478760c)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:27.752963 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5fc73-795c-471c-b6b8-a4e2779fca6b admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:27.754605 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 98/200] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:20:27 2021] GET /identity/v3/users/d48900f443894ac798508f952478760c => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:27.761450 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ced83-bfb4-49e7-9039-33965512429e admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:27.775840 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ced83-bfb4-49e7-9039-33965512429e admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:27.780711 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca49d59-de57-4f28-b7d5-eee090686c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:27.781803 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca49d59-de57-4f28-b7d5-eee090686c61 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.782343 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca49d59-de57-4f28-b7d5-eee090686c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.782795 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca49d59-de57-4f28-b7d5-eee090686c61 admin admin] PATH_INFO: `/v3/projects/34499f5a2c02434b979288e28f14fe69` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.784229 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca49d59-de57-4f28-b7d5-eee090686c61 admin admin] RBAC: Authorizing `identity:get_project(project_id=34499f5a2c02434b979288e28f14fe69)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:27.786522 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca49d59-de57-4f28-b7d5-eee090686c61 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:27.788761 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 103/201] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:27 2021] GET /identity/v3/projects/34499f5a2c02434b979288e28f14fe69 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:27.796144 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5fc73-795c-471c-b6b8-a4e2779fca6b admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:27.806582 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5fc73-795c-471c-b6b8-a4e2779fca6b admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:27.811890 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0520f2-1f41-4818-90e7-9893ff78554c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:27.813024 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0520f2-1f41-4818-90e7-9893ff78554c admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.813560 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0520f2-1f41-4818-90e7-9893ff78554c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.814034 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0520f2-1f41-4818-90e7-9893ff78554c admin admin] PATH_INFO: `/v3/projects/34499f5a2c02434b979288e28f14fe69/users/d48900f443894ac798508f952478760c/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.816293 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0520f2-1f41-4818-90e7-9893ff78554c admin admin] RBAC: Authorizing `identity:create_grant(project_id=34499f5a2c02434b979288e28f14fe69, user_id=d48900f443894ac798508f952478760c, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:27.819248 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0520f2-1f41-4818-90e7-9893ff78554c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:27.833958 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 99/202] 10.222.0.25 () {58 vars in 1460 bytes} [Wed Oct 27 01:20:27 2021] PUT /identity/v3/projects/34499f5a2c02434b979288e28f14fe69/users/d48900f443894ac798508f952478760c/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:28.187376 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014a832-aaef-476a-b11a-5684d7416d27 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:28.187766 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014a832-aaef-476a-b11a-5684d7416d27 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:28.187957 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014a832-aaef-476a-b11a-5684d7416d27 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:28.189763 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 104/203] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:28.195242 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f834c-e824-42fa-8f38-c37bf9cd4c7e None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:28.195531 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f834c-e824-42fa-8f38-c37bf9cd4c7e None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:28.195810 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f834c-e824-42fa-8f38-c37bf9cd4c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:28.198145 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae7a3b-29e3-43ff-bbb2-fd49d425438b None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:28.198432 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae7a3b-29e3-43ff-bbb2-fd49d425438b None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:28.198706 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae7a3b-29e3-43ff-bbb2-fd49d425438b None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:28.200572 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 100/204] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:28 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:28.206959 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cbffa-d03e-49a7-95bd-246963a410a1 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:28.207242 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cbffa-d03e-49a7-95bd-246963a410a1 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:28.207516 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cbffa-d03e-49a7-95bd-246963a410a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:28.221684 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-ea0f834c-e824-42fa-8f38-c37bf9cd4c7e None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:28.222861 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-ea0f834c-e824-42fa-8f38-c37bf9cd4c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:28.289076 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 105/205] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:28.313590 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f834c-e824-42fa-8f38-c37bf9cd4c7e None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:28.323283 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f834c-e824-42fa-8f38-c37bf9cd4c7e None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:28.327866 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb4caf-adbc-48ef-84ef-3072e25f2e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:28.328694 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb4caf-adbc-48ef-84ef-3072e25f2e5d admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:28.328980 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb4caf-adbc-48ef-84ef-3072e25f2e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:28.329260 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb4caf-adbc-48ef-84ef-3072e25f2e5d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:28.341349 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb4caf-adbc-48ef-84ef-3072e25f2e5d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:28.348995 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-4eeb4caf-adbc-48ef-84ef-3072e25f2e5d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:20:28.350283 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 106/206] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Oct 27 01:20:28 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:20:28.356952 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb4caf-adbc-48ef-84ef-3072e25f2e5d admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:28.362270 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-a05cbffa-d03e-49a7-95bd-246963a410a1 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:28.364761 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-a05cbffa-d03e-49a7-95bd-246963a410a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:28.368120 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb4caf-adbc-48ef-84ef-3072e25f2e5d admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:28.373062 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0a364-fc79-48bb-9038-ca22d7321dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:28.373985 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0a364-fc79-48bb-9038-ca22d7321dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:28.374140 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 101/207] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:28.378561 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0a364-fc79-48bb-9038-ca22d7321dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:28.378561 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0a364-fc79-48bb-9038-ca22d7321dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:28.378561 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0a364-fc79-48bb-9038-ca22d7321dd1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:28.378561 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0a364-fc79-48bb-9038-ca22d7321dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:28.378561 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0a364-fc79-48bb-9038-ca22d7321dd1 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:28.389862 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 107/208] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:28 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:28.396144 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cbffa-d03e-49a7-95bd-246963a410a1 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:28.399039 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0a364-fc79-48bb-9038-ca22d7321dd1 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:28.406961 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cbffa-d03e-49a7-95bd-246963a410a1 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:28.409607 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0a364-fc79-48bb-9038-ca22d7321dd1 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:28.411720 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c48236-e5b2-4a13-a0ee-f98b9efbec1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:28.412644 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c48236-e5b2-4a13-a0ee-f98b9efbec1b admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:28.413063 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c48236-e5b2-4a13-a0ee-f98b9efbec1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:28.413394 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c48236-e5b2-4a13-a0ee-f98b9efbec1b admin admin] PATH_INFO: `/v3/users/f4e70afd8b1544f39207d23608348872` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:28.414843 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c48236-e5b2-4a13-a0ee-f98b9efbec1b admin admin] RBAC: Authorizing `identity:get_user(user_id=f4e70afd8b1544f39207d23608348872)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:28.415703 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38553edc-b859-4146-bb5c-f50beb8dec28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:28.416715 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38553edc-b859-4146-bb5c-f50beb8dec28 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:28.417187 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c48236-e5b2-4a13-a0ee-f98b9efbec1b admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:28.417384 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38553edc-b859-4146-bb5c-f50beb8dec28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:28.417870 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38553edc-b859-4146-bb5c-f50beb8dec28 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:28.418892 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 102/209] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:20:28 2021] GET /identity/v3/users/f4e70afd8b1544f39207d23608348872 => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:28.419450 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38553edc-b859-4146-bb5c-f50beb8dec28 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:28.421442 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38553edc-b859-4146-bb5c-f50beb8dec28 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:28.423242 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 108/210] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:28 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:28.428403 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c48236-e5b2-4a13-a0ee-f98b9efbec1b admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:28.433848 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38553edc-b859-4146-bb5c-f50beb8dec28 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:28.439031 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c48236-e5b2-4a13-a0ee-f98b9efbec1b admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:28.446890 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38553edc-b859-4146-bb5c-f50beb8dec28 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:28.448620 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fa238-4a7a-4c6f-92d0-371c5a670e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:28.449472 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fa238-4a7a-4c6f-92d0-371c5a670e0e admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:28.449782 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fa238-4a7a-4c6f-92d0-371c5a670e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:28.450056 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fa238-4a7a-4c6f-92d0-371c5a670e0e admin admin] PATH_INFO: `/v3/projects/34499f5a2c02434b979288e28f14fe69` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:28.451506 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fa238-4a7a-4c6f-92d0-371c5a670e0e admin admin] RBAC: Authorizing `identity:get_project(project_id=34499f5a2c02434b979288e28f14fe69)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:28.453555 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fa238-4a7a-4c6f-92d0-371c5a670e0e admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:28.455220 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 103/211] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:28 2021] GET /identity/v3/projects/34499f5a2c02434b979288e28f14fe69 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:28.457549 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5401d6-d331-4db9-8950-24e1c230b064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:28.458488 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5401d6-d331-4db9-8950-24e1c230b064 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:28.458967 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5401d6-d331-4db9-8950-24e1c230b064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:28.459438 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5401d6-d331-4db9-8950-24e1c230b064 admin admin] PATH_INFO: `/v3/groups` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:28.460469 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5401d6-d331-4db9-8950-24e1c230b064 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:28.461287 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fa238-4a7a-4c6f-92d0-371c5a670e0e admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:28.462181 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING py.warnings [None req-ac5401d6-d331-4db9-8950-24e1c230b064 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:28.462181 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: warnings.warn(msg) Oct 27 01:20:28.462181 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: Oct 27 01:20:28.464416 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5401d6-d331-4db9-8950-24e1c230b064 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:28.472625 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fa238-4a7a-4c6f-92d0-371c5a670e0e admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:28.477347 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8dcd6-a393-4fa2-9d5e-26f8d38c8d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:28.478280 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8dcd6-a393-4fa2-9d5e-26f8d38c8d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:28.478578 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8dcd6-a393-4fa2-9d5e-26f8d38c8d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:28.478838 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8dcd6-a393-4fa2-9d5e-26f8d38c8d01 admin admin] PATH_INFO: `/v3/projects/34499f5a2c02434b979288e28f14fe69/users/f4e70afd8b1544f39207d23608348872/roles/22382371cf4846fe84d1403e3ab1785e` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:28.481100 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8dcd6-a393-4fa2-9d5e-26f8d38c8d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34499f5a2c02434b979288e28f14fe69, user_id=f4e70afd8b1544f39207d23608348872, role_id=22382371cf4846fe84d1403e3ab1785e)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:28.483520 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 109/212] 10.222.0.25 () {60 vars in 1155 bytes} [Wed Oct 27 01:20:28 2021] POST /identity/v3/groups => generated 226 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:28.490275 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8dcd6-a393-4fa2-9d5e-26f8d38c8d01 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:28.506101 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 104/213] 10.222.0.25 () {58 vars in 1460 bytes} [Wed Oct 27 01:20:28 2021] PUT /identity/v3/projects/34499f5a2c02434b979288e28f14fe69/users/f4e70afd8b1544f39207d23608348872/roles/22382371cf4846fe84d1403e3ab1785e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:29.922291 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de08d3-035c-4ca0-8c8b-6868b6f0a543 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:29.923278 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de08d3-035c-4ca0-8c8b-6868b6f0a543 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:29.923766 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de08d3-035c-4ca0-8c8b-6868b6f0a543 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:29.926006 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 110/214] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:29.933212 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3db95-96ce-4117-9007-4394b5715d54 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:29.934060 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3db95-96ce-4117-9007-4394b5715d54 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:29.934556 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3db95-96ce-4117-9007-4394b5715d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:29.952752 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-a8a3db95-96ce-4117-9007-4394b5715d54 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:29.954295 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-a8a3db95-96ce-4117-9007-4394b5715d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:30.014569 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 105/215] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:30.055543 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de08d3-035c-4ca0-8c8b-6868b6f0a543 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:30.068735 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de08d3-035c-4ca0-8c8b-6868b6f0a543 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:30.073072 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b4391-670e-434d-a8d5-2ff690d3c071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:30.077980 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b4391-670e-434d-a8d5-2ff690d3c071 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:30.078277 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b4391-670e-434d-a8d5-2ff690d3c071 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:30.078562 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b4391-670e-434d-a8d5-2ff690d3c071 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:30.089589 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b4391-670e-434d-a8d5-2ff690d3c071 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:30.096703 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-6a3b4391-670e-434d-a8d5-2ff690d3c071 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:20:30.102346 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 111/216] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:30 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:30.109120 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3db95-96ce-4117-9007-4394b5715d54 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:30.118346 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3db95-96ce-4117-9007-4394b5715d54 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:30.123533 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63335612-f7c2-458e-a7dc-ad0b0495274f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:30.124207 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63335612-f7c2-458e-a7dc-ad0b0495274f admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:30.124492 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63335612-f7c2-458e-a7dc-ad0b0495274f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:30.124772 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63335612-f7c2-458e-a7dc-ad0b0495274f admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:30.126333 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63335612-f7c2-458e-a7dc-ad0b0495274f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:30.126654 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63335612-f7c2-458e-a7dc-ad0b0495274f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:30.128242 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63335612-f7c2-458e-a7dc-ad0b0495274f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:30.137316 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 106/217] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Oct 27 01:20:30 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:30.143648 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b4391-670e-434d-a8d5-2ff690d3c071 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:30.154866 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b4391-670e-434d-a8d5-2ff690d3c071 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:30.159238 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a4b6e-6536-4268-81e6-7a8c9667036c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:30.160098 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a4b6e-6536-4268-81e6-7a8c9667036c admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:30.160384 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a4b6e-6536-4268-81e6-7a8c9667036c admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:30.160663 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a4b6e-6536-4268-81e6-7a8c9667036c admin admin] PATH_INFO: `/v3/users/f4e70afd8b1544f39207d23608348872` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:30.166528 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a4b6e-6536-4268-81e6-7a8c9667036c admin admin] RBAC: Authorizing `identity:get_user(user_id=f4e70afd8b1544f39207d23608348872)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:30.168661 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a4b6e-6536-4268-81e6-7a8c9667036c admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:30.170328 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 112/218] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:20:30 2021] GET /identity/v3/users/f4e70afd8b1544f39207d23608348872 => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:30.176686 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63335612-f7c2-458e-a7dc-ad0b0495274f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:30.187529 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63335612-f7c2-458e-a7dc-ad0b0495274f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:30.191965 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6e4f9-3cf6-4f2f-9c6f-ef2f3863fab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:30.192727 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6e4f9-3cf6-4f2f-9c6f-ef2f3863fab8 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:30.193020 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6e4f9-3cf6-4f2f-9c6f-ef2f3863fab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:30.193301 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6e4f9-3cf6-4f2f-9c6f-ef2f3863fab8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:30.205943 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6e4f9-3cf6-4f2f-9c6f-ef2f3863fab8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:30.207749 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6e4f9-3cf6-4f2f-9c6f-ef2f3863fab8 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:30.216825 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 107/219] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:30.223181 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a4b6e-6536-4268-81e6-7a8c9667036c admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:30.233103 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a4b6e-6536-4268-81e6-7a8c9667036c admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:30.237535 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aab086-3910-41e0-8d1f-930895172fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:30.238358 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aab086-3910-41e0-8d1f-930895172fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:30.238640 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aab086-3910-41e0-8d1f-930895172fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:30.238913 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aab086-3910-41e0-8d1f-930895172fe6 admin admin] PATH_INFO: `/v3/projects/34499f5a2c02434b979288e28f14fe69` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:30.240107 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aab086-3910-41e0-8d1f-930895172fe6 admin admin] RBAC: Authorizing `identity:get_project(project_id=34499f5a2c02434b979288e28f14fe69)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:30.242195 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aab086-3910-41e0-8d1f-930895172fe6 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:30.244397 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 113/220] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:30 2021] GET /identity/v3/projects/34499f5a2c02434b979288e28f14fe69 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:30.250974 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6e4f9-3cf6-4f2f-9c6f-ef2f3863fab8 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:30.261035 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6e4f9-3cf6-4f2f-9c6f-ef2f3863fab8 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:30.269935 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd27a91-7f48-44c3-97a2-271820c9c4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:30.270722 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd27a91-7f48-44c3-97a2-271820c9c4a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:30.271010 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd27a91-7f48-44c3-97a2-271820c9c4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:30.271293 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd27a91-7f48-44c3-97a2-271820c9c4a1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:30.272183 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd27a91-7f48-44c3-97a2-271820c9c4a1 admin admin] RBAC: Adding query filter params (role.id=540999ece4154e6ba219007ddda3f8f9, scope.project.id=34499f5a2c02434b979288e28f14fe69, user.id=f4e70afd8b1544f39207d23608348872) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:30.272500 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd27a91-7f48-44c3-97a2-271820c9c4a1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:30.274451 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd27a91-7f48-44c3-97a2-271820c9c4a1 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:30.281787 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 108/221] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:20:30 2021] GET /identity/v3/role_assignments?user.id=f4e70afd8b1544f39207d23608348872&scope.project.id=34499f5a2c02434b979288e28f14fe69&role.id=540999ece4154e6ba219007ddda3f8f9 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:30.431847 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50b34c-cdc5-44d5-b712-72d28bb8fad9 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:30.432142 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50b34c-cdc5-44d5-b712-72d28bb8fad9 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:30.432312 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50b34c-cdc5-44d5-b712-72d28bb8fad9 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:30.434387 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 114/222] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:30.440816 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20943a1-3d9e-4c1d-bfa2-18961dc1bde0 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:30.441110 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20943a1-3d9e-4c1d-bfa2-18961dc1bde0 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:30.441391 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20943a1-3d9e-4c1d-bfa2-18961dc1bde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:30.462655 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-d20943a1-3d9e-4c1d-bfa2-18961dc1bde0 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:30.463882 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-d20943a1-3d9e-4c1d-bfa2-18961dc1bde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:30.471718 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 109/223] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:30.503209 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50b34c-cdc5-44d5-b712-72d28bb8fad9 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:30.516496 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50b34c-cdc5-44d5-b712-72d28bb8fad9 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:30.524176 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f416a10-8a95-4428-980a-b708c8de77e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:30.525021 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f416a10-8a95-4428-980a-b708c8de77e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:30.525311 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f416a10-8a95-4428-980a-b708c8de77e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:30.525621 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f416a10-8a95-4428-980a-b708c8de77e3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:30.542309 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f416a10-8a95-4428-980a-b708c8de77e3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:30.553678 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-2f416a10-8a95-4428-980a-b708c8de77e3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:20:30.555056 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 115/224] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:20:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:30.563001 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20943a1-3d9e-4c1d-bfa2-18961dc1bde0 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:30.578980 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20943a1-3d9e-4c1d-bfa2-18961dc1bde0 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:30.587236 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73321ac2-f512-4187-9dbc-315624d19703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:30.588003 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73321ac2-f512-4187-9dbc-315624d19703 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:30.588300 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73321ac2-f512-4187-9dbc-315624d19703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:30.588586 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73321ac2-f512-4187-9dbc-315624d19703 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:30.589385 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73321ac2-f512-4187-9dbc-315624d19703 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:30.589758 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73321ac2-f512-4187-9dbc-315624d19703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:30.591449 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73321ac2-f512-4187-9dbc-315624d19703 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:30.606840 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 110/225] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:30.613237 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f416a10-8a95-4428-980a-b708c8de77e3 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:30.628602 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f416a10-8a95-4428-980a-b708c8de77e3 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:30.633080 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f926c6-be29-4fb4-8c18-20ad330d8e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:30.634008 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f926c6-be29-4fb4-8c18-20ad330d8e92 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:30.634289 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f926c6-be29-4fb4-8c18-20ad330d8e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:30.634602 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f926c6-be29-4fb4-8c18-20ad330d8e92 admin admin] PATH_INFO: `/v3/users/d48900f443894ac798508f952478760c` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:30.635873 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f926c6-be29-4fb4-8c18-20ad330d8e92 admin admin] RBAC: Authorizing `identity:get_user(user_id=d48900f443894ac798508f952478760c)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:30.637725 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f926c6-be29-4fb4-8c18-20ad330d8e92 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:30.639374 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 116/226] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:20:30 2021] GET /identity/v3/users/d48900f443894ac798508f952478760c => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:30.647393 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73321ac2-f512-4187-9dbc-315624d19703 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:30.663265 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73321ac2-f512-4187-9dbc-315624d19703 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:30.670659 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559647fe-0478-4af7-815f-d9afad18c5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:30.671314 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559647fe-0478-4af7-815f-d9afad18c5df admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:30.671598 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559647fe-0478-4af7-815f-d9afad18c5df admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:30.671879 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559647fe-0478-4af7-815f-d9afad18c5df admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:30.687018 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559647fe-0478-4af7-815f-d9afad18c5df admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:30.688736 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559647fe-0478-4af7-815f-d9afad18c5df admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:30.704007 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 111/227] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:30.711865 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f926c6-be29-4fb4-8c18-20ad330d8e92 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:30.723158 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f926c6-be29-4fb4-8c18-20ad330d8e92 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:30.728061 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef449691-d99a-4466-9d43-84f187ec4049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:30.729442 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef449691-d99a-4466-9d43-84f187ec4049 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:30.731483 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef449691-d99a-4466-9d43-84f187ec4049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:30.731804 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef449691-d99a-4466-9d43-84f187ec4049 admin admin] PATH_INFO: `/v3/projects/34499f5a2c02434b979288e28f14fe69` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:30.733014 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef449691-d99a-4466-9d43-84f187ec4049 admin admin] RBAC: Authorizing `identity:get_project(project_id=34499f5a2c02434b979288e28f14fe69)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:30.735090 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef449691-d99a-4466-9d43-84f187ec4049 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:30.736821 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 117/228] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:30 2021] GET /identity/v3/projects/34499f5a2c02434b979288e28f14fe69 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:30.743444 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559647fe-0478-4af7-815f-d9afad18c5df admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:30.758748 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559647fe-0478-4af7-815f-d9afad18c5df admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:30.764058 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab35781-ad0c-4074-9931-1ba941264da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:30.764713 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab35781-ad0c-4074-9931-1ba941264da3 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:30.765002 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab35781-ad0c-4074-9931-1ba941264da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:30.765283 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab35781-ad0c-4074-9931-1ba941264da3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:30.766175 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab35781-ad0c-4074-9931-1ba941264da3 admin admin] RBAC: Adding query filter params (role.id=df3a437e6ea14518a9c1b9a348e18c99, scope.project.id=34499f5a2c02434b979288e28f14fe69, user.id=d48900f443894ac798508f952478760c) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:30.766490 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab35781-ad0c-4074-9931-1ba941264da3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:30.768410 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab35781-ad0c-4074-9931-1ba941264da3 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:30.778071 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 112/229] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:20:30 2021] GET /identity/v3/role_assignments?user.id=d48900f443894ac798508f952478760c&scope.project.id=34499f5a2c02434b979288e28f14fe69&role.id=df3a437e6ea14518a9c1b9a348e18c99 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:31.684251 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dba6a-6fee-4406-b7d0-8d59206ec85a None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:31.685182 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dba6a-6fee-4406-b7d0-8d59206ec85a None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:31.685779 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dba6a-6fee-4406-b7d0-8d59206ec85a None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:31.688031 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 118/230] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:31 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:31.694495 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3bfa1-08bf-4ae7-875b-2cf8326fa92a None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:31.695389 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3bfa1-08bf-4ae7-875b-2cf8326fa92a None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:31.695888 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3bfa1-08bf-4ae7-875b-2cf8326fa92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:31.718003 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-dfd3bfa1-08bf-4ae7-875b-2cf8326fa92a None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:31.719516 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-dfd3bfa1-08bf-4ae7-875b-2cf8326fa92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:31.727857 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 113/231] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:31.760790 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dba6a-6fee-4406-b7d0-8d59206ec85a None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:31.773769 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dba6a-6fee-4406-b7d0-8d59206ec85a None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:31.779169 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419282d6-fe1f-49d1-a6b6-2df5459aabd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:31.780196 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419282d6-fe1f-49d1-a6b6-2df5459aabd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:31.780675 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419282d6-fe1f-49d1-a6b6-2df5459aabd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:31.781147 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419282d6-fe1f-49d1-a6b6-2df5459aabd2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:31.792856 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419282d6-fe1f-49d1-a6b6-2df5459aabd2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:31.801561 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-419282d6-fe1f-49d1-a6b6-2df5459aabd2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:20:31.803308 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 119/232] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:31 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:31.810177 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3bfa1-08bf-4ae7-875b-2cf8326fa92a None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:31.816324 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dccd79-755d-42f8-a46f-2f6bb48d9629 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:31.816473 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dccd79-755d-42f8-a46f-2f6bb48d9629 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:31.816762 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dccd79-755d-42f8-a46f-2f6bb48d9629 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:31.818613 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 120/233] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:31.820455 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3bfa1-08bf-4ae7-875b-2cf8326fa92a None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:31.825429 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e388bf7-c61c-4a6c-9dc0-6e120b906ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:31.826381 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e388bf7-c61c-4a6c-9dc0-6e120b906ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:31.826866 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e388bf7-c61c-4a6c-9dc0-6e120b906ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:31.827342 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e388bf7-c61c-4a6c-9dc0-6e120b906ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:31.828297 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e388bf7-c61c-4a6c-9dc0-6e120b906ad1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:31.829000 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e388bf7-c61c-4a6c-9dc0-6e120b906ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:31.830835 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e388bf7-c61c-4a6c-9dc0-6e120b906ad1 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:31.840252 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5f000-5611-4ced-ac33-0fb3e21d7a5b None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:31.840252 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5f000-5611-4ced-ac33-0fb3e21d7a5b None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:31.840464 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5f000-5611-4ced-ac33-0fb3e21d7a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:31.844039 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 114/234] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Oct 27 01:20:31 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:31.850196 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e388bf7-c61c-4a6c-9dc0-6e120b906ad1 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:31.862501 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e388bf7-c61c-4a6c-9dc0-6e120b906ad1 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:31.867674 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c9757-28db-4903-9b09-f853750b5478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:31.868563 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c9757-28db-4903-9b09-f853750b5478 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:31.869081 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c9757-28db-4903-9b09-f853750b5478 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:31.869658 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c9757-28db-4903-9b09-f853750b5478 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:31.875788 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-b6e5f000-5611-4ced-ac33-0fb3e21d7a5b None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:31.877038 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-b6e5f000-5611-4ced-ac33-0fb3e21d7a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:31.879016 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c9757-28db-4903-9b09-f853750b5478 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:31.880970 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c9757-28db-4903-9b09-f853750b5478 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:31.891706 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 115/235] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:31 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:20:31.892187 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 121/236] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:31.898029 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c9757-28db-4903-9b09-f853750b5478 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:31.907920 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c9757-28db-4903-9b09-f853750b5478 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:31.912730 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388975b1-32ff-4a1c-a5a4-f58c9c763b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:31.913959 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388975b1-32ff-4a1c-a5a4-f58c9c763b38 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:31.914443 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388975b1-32ff-4a1c-a5a4-f58c9c763b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:31.914912 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388975b1-32ff-4a1c-a5a4-f58c9c763b38 admin admin] PATH_INFO: `/v3/projects/f405caf5e07a413190b7459d3015b944` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:31.916916 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388975b1-32ff-4a1c-a5a4-f58c9c763b38 admin admin] RBAC: Authorizing `identity:get_project(project_id=f405caf5e07a413190b7459d3015b944)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:31.920513 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388975b1-32ff-4a1c-a5a4-f58c9c763b38 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:31.922900 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 116/237] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:31 2021] GET /identity/v3/projects/f405caf5e07a413190b7459d3015b944 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:31.928723 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5f000-5611-4ced-ac33-0fb3e21d7a5b None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:31.944128 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5f000-5611-4ced-ac33-0fb3e21d7a5b None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:31.945985 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388975b1-32ff-4a1c-a5a4-f58c9c763b38 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:31.954372 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87df34f-dfc1-4a41-85d0-127852ab3cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:31.955268 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87df34f-dfc1-4a41-85d0-127852ab3cde admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:31.955650 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87df34f-dfc1-4a41-85d0-127852ab3cde admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:31.955850 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87df34f-dfc1-4a41-85d0-127852ab3cde admin admin] PATH_INFO: `/v3/groups/ee1ac9b1f6e640adadc19b162333a926` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:31.958331 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388975b1-32ff-4a1c-a5a4-f58c9c763b38 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:31.968018 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de849c-cc22-4a03-9895-885e777f736c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:31.969266 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de849c-cc22-4a03-9895-885e777f736c admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:31.969771 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de849c-cc22-4a03-9895-885e777f736c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:31.970629 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de849c-cc22-4a03-9895-885e777f736c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:31.982255 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87df34f-dfc1-4a41-85d0-127852ab3cde admin admin] RBAC: Authorizing `identity:get_group(group_id=ee1ac9b1f6e640adadc19b162333a926)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:31.983373 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING py.warnings [None req-c87df34f-dfc1-4a41-85d0-127852ab3cde admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:31.983373 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: warnings.warn(msg) Oct 27 01:20:31.983373 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: Oct 27 01:20:31.984249 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de849c-cc22-4a03-9895-885e777f736c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:31.984668 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87df34f-dfc1-4a41-85d0-127852ab3cde admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:31.986951 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 122/238] 10.222.0.25 () {56 vars in 1201 bytes} [Wed Oct 27 01:20:31 2021] GET /identity/v3/groups/ee1ac9b1f6e640adadc19b162333a926 => generated 226 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:31.992343 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-22de849c-cc22-4a03-9895-885e777f736c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:20:31.993138 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87df34f-dfc1-4a41-85d0-127852ab3cde admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:31.994372 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 117/239] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Oct 27 01:20:31 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:20:32.003082 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de849c-cc22-4a03-9895-885e777f736c admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:32.012803 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87df34f-dfc1-4a41-85d0-127852ab3cde admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:32.019564 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de849c-cc22-4a03-9895-885e777f736c admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:32.024631 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd8a07-87bb-4a04-a827-48e2b056e4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:32.025380 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd8a07-87bb-4a04-a827-48e2b056e4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:32.025695 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd8a07-87bb-4a04-a827-48e2b056e4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:32.026023 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd8a07-87bb-4a04-a827-48e2b056e4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:32.027044 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd8a07-87bb-4a04-a827-48e2b056e4f5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:32.027361 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd8a07-87bb-4a04-a827-48e2b056e4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:32.029305 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb7ea7-7a62-41c8-bfbc-882aa08f6792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:32.030085 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb7ea7-7a62-41c8-bfbc-882aa08f6792 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:32.030435 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb7ea7-7a62-41c8-bfbc-882aa08f6792 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:32.030828 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb7ea7-7a62-41c8-bfbc-882aa08f6792 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:32.031685 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb7ea7-7a62-41c8-bfbc-882aa08f6792 admin admin] RBAC: Adding query filter params (group.id=ee1ac9b1f6e640adadc19b162333a926, role.id=540999ece4154e6ba219007ddda3f8f9, scope.project.id=f405caf5e07a413190b7459d3015b944) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:32.031997 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb7ea7-7a62-41c8-bfbc-882aa08f6792 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:32.033676 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd8a07-87bb-4a04-a827-48e2b056e4f5 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:32.033865 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb7ea7-7a62-41c8-bfbc-882aa08f6792 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:32.048909 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 118/240] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:32 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:32.050278 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 123/241] 10.222.0.25 () {56 vars in 1397 bytes} [Wed Oct 27 01:20:31 2021] GET /identity/v3/role_assignments?group.id=ee1ac9b1f6e640adadc19b162333a926&scope.project.id=f405caf5e07a413190b7459d3015b944&role.id=540999ece4154e6ba219007ddda3f8f9 => generated 260 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:32.055265 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd8a07-87bb-4a04-a827-48e2b056e4f5 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:32.065924 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd8a07-87bb-4a04-a827-48e2b056e4f5 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:32.074762 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92f5f4-f4dc-4de2-aa2b-0ec1401b5d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:32.075665 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92f5f4-f4dc-4de2-aa2b-0ec1401b5d3f admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:32.075955 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92f5f4-f4dc-4de2-aa2b-0ec1401b5d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:32.076232 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92f5f4-f4dc-4de2-aa2b-0ec1401b5d3f admin admin] PATH_INFO: `/v3/users/f4e70afd8b1544f39207d23608348872` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:32.077521 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92f5f4-f4dc-4de2-aa2b-0ec1401b5d3f admin admin] RBAC: Authorizing `identity:get_user(user_id=f4e70afd8b1544f39207d23608348872)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:32.079680 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92f5f4-f4dc-4de2-aa2b-0ec1401b5d3f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:32.081384 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 119/242] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:20:32 2021] GET /identity/v3/users/f4e70afd8b1544f39207d23608348872 => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:32.088361 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb7ea7-7a62-41c8-bfbc-882aa08f6792 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:32.107158 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb7ea7-7a62-41c8-bfbc-882aa08f6792 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:32.122242 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27f122-03b3-4efa-9fe7-21353430affc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:32.122926 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27f122-03b3-4efa-9fe7-21353430affc admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:32.123213 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27f122-03b3-4efa-9fe7-21353430affc admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:32.123494 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27f122-03b3-4efa-9fe7-21353430affc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:32.138211 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f27f122-03b3-4efa-9fe7-21353430affc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:32.140074 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f27f122-03b3-4efa-9fe7-21353430affc admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:32.155972 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 124/243] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:32 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:32.161968 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92f5f4-f4dc-4de2-aa2b-0ec1401b5d3f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:32.175555 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92f5f4-f4dc-4de2-aa2b-0ec1401b5d3f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:32.188792 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538d606-c9fb-4813-afbf-37e78e778ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:32.189713 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538d606-c9fb-4813-afbf-37e78e778ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:32.189999 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538d606-c9fb-4813-afbf-37e78e778ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:32.190273 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538d606-c9fb-4813-afbf-37e78e778ee8 admin admin] PATH_INFO: `/v3/projects/34499f5a2c02434b979288e28f14fe69` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:32.191492 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538d606-c9fb-4813-afbf-37e78e778ee8 admin admin] RBAC: Authorizing `identity:get_project(project_id=34499f5a2c02434b979288e28f14fe69)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:32.193583 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538d606-c9fb-4813-afbf-37e78e778ee8 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:32.195385 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 120/244] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:32 2021] GET /identity/v3/projects/34499f5a2c02434b979288e28f14fe69 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:32.201998 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27f122-03b3-4efa-9fe7-21353430affc admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:32.214631 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27f122-03b3-4efa-9fe7-21353430affc admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:32.221676 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf9ed3-88d1-4b2b-bfd1-f96dea6e2b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:32.222353 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf9ed3-88d1-4b2b-bfd1-f96dea6e2b40 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:32.222642 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf9ed3-88d1-4b2b-bfd1-f96dea6e2b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:32.222922 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf9ed3-88d1-4b2b-bfd1-f96dea6e2b40 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:32.223780 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf9ed3-88d1-4b2b-bfd1-f96dea6e2b40 admin admin] RBAC: Adding query filter params (role.id=22382371cf4846fe84d1403e3ab1785e, scope.project.id=34499f5a2c02434b979288e28f14fe69, user.id=f4e70afd8b1544f39207d23608348872) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:32.224095 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf9ed3-88d1-4b2b-bfd1-f96dea6e2b40 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:32.230135 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf9ed3-88d1-4b2b-bfd1-f96dea6e2b40 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:32.237160 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 125/245] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:20:32 2021] GET /identity/v3/role_assignments?user.id=f4e70afd8b1544f39207d23608348872&scope.project.id=34499f5a2c02434b979288e28f14fe69&role.id=22382371cf4846fe84d1403e3ab1785e => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:32.602500 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5eaa3-d045-421e-aa94-c38d8270c5df None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:32.602823 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5eaa3-d045-421e-aa94-c38d8270c5df None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:32.602990 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5eaa3-d045-421e-aa94-c38d8270c5df None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:32.605330 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 121/246] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:32.611849 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efe6e9-cf79-483e-a48f-360e49cf0027 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:32.612180 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efe6e9-cf79-483e-a48f-360e49cf0027 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:32.612475 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efe6e9-cf79-483e-a48f-360e49cf0027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:32.646622 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-d4efe6e9-cf79-483e-a48f-360e49cf0027 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:32.647887 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-d4efe6e9-cf79-483e-a48f-360e49cf0027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:32.656729 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 126/247] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:32.701773 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5eaa3-d045-421e-aa94-c38d8270c5df None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:32.719465 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5eaa3-d045-421e-aa94-c38d8270c5df None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:32.723974 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21d9c5-f293-4e67-acc4-29693dddc9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:32.724941 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21d9c5-f293-4e67-acc4-29693dddc9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:32.725233 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21d9c5-f293-4e67-acc4-29693dddc9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:32.725535 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21d9c5-f293-4e67-acc4-29693dddc9f6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:32.745625 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21d9c5-f293-4e67-acc4-29693dddc9f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:32.753268 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-ee21d9c5-f293-4e67-acc4-29693dddc9f6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:20:32.754507 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 122/248] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Oct 27 01:20:32 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:32.760982 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efe6e9-cf79-483e-a48f-360e49cf0027 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:32.774399 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efe6e9-cf79-483e-a48f-360e49cf0027 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:32.784836 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022fa53-3cae-4bb6-87e6-02407083fa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:32.785536 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022fa53-3cae-4bb6-87e6-02407083fa69 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:32.785827 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022fa53-3cae-4bb6-87e6-02407083fa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:32.786105 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022fa53-3cae-4bb6-87e6-02407083fa69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:32.786877 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022fa53-3cae-4bb6-87e6-02407083fa69 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:32.787193 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022fa53-3cae-4bb6-87e6-02407083fa69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:32.788788 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022fa53-3cae-4bb6-87e6-02407083fa69 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:32.800860 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 127/249] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:32 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:32.810458 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21d9c5-f293-4e67-acc4-29693dddc9f6 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:32.824901 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21d9c5-f293-4e67-acc4-29693dddc9f6 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:32.829310 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae8066-00a4-4dc3-8241-00a15b3615a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:32.830182 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae8066-00a4-4dc3-8241-00a15b3615a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:32.830466 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae8066-00a4-4dc3-8241-00a15b3615a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:32.830749 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae8066-00a4-4dc3-8241-00a15b3615a3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:32.845765 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae8066-00a4-4dc3-8241-00a15b3615a3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:32.847517 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae8066-00a4-4dc3-8241-00a15b3615a3 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:32.863516 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 123/250] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:32 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:32.869383 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022fa53-3cae-4bb6-87e6-02407083fa69 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:32.890656 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022fa53-3cae-4bb6-87e6-02407083fa69 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:32.900923 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa68216-515d-4499-834f-335498c63e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:32.901818 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa68216-515d-4499-834f-335498c63e88 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:32.902101 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa68216-515d-4499-834f-335498c63e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:32.902384 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa68216-515d-4499-834f-335498c63e88 admin admin] PATH_INFO: `/v3/projects/f405caf5e07a413190b7459d3015b944` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:32.906254 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa68216-515d-4499-834f-335498c63e88 admin admin] RBAC: Authorizing `identity:get_project(project_id=f405caf5e07a413190b7459d3015b944)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:32.908388 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa68216-515d-4499-834f-335498c63e88 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:32.910290 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 128/251] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:32 2021] GET /identity/v3/projects/f405caf5e07a413190b7459d3015b944 => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:32.916857 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae8066-00a4-4dc3-8241-00a15b3615a3 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:32.927267 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae8066-00a4-4dc3-8241-00a15b3615a3 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:32.932569 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c1b43-cef5-4d8f-8b59-93ca10b1d5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:32.933892 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c1b43-cef5-4d8f-8b59-93ca10b1d5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:32.934275 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c1b43-cef5-4d8f-8b59-93ca10b1d5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:32.934668 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c1b43-cef5-4d8f-8b59-93ca10b1d5a2 admin admin] PATH_INFO: `/v3/groups/ee1ac9b1f6e640adadc19b162333a926` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:32.936026 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c1b43-cef5-4d8f-8b59-93ca10b1d5a2 admin admin] RBAC: Authorizing `identity:get_group(group_id=ee1ac9b1f6e640adadc19b162333a926)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:32.937128 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING py.warnings [None req-278c1b43-cef5-4d8f-8b59-93ca10b1d5a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:32.937128 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: warnings.warn(msg) Oct 27 01:20:32.937128 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: Oct 27 01:20:32.938583 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c1b43-cef5-4d8f-8b59-93ca10b1d5a2 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:32.940621 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 124/252] 10.222.0.25 () {56 vars in 1201 bytes} [Wed Oct 27 01:20:32 2021] GET /identity/v3/groups/ee1ac9b1f6e640adadc19b162333a926 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:32.946737 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa68216-515d-4499-834f-335498c63e88 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:32.962788 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa68216-515d-4499-834f-335498c63e88 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:32.974139 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26667c4f-b013-4803-877f-7bd9d1b5449b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:32.974823 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26667c4f-b013-4803-877f-7bd9d1b5449b admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:32.975112 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26667c4f-b013-4803-877f-7bd9d1b5449b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:32.975395 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26667c4f-b013-4803-877f-7bd9d1b5449b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:32.976258 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26667c4f-b013-4803-877f-7bd9d1b5449b admin admin] RBAC: Adding query filter params (group.id=ee1ac9b1f6e640adadc19b162333a926, role.id=22382371cf4846fe84d1403e3ab1785e, scope.project.id=f405caf5e07a413190b7459d3015b944) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:32.976581 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26667c4f-b013-4803-877f-7bd9d1b5449b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:32.979087 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26667c4f-b013-4803-877f-7bd9d1b5449b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:32.990399 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 129/253] 10.222.0.25 () {56 vars in 1397 bytes} [Wed Oct 27 01:20:32 2021] GET /identity/v3/role_assignments?group.id=ee1ac9b1f6e640adadc19b162333a926&scope.project.id=f405caf5e07a413190b7459d3015b944&role.id=22382371cf4846fe84d1403e3ab1785e => generated 260 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:33.291869 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad8578-a90f-425f-8a3f-e735a144c6d0 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:33.292260 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad8578-a90f-425f-8a3f-e735a144c6d0 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:33.292460 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad8578-a90f-425f-8a3f-e735a144c6d0 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:33.294496 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 125/254] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:33.301796 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89fe43-503e-4de1-bb78-2e6b6b6fe99e None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:33.302337 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89fe43-503e-4de1-bb78-2e6b6b6fe99e None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:33.302844 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89fe43-503e-4de1-bb78-2e6b6b6fe99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:33.330504 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-ef89fe43-503e-4de1-bb78-2e6b6b6fe99e None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:33.332046 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-ef89fe43-503e-4de1-bb78-2e6b6b6fe99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:33.340146 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 130/255] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:33.376257 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad8578-a90f-425f-8a3f-e735a144c6d0 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:33.391446 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad8578-a90f-425f-8a3f-e735a144c6d0 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:33.395894 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bacfd-f760-4057-88ca-2f3eb0a71826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:33.396696 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bacfd-f760-4057-88ca-2f3eb0a71826 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:33.396978 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bacfd-f760-4057-88ca-2f3eb0a71826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:33.397256 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bacfd-f760-4057-88ca-2f3eb0a71826 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:33.412537 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4bacfd-f760-4057-88ca-2f3eb0a71826 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:33.419654 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-ac4bacfd-f760-4057-88ca-2f3eb0a71826 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:20:33.420851 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 126/256] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:33 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:33.427745 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89fe43-503e-4de1-bb78-2e6b6b6fe99e None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:33.442513 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89fe43-503e-4de1-bb78-2e6b6b6fe99e None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:33.451133 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6de42-2657-4c63-84ed-1af4c4115597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:33.452059 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6de42-2657-4c63-84ed-1af4c4115597 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:33.452549 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6de42-2657-4c63-84ed-1af4c4115597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:33.453050 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6de42-2657-4c63-84ed-1af4c4115597 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:33.454045 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6de42-2657-4c63-84ed-1af4c4115597 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:33.454557 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6de42-2657-4c63-84ed-1af4c4115597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:33.456335 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6de42-2657-4c63-84ed-1af4c4115597 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:33.473580 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 131/257] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Oct 27 01:20:33 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:33.479858 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bacfd-f760-4057-88ca-2f3eb0a71826 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:33.495064 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bacfd-f760-4057-88ca-2f3eb0a71826 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:33.505696 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc27a39-1a7f-4fcb-acb6-17ac78ad7af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:33.506356 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc27a39-1a7f-4fcb-acb6-17ac78ad7af2 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:33.506644 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc27a39-1a7f-4fcb-acb6-17ac78ad7af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:33.506933 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc27a39-1a7f-4fcb-acb6-17ac78ad7af2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:33.521690 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc27a39-1a7f-4fcb-acb6-17ac78ad7af2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:33.523452 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc27a39-1a7f-4fcb-acb6-17ac78ad7af2 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:33.538986 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 127/258] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:33 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:33.546017 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6de42-2657-4c63-84ed-1af4c4115597 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:33.558912 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6de42-2657-4c63-84ed-1af4c4115597 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:33.574120 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63762ead-7c61-4225-9ea1-fbdeeb9ecec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:33.575314 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63762ead-7c61-4225-9ea1-fbdeeb9ecec5 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:33.575815 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63762ead-7c61-4225-9ea1-fbdeeb9ecec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:33.576330 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63762ead-7c61-4225-9ea1-fbdeeb9ecec5 admin admin] PATH_INFO: `/v3/projects/34499f5a2c02434b979288e28f14fe69` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:33.577862 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63762ead-7c61-4225-9ea1-fbdeeb9ecec5 admin admin] RBAC: Authorizing `identity:get_project(project_id=34499f5a2c02434b979288e28f14fe69)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:33.580213 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63762ead-7c61-4225-9ea1-fbdeeb9ecec5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:33.582241 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 132/259] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:33 2021] GET /identity/v3/projects/34499f5a2c02434b979288e28f14fe69 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:33.588986 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc27a39-1a7f-4fcb-acb6-17ac78ad7af2 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:33.600890 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc27a39-1a7f-4fcb-acb6-17ac78ad7af2 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:33.606772 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf27ea-0208-416b-8832-de1bf942e6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:33.607625 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf27ea-0208-416b-8832-de1bf942e6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:33.607913 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf27ea-0208-416b-8832-de1bf942e6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:33.608197 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf27ea-0208-416b-8832-de1bf942e6e6 admin admin] PATH_INFO: `/v3/groups/ee1ac9b1f6e640adadc19b162333a926` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:33.614229 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf27ea-0208-416b-8832-de1bf942e6e6 admin admin] RBAC: Authorizing `identity:get_group(group_id=ee1ac9b1f6e640adadc19b162333a926)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:33.616138 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf27ea-0208-416b-8832-de1bf942e6e6 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:33.618039 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 128/260] 10.222.0.25 () {56 vars in 1201 bytes} [Wed Oct 27 01:20:33 2021] GET /identity/v3/groups/ee1ac9b1f6e640adadc19b162333a926 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:33.624964 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63762ead-7c61-4225-9ea1-fbdeeb9ecec5 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:33.639103 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63762ead-7c61-4225-9ea1-fbdeeb9ecec5 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:33.649653 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3682a84-4375-4640-bbda-f0a34f01e89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:33.651148 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3682a84-4375-4640-bbda-f0a34f01e89e admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:33.651652 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3682a84-4375-4640-bbda-f0a34f01e89e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:33.652143 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3682a84-4375-4640-bbda-f0a34f01e89e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:33.653472 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3682a84-4375-4640-bbda-f0a34f01e89e admin admin] RBAC: Adding query filter params (group.id=ee1ac9b1f6e640adadc19b162333a926, role.id=540999ece4154e6ba219007ddda3f8f9, scope.project.id=34499f5a2c02434b979288e28f14fe69) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:33.654073 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3682a84-4375-4640-bbda-f0a34f01e89e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:33.656551 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3682a84-4375-4640-bbda-f0a34f01e89e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:33.666106 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 133/261] 10.222.0.25 () {56 vars in 1397 bytes} [Wed Oct 27 01:20:33 2021] GET /identity/v3/role_assignments?group.id=ee1ac9b1f6e640adadc19b162333a926&scope.project.id=34499f5a2c02434b979288e28f14fe69&role.id=540999ece4154e6ba219007ddda3f8f9 => generated 260 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:34.232659 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72f130-ba1a-4ffd-a63f-8161879233e1 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.233267 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72f130-ba1a-4ffd-a63f-8161879233e1 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.233267 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72f130-ba1a-4ffd-a63f-8161879233e1 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.234932 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 129/262] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:34.251825 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a6e64-ab2b-4bf5-9a4b-bfef19506e3a None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.252756 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a6e64-ab2b-4bf5-9a4b-bfef19506e3a None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.253258 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a6e64-ab2b-4bf5-9a4b-bfef19506e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.278491 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-fe4a6e64-ab2b-4bf5-9a4b-bfef19506e3a None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:34.280042 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-fe4a6e64-ab2b-4bf5-9a4b-bfef19506e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:34.292560 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 134/263] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:34.334455 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72f130-ba1a-4ffd-a63f-8161879233e1 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:34.355107 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72f130-ba1a-4ffd-a63f-8161879233e1 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:34.359797 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710934a-bcdd-4590-9cd4-34dd5dfdf1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:34.360840 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710934a-bcdd-4590-9cd4-34dd5dfdf1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.361356 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710934a-bcdd-4590-9cd4-34dd5dfdf1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.361866 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710934a-bcdd-4590-9cd4-34dd5dfdf1e7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.376538 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb84411-ecd9-4267-a8bf-3139a90fa4bd None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.377145 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb84411-ecd9-4267-a8bf-3139a90fa4bd None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.377658 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb84411-ecd9-4267-a8bf-3139a90fa4bd None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.379659 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 135/264] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:34.385450 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392944a-a34c-4f70-ba99-abe17afede5e None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.386056 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392944a-a34c-4f70-ba99-abe17afede5e None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.386565 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392944a-a34c-4f70-ba99-abe17afede5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.394166 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710934a-bcdd-4590-9cd4-34dd5dfdf1e7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:34.408737 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-2710934a-bcdd-4590-9cd4-34dd5dfdf1e7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:20:34.410661 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 130/265] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Oct 27 01:20:34 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:34.414888 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-0392944a-a34c-4f70-ba99-abe17afede5e None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:34.416921 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-0392944a-a34c-4f70-ba99-abe17afede5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:34.417963 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710934a-bcdd-4590-9cd4-34dd5dfdf1e7 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:34.431311 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710934a-bcdd-4590-9cd4-34dd5dfdf1e7 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:34.435184 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 136/266] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:34.439992 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be6606-c3ed-4f54-9d38-41b5ccf4acae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:34.440880 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be6606-c3ed-4f54-9d38-41b5ccf4acae admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.441385 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be6606-c3ed-4f54-9d38-41b5ccf4acae admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.441891 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be6606-c3ed-4f54-9d38-41b5ccf4acae admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.442866 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be6606-c3ed-4f54-9d38-41b5ccf4acae admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:34.443371 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be6606-c3ed-4f54-9d38-41b5ccf4acae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:34.445204 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be6606-c3ed-4f54-9d38-41b5ccf4acae admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:34.457503 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 131/267] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:34 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:34.466333 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392944a-a34c-4f70-ba99-abe17afede5e None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:34.466492 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be6606-c3ed-4f54-9d38-41b5ccf4acae admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:34.478527 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be6606-c3ed-4f54-9d38-41b5ccf4acae admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:34.480937 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392944a-a34c-4f70-ba99-abe17afede5e None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:34.486785 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eeb3a2-4eb3-46e7-a55b-29eb58ae775c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:34.487880 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eeb3a2-4eb3-46e7-a55b-29eb58ae775c admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.488176 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eeb3a2-4eb3-46e7-a55b-29eb58ae775c admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.488458 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eeb3a2-4eb3-46e7-a55b-29eb58ae775c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.491457 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c4451-56b7-4085-992f-44fe60350640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:34.492610 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c4451-56b7-4085-992f-44fe60350640 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.492898 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c4451-56b7-4085-992f-44fe60350640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.496071 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c4451-56b7-4085-992f-44fe60350640 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.505105 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eeb3a2-4eb3-46e7-a55b-29eb58ae775c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:34.507963 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eeb3a2-4eb3-46e7-a55b-29eb58ae775c admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:34.517325 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c4451-56b7-4085-992f-44fe60350640 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:34.526958 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-641c4451-56b7-4085-992f-44fe60350640 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:20:34.528395 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 132/268] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:20:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:20:34.534479 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c4451-56b7-4085-992f-44fe60350640 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:34.536759 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 137/269] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:34 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:34.543145 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eeb3a2-4eb3-46e7-a55b-29eb58ae775c admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:34.544968 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c4451-56b7-4085-992f-44fe60350640 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:34.555497 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd01aa3-97c1-464b-bae1-e3f8da1ca694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:34.556219 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd01aa3-97c1-464b-bae1-e3f8da1ca694 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.556399 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eeb3a2-4eb3-46e7-a55b-29eb58ae775c admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:34.556498 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd01aa3-97c1-464b-bae1-e3f8da1ca694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.556771 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd01aa3-97c1-464b-bae1-e3f8da1ca694 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.557578 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd01aa3-97c1-464b-bae1-e3f8da1ca694 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:34.557892 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd01aa3-97c1-464b-bae1-e3f8da1ca694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:34.559741 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd01aa3-97c1-464b-bae1-e3f8da1ca694 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:34.564362 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6650928-797d-4b93-a74e-33cc2c50154e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:34.565331 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6650928-797d-4b93-a74e-33cc2c50154e admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.565648 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6650928-797d-4b93-a74e-33cc2c50154e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.565931 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6650928-797d-4b93-a74e-33cc2c50154e admin admin] PATH_INFO: `/v3/projects/34499f5a2c02434b979288e28f14fe69` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.567256 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6650928-797d-4b93-a74e-33cc2c50154e admin admin] RBAC: Authorizing `identity:get_project(project_id=34499f5a2c02434b979288e28f14fe69)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:34.569245 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 133/270] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:34.569725 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6650928-797d-4b93-a74e-33cc2c50154e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:34.571478 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 138/271] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:34 2021] GET /identity/v3/projects/34499f5a2c02434b979288e28f14fe69 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:34.575879 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd01aa3-97c1-464b-bae1-e3f8da1ca694 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:34.578180 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6650928-797d-4b93-a74e-33cc2c50154e admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:34.587223 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd01aa3-97c1-464b-bae1-e3f8da1ca694 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:34.593259 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09b51a-36b1-470c-a834-ccbba717868a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:34.593943 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09b51a-36b1-470c-a834-ccbba717868a admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.594228 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09b51a-36b1-470c-a834-ccbba717868a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.594507 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09b51a-36b1-470c-a834-ccbba717868a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.594963 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6650928-797d-4b93-a74e-33cc2c50154e admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:34.602890 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09b51a-36b1-470c-a834-ccbba717868a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:34.604772 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09b51a-36b1-470c-a834-ccbba717868a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:34.611519 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ac53a-3cb7-4969-aeef-a0ba64f3390c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:34.612381 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ac53a-3cb7-4969-aeef-a0ba64f3390c admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.612661 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ac53a-3cb7-4969-aeef-a0ba64f3390c admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.612937 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ac53a-3cb7-4969-aeef-a0ba64f3390c admin admin] PATH_INFO: `/v3/groups/ee1ac9b1f6e640adadc19b162333a926` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.614057 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 134/272] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:34 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:34.618240 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ac53a-3cb7-4969-aeef-a0ba64f3390c admin admin] RBAC: Authorizing `identity:get_group(group_id=ee1ac9b1f6e640adadc19b162333a926)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:34.620141 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09b51a-36b1-470c-a834-ccbba717868a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:34.620341 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ac53a-3cb7-4969-aeef-a0ba64f3390c admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:34.622106 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 139/273] 10.222.0.25 () {56 vars in 1201 bytes} [Wed Oct 27 01:20:34 2021] GET /identity/v3/groups/ee1ac9b1f6e640adadc19b162333a926 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:34.628520 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ac53a-3cb7-4969-aeef-a0ba64f3390c admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:34.629001 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09b51a-36b1-470c-a834-ccbba717868a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:34.637412 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f28038-1304-463d-af78-eb8d06d3464f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:34.638429 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f28038-1304-463d-af78-eb8d06d3464f admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.638708 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f28038-1304-463d-af78-eb8d06d3464f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.638985 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f28038-1304-463d-af78-eb8d06d3464f admin admin] PATH_INFO: `/v3/projects/38379d318e5c49acaf4683887f433419` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.640240 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f28038-1304-463d-af78-eb8d06d3464f admin admin] RBAC: Authorizing `identity:get_project(project_id=38379d318e5c49acaf4683887f433419)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:34.642211 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f28038-1304-463d-af78-eb8d06d3464f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:34.644982 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 135/274] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:34 2021] GET /identity/v3/projects/38379d318e5c49acaf4683887f433419 => generated 344 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:34.650758 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ac53a-3cb7-4969-aeef-a0ba64f3390c admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:34.651000 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f28038-1304-463d-af78-eb8d06d3464f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:34.661229 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f28038-1304-463d-af78-eb8d06d3464f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:34.665998 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92636526-eb24-4128-9830-4fcf12d1fc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:34.666231 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69941f-7433-4a86-932d-5ee37eea8c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:34.666770 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69941f-7433-4a86-932d-5ee37eea8c42 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.666947 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92636526-eb24-4128-9830-4fcf12d1fc0b admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.667100 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69941f-7433-4a86-932d-5ee37eea8c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.667263 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92636526-eb24-4128-9830-4fcf12d1fc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.667417 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69941f-7433-4a86-932d-5ee37eea8c42 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.667560 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92636526-eb24-4128-9830-4fcf12d1fc0b admin admin] PATH_INFO: `/v3/groups/c61b6e05a91b45a8821c6b8fcc313832` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.668151 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69941f-7433-4a86-932d-5ee37eea8c42 admin admin] RBAC: Adding query filter params (group.id=ee1ac9b1f6e640adadc19b162333a926, role.id=22382371cf4846fe84d1403e3ab1785e, scope.project.id=34499f5a2c02434b979288e28f14fe69) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:34.668473 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69941f-7433-4a86-932d-5ee37eea8c42 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:34.670399 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69941f-7433-4a86-932d-5ee37eea8c42 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:34.675192 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92636526-eb24-4128-9830-4fcf12d1fc0b admin admin] RBAC: Authorizing `identity:get_group(group_id=c61b6e05a91b45a8821c6b8fcc313832)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:34.677242 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92636526-eb24-4128-9830-4fcf12d1fc0b admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:34.679815 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 136/275] 10.222.0.25 () {56 vars in 1201 bytes} [Wed Oct 27 01:20:34 2021] GET /identity/v3/groups/c61b6e05a91b45a8821c6b8fcc313832 => generated 229 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:34.684893 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 140/276] 10.222.0.25 () {56 vars in 1397 bytes} [Wed Oct 27 01:20:34 2021] GET /identity/v3/role_assignments?group.id=ee1ac9b1f6e640adadc19b162333a926&scope.project.id=34499f5a2c02434b979288e28f14fe69&role.id=22382371cf4846fe84d1403e3ab1785e => generated 260 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:34.687761 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92636526-eb24-4128-9830-4fcf12d1fc0b admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:34.699241 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92636526-eb24-4128-9830-4fcf12d1fc0b admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:34.704205 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22a247-7aa0-4fd7-8d1d-477cdefbbb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:34.704871 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22a247-7aa0-4fd7-8d1d-477cdefbbb09 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.705207 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22a247-7aa0-4fd7-8d1d-477cdefbbb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.705504 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22a247-7aa0-4fd7-8d1d-477cdefbbb09 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.706461 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22a247-7aa0-4fd7-8d1d-477cdefbbb09 admin admin] RBAC: Adding query filter params (group.id=c61b6e05a91b45a8821c6b8fcc313832, role.id=df3a437e6ea14518a9c1b9a348e18c99, scope.project.id=38379d318e5c49acaf4683887f433419) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:34.706777 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22a247-7aa0-4fd7-8d1d-477cdefbbb09 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:34.708876 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22a247-7aa0-4fd7-8d1d-477cdefbbb09 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:34.715597 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 137/277] 10.222.0.25 () {56 vars in 1397 bytes} [Wed Oct 27 01:20:34 2021] GET /identity/v3/role_assignments?group.id=c61b6e05a91b45a8821c6b8fcc313832&scope.project.id=38379d318e5c49acaf4683887f433419&role.id=df3a437e6ea14518a9c1b9a348e18c99 => generated 260 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:35.150502 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e58255-afca-4abf-9a8e-b85983258bf1 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:35.150866 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e58255-afca-4abf-9a8e-b85983258bf1 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:35.151039 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e58255-afca-4abf-9a8e-b85983258bf1 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:35.153104 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 141/278] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:35.160251 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68740061-9cc3-452b-80b3-e7677159bdd3 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:35.160541 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68740061-9cc3-452b-80b3-e7677159bdd3 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:35.160830 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68740061-9cc3-452b-80b3-e7677159bdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:35.185444 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-68740061-9cc3-452b-80b3-e7677159bdd3 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:35.186747 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-68740061-9cc3-452b-80b3-e7677159bdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:35.195039 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 138/279] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:35.234147 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e58255-afca-4abf-9a8e-b85983258bf1 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:35.247096 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e58255-afca-4abf-9a8e-b85983258bf1 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:35.257254 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf6b43-4a65-4ba5-99f9-79e3e2a89dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:35.258082 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf6b43-4a65-4ba5-99f9-79e3e2a89dca admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:35.258348 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf6b43-4a65-4ba5-99f9-79e3e2a89dca admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:35.258625 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf6b43-4a65-4ba5-99f9-79e3e2a89dca admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:35.274587 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf6b43-4a65-4ba5-99f9-79e3e2a89dca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:35.281739 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-07cf6b43-4a65-4ba5-99f9-79e3e2a89dca admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:20:35.282949 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 142/280] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:35 2021] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:35.289650 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68740061-9cc3-452b-80b3-e7677159bdd3 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:35.302594 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68740061-9cc3-452b-80b3-e7677159bdd3 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:35.310633 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92a1a9-3f89-4190-9db7-2079319338ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:35.311311 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92a1a9-3f89-4190-9db7-2079319338ff admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:35.311599 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92a1a9-3f89-4190-9db7-2079319338ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:35.311873 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92a1a9-3f89-4190-9db7-2079319338ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:35.312637 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92a1a9-3f89-4190-9db7-2079319338ff admin admin] RBAC: Adding query filter params (name=member) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:35.312944 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92a1a9-3f89-4190-9db7-2079319338ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:35.314570 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92a1a9-3f89-4190-9db7-2079319338ff admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:35.329247 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 139/281] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Oct 27 01:20:35 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:35.336031 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf6b43-4a65-4ba5-99f9-79e3e2a89dca admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:35.346407 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf6b43-4a65-4ba5-99f9-79e3e2a89dca admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:35.352265 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213b6e1-82f0-4027-88af-f5e216209aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:35.353664 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213b6e1-82f0-4027-88af-f5e216209aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:35.353953 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213b6e1-82f0-4027-88af-f5e216209aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:35.354232 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213b6e1-82f0-4027-88af-f5e216209aa2 admin admin] PATH_INFO: `/v3/groups/ee1ac9b1f6e640adadc19b162333a926` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:35.355431 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213b6e1-82f0-4027-88af-f5e216209aa2 admin admin] RBAC: Authorizing `identity:get_group(group_id=ee1ac9b1f6e640adadc19b162333a926)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:35.357319 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213b6e1-82f0-4027-88af-f5e216209aa2 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:35.359142 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 143/282] 10.222.0.25 () {56 vars in 1201 bytes} [Wed Oct 27 01:20:35 2021] GET /identity/v3/groups/ee1ac9b1f6e640adadc19b162333a926 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:35.365451 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92a1a9-3f89-4190-9db7-2079319338ff admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:35.378364 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92a1a9-3f89-4190-9db7-2079319338ff admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:35.382980 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2d0d5-5eff-4d5f-9e4a-e3e113e5f0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:35.383833 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2d0d5-5eff-4d5f-9e4a-e3e113e5f0aa admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:35.384114 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2d0d5-5eff-4d5f-9e4a-e3e113e5f0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:35.384421 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2d0d5-5eff-4d5f-9e4a-e3e113e5f0aa admin admin] PATH_INFO: `/v3/projects/f405caf5e07a413190b7459d3015b944` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:35.390232 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2d0d5-5eff-4d5f-9e4a-e3e113e5f0aa admin admin] RBAC: Authorizing `identity:get_project(project_id=f405caf5e07a413190b7459d3015b944)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:35.392263 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2d0d5-5eff-4d5f-9e4a-e3e113e5f0aa admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:35.394399 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 140/283] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:35 2021] GET /identity/v3/projects/f405caf5e07a413190b7459d3015b944 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:35.401511 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213b6e1-82f0-4027-88af-f5e216209aa2 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:35.414733 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213b6e1-82f0-4027-88af-f5e216209aa2 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:35.420041 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f2fb6-37f2-4c0f-b79d-3810d97c685d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:35.420946 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f2fb6-37f2-4c0f-b79d-3810d97c685d admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:35.421228 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f2fb6-37f2-4c0f-b79d-3810d97c685d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:35.421576 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f2fb6-37f2-4c0f-b79d-3810d97c685d admin admin] PATH_INFO: `/v3/projects/f405caf5e07a413190b7459d3015b944/groups/ee1ac9b1f6e640adadc19b162333a926/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:35.426668 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f2fb6-37f2-4c0f-b79d-3810d97c685d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f405caf5e07a413190b7459d3015b944, group_id=ee1ac9b1f6e640adadc19b162333a926, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:35.429302 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f2fb6-37f2-4c0f-b79d-3810d97c685d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:35.450015 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 144/284] 10.222.0.25 () {58 vars in 1463 bytes} [Wed Oct 27 01:20:35 2021] PUT /identity/v3/projects/f405caf5e07a413190b7459d3015b944/groups/ee1ac9b1f6e640adadc19b162333a926/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:35.977707 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d7700-2482-468e-b235-43fa3ba5d3bb None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:35.978507 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d7700-2482-468e-b235-43fa3ba5d3bb None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:35.978827 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d7700-2482-468e-b235-43fa3ba5d3bb None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:35.980762 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 141/285] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:35.987557 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b4914-e74d-4e92-a07f-0c988762c9d6 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:35.987854 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b4914-e74d-4e92-a07f-0c988762c9d6 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:35.988140 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b4914-e74d-4e92-a07f-0c988762c9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:36.006814 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-f55b4914-e74d-4e92-a07f-0c988762c9d6 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:36.007994 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-f55b4914-e74d-4e92-a07f-0c988762c9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:36.067709 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 145/286] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:36.094669 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d7700-2482-468e-b235-43fa3ba5d3bb None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:36.111481 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d7700-2482-468e-b235-43fa3ba5d3bb None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:36.116055 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc313556-880f-482d-96fe-fabd9f0c5abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:36.116868 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc313556-880f-482d-96fe-fabd9f0c5abb admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:36.117149 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc313556-880f-482d-96fe-fabd9f0c5abb admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:36.117425 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc313556-880f-482d-96fe-fabd9f0c5abb admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:36.133315 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc313556-880f-482d-96fe-fabd9f0c5abb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:36.141253 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-fc313556-880f-482d-96fe-fabd9f0c5abb admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:20:36.145089 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 142/287] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Oct 27 01:20:36 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:36.152107 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b4914-e74d-4e92-a07f-0c988762c9d6 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:36.161404 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b4914-e74d-4e92-a07f-0c988762c9d6 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:36.167689 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024cc21-fb9a-403d-a8e2-e9bdb2016e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:36.168370 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024cc21-fb9a-403d-a8e2-e9bdb2016e30 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:36.168652 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024cc21-fb9a-403d-a8e2-e9bdb2016e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:36.168926 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024cc21-fb9a-403d-a8e2-e9bdb2016e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:36.169724 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c024cc21-fb9a-403d-a8e2-e9bdb2016e30 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:36.170081 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c024cc21-fb9a-403d-a8e2-e9bdb2016e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:36.172020 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c024cc21-fb9a-403d-a8e2-e9bdb2016e30 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:36.186608 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 146/288] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:36 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:36.202243 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc313556-880f-482d-96fe-fabd9f0c5abb admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:36.212822 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc313556-880f-482d-96fe-fabd9f0c5abb admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:36.222157 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58307df0-2f2f-410e-99c5-a729995325d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:36.222960 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58307df0-2f2f-410e-99c5-a729995325d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:36.223247 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58307df0-2f2f-410e-99c5-a729995325d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:36.223533 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58307df0-2f2f-410e-99c5-a729995325d4 admin admin] PATH_INFO: `/v3/groups/ee1ac9b1f6e640adadc19b162333a926` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:36.224836 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58307df0-2f2f-410e-99c5-a729995325d4 admin admin] RBAC: Authorizing `identity:get_group(group_id=ee1ac9b1f6e640adadc19b162333a926)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:36.226853 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58307df0-2f2f-410e-99c5-a729995325d4 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:36.228928 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 143/289] 10.222.0.25 () {56 vars in 1201 bytes} [Wed Oct 27 01:20:36 2021] GET /identity/v3/groups/ee1ac9b1f6e640adadc19b162333a926 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:36.235102 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024cc21-fb9a-403d-a8e2-e9bdb2016e30 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:36.245409 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024cc21-fb9a-403d-a8e2-e9bdb2016e30 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:36.252107 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013a89e-fec6-4c87-a625-6cc67c1e6f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:36.252966 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013a89e-fec6-4c87-a625-6cc67c1e6f6a admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:36.253251 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013a89e-fec6-4c87-a625-6cc67c1e6f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:36.253631 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013a89e-fec6-4c87-a625-6cc67c1e6f6a admin admin] PATH_INFO: `/v3/projects/f405caf5e07a413190b7459d3015b944` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:36.254854 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a013a89e-fec6-4c87-a625-6cc67c1e6f6a admin admin] RBAC: Authorizing `identity:get_project(project_id=f405caf5e07a413190b7459d3015b944)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:36.256891 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a013a89e-fec6-4c87-a625-6cc67c1e6f6a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:36.258814 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 147/290] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:36 2021] GET /identity/v3/projects/f405caf5e07a413190b7459d3015b944 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:36.265397 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58307df0-2f2f-410e-99c5-a729995325d4 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:36.275318 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58307df0-2f2f-410e-99c5-a729995325d4 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:36.285626 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4ba38-72a2-428f-9b58-4b1e9c539d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:36.286512 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4ba38-72a2-428f-9b58-4b1e9c539d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:36.286801 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4ba38-72a2-428f-9b58-4b1e9c539d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:36.287080 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4ba38-72a2-428f-9b58-4b1e9c539d8c admin admin] PATH_INFO: `/v3/projects/f405caf5e07a413190b7459d3015b944/groups/ee1ac9b1f6e640adadc19b162333a926/roles/22382371cf4846fe84d1403e3ab1785e` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:36.289332 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf4ba38-72a2-428f-9b58-4b1e9c539d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f405caf5e07a413190b7459d3015b944, group_id=ee1ac9b1f6e640adadc19b162333a926, role_id=22382371cf4846fe84d1403e3ab1785e)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:36.292020 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf4ba38-72a2-428f-9b58-4b1e9c539d8c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:36.312895 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 144/291] 10.222.0.25 () {58 vars in 1463 bytes} [Wed Oct 27 01:20:36 2021] PUT /identity/v3/projects/f405caf5e07a413190b7459d3015b944/groups/ee1ac9b1f6e640adadc19b162333a926/roles/22382371cf4846fe84d1403e3ab1785e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:36.609256 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd13e3-6130-4051-a784-91b4aadc0eb7 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:36.609616 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd13e3-6130-4051-a784-91b4aadc0eb7 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:36.609788 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd13e3-6130-4051-a784-91b4aadc0eb7 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:36.611734 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 148/292] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:36.617845 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cebba-01f5-42a3-838e-4042d266d324 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:36.618140 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cebba-01f5-42a3-838e-4042d266d324 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:36.618396 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cebba-01f5-42a3-838e-4042d266d324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:36.642726 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-e14cebba-01f5-42a3-838e-4042d266d324 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:36.643952 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-e14cebba-01f5-42a3-838e-4042d266d324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:36.717966 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 145/293] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:36.753160 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd13e3-6130-4051-a784-91b4aadc0eb7 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:36.767791 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd13e3-6130-4051-a784-91b4aadc0eb7 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:36.772327 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceebe71-955d-420d-b117-018d7080a041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:36.773180 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceebe71-955d-420d-b117-018d7080a041 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:36.773462 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceebe71-955d-420d-b117-018d7080a041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:36.773760 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceebe71-955d-420d-b117-018d7080a041 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:36.791784 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceebe71-955d-420d-b117-018d7080a041 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:36.799094 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-9ceebe71-955d-420d-b117-018d7080a041 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:20:36.800422 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 149/294] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:36 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:36.807139 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cebba-01f5-42a3-838e-4042d266d324 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:36.816726 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cebba-01f5-42a3-838e-4042d266d324 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:36.825875 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f27855-d7ed-4258-8383-3bda0ac81b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:36.826563 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f27855-d7ed-4258-8383-3bda0ac81b78 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:36.826843 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f27855-d7ed-4258-8383-3bda0ac81b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:36.827115 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f27855-d7ed-4258-8383-3bda0ac81b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:36.827890 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f27855-d7ed-4258-8383-3bda0ac81b78 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:36.828194 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f27855-d7ed-4258-8383-3bda0ac81b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:36.829817 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f27855-d7ed-4258-8383-3bda0ac81b78 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:36.839536 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 146/295] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Oct 27 01:20:36 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:36.845787 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceebe71-955d-420d-b117-018d7080a041 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:36.858949 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceebe71-955d-420d-b117-018d7080a041 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:36.866033 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62c82a-b3f5-4514-a332-e9cec2d5b1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:36.866848 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62c82a-b3f5-4514-a332-e9cec2d5b1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:36.867167 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62c82a-b3f5-4514-a332-e9cec2d5b1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:36.867457 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62c82a-b3f5-4514-a332-e9cec2d5b1a0 admin admin] PATH_INFO: `/v3/groups/ee1ac9b1f6e640adadc19b162333a926` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:36.869330 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62c82a-b3f5-4514-a332-e9cec2d5b1a0 admin admin] RBAC: Authorizing `identity:get_group(group_id=ee1ac9b1f6e640adadc19b162333a926)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:36.871330 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62c82a-b3f5-4514-a332-e9cec2d5b1a0 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:36.873099 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 150/296] 10.222.0.25 () {56 vars in 1201 bytes} [Wed Oct 27 01:20:36 2021] GET /identity/v3/groups/ee1ac9b1f6e640adadc19b162333a926 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:36.879298 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f27855-d7ed-4258-8383-3bda0ac81b78 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:36.889678 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f27855-d7ed-4258-8383-3bda0ac81b78 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:36.894435 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cad64-a1d8-45d1-b47f-99c4182af5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:36.895354 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cad64-a1d8-45d1-b47f-99c4182af5ea admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:36.895638 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cad64-a1d8-45d1-b47f-99c4182af5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:36.895964 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cad64-a1d8-45d1-b47f-99c4182af5ea admin admin] PATH_INFO: `/v3/projects/34499f5a2c02434b979288e28f14fe69` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:36.897216 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cad64-a1d8-45d1-b47f-99c4182af5ea admin admin] RBAC: Authorizing `identity:get_project(project_id=34499f5a2c02434b979288e28f14fe69)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:36.899403 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cad64-a1d8-45d1-b47f-99c4182af5ea admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:36.902058 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 147/297] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:36 2021] GET /identity/v3/projects/34499f5a2c02434b979288e28f14fe69 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:36.908558 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62c82a-b3f5-4514-a332-e9cec2d5b1a0 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:36.918894 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62c82a-b3f5-4514-a332-e9cec2d5b1a0 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:36.923547 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd29ae0-5f49-4941-a13c-69cd4c01d973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:36.924476 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd29ae0-5f49-4941-a13c-69cd4c01d973 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:36.924764 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd29ae0-5f49-4941-a13c-69cd4c01d973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:36.925041 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd29ae0-5f49-4941-a13c-69cd4c01d973 admin admin] PATH_INFO: `/v3/projects/34499f5a2c02434b979288e28f14fe69/groups/ee1ac9b1f6e640adadc19b162333a926/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:36.927155 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd29ae0-5f49-4941-a13c-69cd4c01d973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34499f5a2c02434b979288e28f14fe69, group_id=ee1ac9b1f6e640adadc19b162333a926, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:36.929946 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd29ae0-5f49-4941-a13c-69cd4c01d973 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:36.944925 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 151/298] 10.222.0.25 () {58 vars in 1463 bytes} [Wed Oct 27 01:20:36 2021] PUT /identity/v3/projects/34499f5a2c02434b979288e28f14fe69/groups/ee1ac9b1f6e640adadc19b162333a926/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:37.433241 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c93fea-8edd-4619-be82-7244d89afb53 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:37.433953 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c93fea-8edd-4619-be82-7244d89afb53 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:37.433953 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c93fea-8edd-4619-be82-7244d89afb53 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:37.435667 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 148/299] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:37.441757 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b525bb-8771-433c-9bac-c629ae7007ed None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:37.442265 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b525bb-8771-433c-9bac-c629ae7007ed None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:37.442408 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b525bb-8771-433c-9bac-c629ae7007ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:37.464167 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-b7b525bb-8771-433c-9bac-c629ae7007ed None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:37.465474 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-b7b525bb-8771-433c-9bac-c629ae7007ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:37.533355 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 152/300] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:37.559095 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c93fea-8edd-4619-be82-7244d89afb53 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:37.575659 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c93fea-8edd-4619-be82-7244d89afb53 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:37.580174 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef5c14-e153-4f88-a7eb-bdf91a10a2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:37.580981 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef5c14-e153-4f88-a7eb-bdf91a10a2db admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:37.581267 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef5c14-e153-4f88-a7eb-bdf91a10a2db admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:37.581566 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef5c14-e153-4f88-a7eb-bdf91a10a2db admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:37.592432 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef5c14-e153-4f88-a7eb-bdf91a10a2db admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:37.604517 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-b2ef5c14-e153-4f88-a7eb-bdf91a10a2db admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:20:37.605986 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 149/301] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Oct 27 01:20:37 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:37.612081 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b525bb-8771-433c-9bac-c629ae7007ed None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:37.621973 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b525bb-8771-433c-9bac-c629ae7007ed None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:37.629640 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6df9f-d4eb-4e81-af06-ea87fe60b0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:37.630318 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6df9f-d4eb-4e81-af06-ea87fe60b0ea admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:37.630595 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6df9f-d4eb-4e81-af06-ea87fe60b0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:37.630876 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6df9f-d4eb-4e81-af06-ea87fe60b0ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:37.631633 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6df9f-d4eb-4e81-af06-ea87fe60b0ea admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:37.632066 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6df9f-d4eb-4e81-af06-ea87fe60b0ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:37.633746 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6df9f-d4eb-4e81-af06-ea87fe60b0ea admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:37.642944 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 153/302] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:37 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:37.648865 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef5c14-e153-4f88-a7eb-bdf91a10a2db admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:37.659991 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef5c14-e153-4f88-a7eb-bdf91a10a2db admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:37.675166 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa233d-287a-4985-9d08-f70e463326a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:37.675166 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa233d-287a-4985-9d08-f70e463326a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:37.675166 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa233d-287a-4985-9d08-f70e463326a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:37.675166 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa233d-287a-4985-9d08-f70e463326a4 admin admin] PATH_INFO: `/v3/groups/ee1ac9b1f6e640adadc19b162333a926` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:37.675940 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa233d-287a-4985-9d08-f70e463326a4 admin admin] RBAC: Authorizing `identity:get_group(group_id=ee1ac9b1f6e640adadc19b162333a926)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:37.677537 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa233d-287a-4985-9d08-f70e463326a4 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:37.679217 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 150/303] 10.222.0.25 () {56 vars in 1201 bytes} [Wed Oct 27 01:20:37 2021] GET /identity/v3/groups/ee1ac9b1f6e640adadc19b162333a926 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:37.685852 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6df9f-d4eb-4e81-af06-ea87fe60b0ea admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:37.695838 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6df9f-d4eb-4e81-af06-ea87fe60b0ea admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:37.707943 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b5a9f-becd-47d1-92c0-64c9efc3e72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:37.708975 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b5a9f-becd-47d1-92c0-64c9efc3e72e admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:37.709264 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b5a9f-becd-47d1-92c0-64c9efc3e72e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:37.709556 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b5a9f-becd-47d1-92c0-64c9efc3e72e admin admin] PATH_INFO: `/v3/projects/34499f5a2c02434b979288e28f14fe69` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:37.713015 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b5a9f-becd-47d1-92c0-64c9efc3e72e admin admin] RBAC: Authorizing `identity:get_project(project_id=34499f5a2c02434b979288e28f14fe69)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:37.715204 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b5a9f-becd-47d1-92c0-64c9efc3e72e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:37.717199 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 154/304] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:37 2021] GET /identity/v3/projects/34499f5a2c02434b979288e28f14fe69 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:37.723616 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa233d-287a-4985-9d08-f70e463326a4 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:37.742036 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa233d-287a-4985-9d08-f70e463326a4 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:37.749591 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58c2b9-1644-4550-933c-e005eef752b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:37.750487 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58c2b9-1644-4550-933c-e005eef752b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:37.750820 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58c2b9-1644-4550-933c-e005eef752b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:37.751099 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58c2b9-1644-4550-933c-e005eef752b7 admin admin] PATH_INFO: `/v3/projects/34499f5a2c02434b979288e28f14fe69/groups/ee1ac9b1f6e640adadc19b162333a926/roles/22382371cf4846fe84d1403e3ab1785e` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:37.753376 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58c2b9-1644-4550-933c-e005eef752b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34499f5a2c02434b979288e28f14fe69, group_id=ee1ac9b1f6e640adadc19b162333a926, role_id=22382371cf4846fe84d1403e3ab1785e)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:37.756260 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58c2b9-1644-4550-933c-e005eef752b7 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:37.774031 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 151/305] 10.222.0.25 () {58 vars in 1463 bytes} [Wed Oct 27 01:20:37 2021] PUT /identity/v3/projects/34499f5a2c02434b979288e28f14fe69/groups/ee1ac9b1f6e640adadc19b162333a926/roles/22382371cf4846fe84d1403e3ab1785e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:38.022575 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7bb66-98d0-4879-ae5c-f2652f6c9081 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:38.022902 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7bb66-98d0-4879-ae5c-f2652f6c9081 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:38.023129 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7bb66-98d0-4879-ae5c-f2652f6c9081 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:38.025211 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 155/306] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:38.031906 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4dd041-579d-4582-b50c-144dbc586aa2 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:38.032230 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4dd041-579d-4582-b50c-144dbc586aa2 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:38.032453 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4dd041-579d-4582-b50c-144dbc586aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:38.055037 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-2b4dd041-579d-4582-b50c-144dbc586aa2 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:38.056353 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-2b4dd041-579d-4582-b50c-144dbc586aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:38.131948 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 152/307] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:38.173857 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7bb66-98d0-4879-ae5c-f2652f6c9081 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:38.191635 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7bb66-98d0-4879-ae5c-f2652f6c9081 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:38.198060 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443a00b-3b64-42e8-9680-4fd25b5dfd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:38.198855 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443a00b-3b64-42e8-9680-4fd25b5dfd9d admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:38.199181 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443a00b-3b64-42e8-9680-4fd25b5dfd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:38.199462 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443a00b-3b64-42e8-9680-4fd25b5dfd9d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:38.214312 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0443a00b-3b64-42e8-9680-4fd25b5dfd9d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:38.221322 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-0443a00b-3b64-42e8-9680-4fd25b5dfd9d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:20:38.222715 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 156/308] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:20:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:38.229368 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4dd041-579d-4582-b50c-144dbc586aa2 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:38.239361 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4dd041-579d-4582-b50c-144dbc586aa2 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:38.248961 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93e554-28ed-481a-819a-f46c9a584711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:38.249685 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93e554-28ed-481a-819a-f46c9a584711 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:38.249969 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93e554-28ed-481a-819a-f46c9a584711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:38.250308 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93e554-28ed-481a-819a-f46c9a584711 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:38.251092 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93e554-28ed-481a-819a-f46c9a584711 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:38.251448 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93e554-28ed-481a-819a-f46c9a584711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:38.253092 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93e554-28ed-481a-819a-f46c9a584711 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:38.263863 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 153/309] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:38.270900 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443a00b-3b64-42e8-9680-4fd25b5dfd9d admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:38.292209 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443a00b-3b64-42e8-9680-4fd25b5dfd9d admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:38.301582 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ff59f-fb2d-426e-9fa4-e5bd090bb470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:38.302449 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ff59f-fb2d-426e-9fa4-e5bd090bb470 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:38.302904 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ff59f-fb2d-426e-9fa4-e5bd090bb470 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:38.303187 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ff59f-fb2d-426e-9fa4-e5bd090bb470 admin admin] PATH_INFO: `/v3/groups/c61b6e05a91b45a8821c6b8fcc313832` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:38.310316 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ff59f-fb2d-426e-9fa4-e5bd090bb470 admin admin] RBAC: Authorizing `identity:get_group(group_id=c61b6e05a91b45a8821c6b8fcc313832)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:38.312307 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ff59f-fb2d-426e-9fa4-e5bd090bb470 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:38.314282 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 157/310] 10.222.0.25 () {56 vars in 1201 bytes} [Wed Oct 27 01:20:38 2021] GET /identity/v3/groups/c61b6e05a91b45a8821c6b8fcc313832 => generated 229 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:38.320584 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93e554-28ed-481a-819a-f46c9a584711 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:38.331476 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93e554-28ed-481a-819a-f46c9a584711 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:38.339363 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee42239-d5d3-492d-b51c-71964261f81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:38.340277 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee42239-d5d3-492d-b51c-71964261f81e admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:38.340559 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee42239-d5d3-492d-b51c-71964261f81e admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:38.340835 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee42239-d5d3-492d-b51c-71964261f81e admin admin] PATH_INFO: `/v3/projects/38379d318e5c49acaf4683887f433419` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:38.342237 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee42239-d5d3-492d-b51c-71964261f81e admin admin] RBAC: Authorizing `identity:get_project(project_id=38379d318e5c49acaf4683887f433419)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:38.344185 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee42239-d5d3-492d-b51c-71964261f81e admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:38.346162 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 154/311] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:38 2021] GET /identity/v3/projects/38379d318e5c49acaf4683887f433419 => generated 344 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:38.352653 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ff59f-fb2d-426e-9fa4-e5bd090bb470 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:38.363038 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ff59f-fb2d-426e-9fa4-e5bd090bb470 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:38.372626 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe17c9-35e2-4ed4-b583-a7d1a49c747f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:38.373588 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe17c9-35e2-4ed4-b583-a7d1a49c747f admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:38.373873 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe17c9-35e2-4ed4-b583-a7d1a49c747f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:38.374149 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe17c9-35e2-4ed4-b583-a7d1a49c747f admin admin] PATH_INFO: `/v3/projects/38379d318e5c49acaf4683887f433419/groups/c61b6e05a91b45a8821c6b8fcc313832/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:38.376264 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe17c9-35e2-4ed4-b583-a7d1a49c747f admin admin] RBAC: Authorizing `identity:create_grant(project_id=38379d318e5c49acaf4683887f433419, group_id=c61b6e05a91b45a8821c6b8fcc313832, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:38.379078 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe17c9-35e2-4ed4-b583-a7d1a49c747f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:38.394612 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 158/312] 10.222.0.25 () {58 vars in 1463 bytes} [Wed Oct 27 01:20:38 2021] PUT /identity/v3/projects/38379d318e5c49acaf4683887f433419/groups/c61b6e05a91b45a8821c6b8fcc313832/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:38.417984 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4630b-be1f-4366-9258-19be895c89c0 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:38.418318 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4630b-be1f-4366-9258-19be895c89c0 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:38.418585 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4630b-be1f-4366-9258-19be895c89c0 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:38.420511 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 155/313] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:38.427168 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd5111-b194-4b1c-9a9d-45402248562a None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:38.427466 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd5111-b194-4b1c-9a9d-45402248562a None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:38.427719 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd5111-b194-4b1c-9a9d-45402248562a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:38.574820 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-35cd5111-b194-4b1c-9a9d-45402248562a None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:38.575959 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-35cd5111-b194-4b1c-9a9d-45402248562a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:38.651913 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 159/314] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:38.693070 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4630b-be1f-4366-9258-19be895c89c0 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:38.711339 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4630b-be1f-4366-9258-19be895c89c0 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:38.716462 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716adac-aa4a-419a-82cc-7e9504348df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:38.717289 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716adac-aa4a-419a-82cc-7e9504348df5 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:38.717594 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716adac-aa4a-419a-82cc-7e9504348df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:38.717874 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716adac-aa4a-419a-82cc-7e9504348df5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:38.729358 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716adac-aa4a-419a-82cc-7e9504348df5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:38.736417 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-8716adac-aa4a-419a-82cc-7e9504348df5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:20:38.739405 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 156/315] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:38 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:38.746385 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd5111-b194-4b1c-9a9d-45402248562a None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:38.755457 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd5111-b194-4b1c-9a9d-45402248562a None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:38.763582 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e14a3f-c099-424c-a312-f67e4a1a480a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:38.764446 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e14a3f-c099-424c-a312-f67e4a1a480a admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:38.764905 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e14a3f-c099-424c-a312-f67e4a1a480a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:38.765332 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e14a3f-c099-424c-a312-f67e4a1a480a admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:38.766262 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e14a3f-c099-424c-a312-f67e4a1a480a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:38.766719 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e14a3f-c099-424c-a312-f67e4a1a480a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:38.768455 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e14a3f-c099-424c-a312-f67e4a1a480a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:38.779098 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 160/316] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Oct 27 01:20:38 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:38.785365 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716adac-aa4a-419a-82cc-7e9504348df5 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:38.796017 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716adac-aa4a-419a-82cc-7e9504348df5 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:38.800495 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0230ae8-ca4a-42b9-8638-9f71772ee370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:38.801138 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0230ae8-ca4a-42b9-8638-9f71772ee370 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:38.801424 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0230ae8-ca4a-42b9-8638-9f71772ee370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:38.801745 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0230ae8-ca4a-42b9-8638-9f71772ee370 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:38.813439 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0230ae8-ca4a-42b9-8638-9f71772ee370 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:38.815221 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0230ae8-ca4a-42b9-8638-9f71772ee370 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:38.824916 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 157/317] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:38.831211 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e14a3f-c099-424c-a312-f67e4a1a480a admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:38.842622 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e14a3f-c099-424c-a312-f67e4a1a480a admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:38.848282 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a002cfa-00ee-46b9-acde-aaff7c801eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:38.849355 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a002cfa-00ee-46b9-acde-aaff7c801eaa admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:38.849881 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a002cfa-00ee-46b9-acde-aaff7c801eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:38.850363 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a002cfa-00ee-46b9-acde-aaff7c801eaa admin admin] PATH_INFO: `/v3/projects/f405caf5e07a413190b7459d3015b944` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:38.851769 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a002cfa-00ee-46b9-acde-aaff7c801eaa admin admin] RBAC: Authorizing `identity:get_project(project_id=f405caf5e07a413190b7459d3015b944)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:38.854560 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a002cfa-00ee-46b9-acde-aaff7c801eaa admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:38.856720 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 161/318] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:38 2021] GET /identity/v3/projects/f405caf5e07a413190b7459d3015b944 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:38.862980 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0230ae8-ca4a-42b9-8638-9f71772ee370 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:38.877164 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0230ae8-ca4a-42b9-8638-9f71772ee370 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:38.885280 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553558c-f819-4031-a695-de1d271b81f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:38.886169 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553558c-f819-4031-a695-de1d271b81f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:38.886450 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553558c-f819-4031-a695-de1d271b81f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:38.886727 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553558c-f819-4031-a695-de1d271b81f0 admin admin] PATH_INFO: `/v3/groups/ee1ac9b1f6e640adadc19b162333a926` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:38.890188 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553558c-f819-4031-a695-de1d271b81f0 admin admin] RBAC: Authorizing `identity:get_group(group_id=ee1ac9b1f6e640adadc19b162333a926)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:38.892080 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553558c-f819-4031-a695-de1d271b81f0 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:38.893729 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 158/319] 10.222.0.25 () {56 vars in 1201 bytes} [Wed Oct 27 01:20:38 2021] GET /identity/v3/groups/ee1ac9b1f6e640adadc19b162333a926 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:38.900341 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a002cfa-00ee-46b9-acde-aaff7c801eaa admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:38.913830 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a002cfa-00ee-46b9-acde-aaff7c801eaa admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:38.920994 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbd45f-afdf-493a-a8ae-34c77d8bfac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:38.921885 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbd45f-afdf-493a-a8ae-34c77d8bfac9 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:38.922357 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbd45f-afdf-493a-a8ae-34c77d8bfac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:38.922816 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbd45f-afdf-493a-a8ae-34c77d8bfac9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:38.923862 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccbd45f-afdf-493a-a8ae-34c77d8bfac9 admin admin] RBAC: Adding query filter params (group.id=ee1ac9b1f6e640adadc19b162333a926, role.id=540999ece4154e6ba219007ddda3f8f9, scope.project.id=f405caf5e07a413190b7459d3015b944) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:38.924361 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccbd45f-afdf-493a-a8ae-34c77d8bfac9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:38.926419 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccbd45f-afdf-493a-a8ae-34c77d8bfac9 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:38.938413 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 162/320] 10.222.0.25 () {56 vars in 1397 bytes} [Wed Oct 27 01:20:38 2021] GET /identity/v3/role_assignments?group.id=ee1ac9b1f6e640adadc19b162333a926&scope.project.id=f405caf5e07a413190b7459d3015b944&role.id=540999ece4154e6ba219007ddda3f8f9 => generated 611 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:39.707383 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b055c-3d0b-4c4d-967b-d03f4ab0cdf6 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:39.708442 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b055c-3d0b-4c4d-967b-d03f4ab0cdf6 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:39.708930 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b055c-3d0b-4c4d-967b-d03f4ab0cdf6 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:39.710939 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 159/321] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:39 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:39.717256 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac78d13-b6fc-4e34-a148-12af96ab4393 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:39.718161 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac78d13-b6fc-4e34-a148-12af96ab4393 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:39.718676 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac78d13-b6fc-4e34-a148-12af96ab4393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:39.739079 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-0ac78d13-b6fc-4e34-a148-12af96ab4393 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:39.740569 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-0ac78d13-b6fc-4e34-a148-12af96ab4393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:39.751613 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 163/322] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:39.779407 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b055c-3d0b-4c4d-967b-d03f4ab0cdf6 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:39.795883 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b055c-3d0b-4c4d-967b-d03f4ab0cdf6 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:39.803202 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d2d1a-c1b9-4f48-8948-bd9fe4b8cc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:39.804292 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d2d1a-c1b9-4f48-8948-bd9fe4b8cc59 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:39.804777 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d2d1a-c1b9-4f48-8948-bd9fe4b8cc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:39.805272 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d2d1a-c1b9-4f48-8948-bd9fe4b8cc59 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:39.821101 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d2d1a-c1b9-4f48-8948-bd9fe4b8cc59 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:39.832872 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-8b0d2d1a-c1b9-4f48-8948-bd9fe4b8cc59 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:20:39.834680 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 160/323] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Oct 27 01:20:39 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:39.842133 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac78d13-b6fc-4e34-a148-12af96ab4393 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:39.851525 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac78d13-b6fc-4e34-a148-12af96ab4393 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:39.858992 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d3236-11bc-42b9-8f91-79a68923f3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:39.860034 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d3236-11bc-42b9-8f91-79a68923f3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:39.860554 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d3236-11bc-42b9-8f91-79a68923f3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:39.861032 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d3236-11bc-42b9-8f91-79a68923f3d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:39.862111 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d3236-11bc-42b9-8f91-79a68923f3d7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:39.862623 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d3236-11bc-42b9-8f91-79a68923f3d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:39.864402 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d3236-11bc-42b9-8f91-79a68923f3d7 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:39.875856 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 164/324] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:39 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:39.882511 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d2d1a-c1b9-4f48-8948-bd9fe4b8cc59 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:39.893294 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d2d1a-c1b9-4f48-8948-bd9fe4b8cc59 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:39.898353 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aab96a-bf19-4397-988e-b8d5908a6c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:39.899293 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aab96a-bf19-4397-988e-b8d5908a6c11 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:39.899864 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aab96a-bf19-4397-988e-b8d5908a6c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:39.900346 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aab96a-bf19-4397-988e-b8d5908a6c11 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:39.909907 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aab96a-bf19-4397-988e-b8d5908a6c11 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:39.912076 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aab96a-bf19-4397-988e-b8d5908a6c11 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:39.924166 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 161/325] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:39 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:39.930099 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d3236-11bc-42b9-8f91-79a68923f3d7 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:39.941742 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d3236-11bc-42b9-8f91-79a68923f3d7 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:39.946662 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162676b-4d7c-44d2-88c9-7cb3ebfe24dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:39.947806 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162676b-4d7c-44d2-88c9-7cb3ebfe24dc admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:39.948424 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162676b-4d7c-44d2-88c9-7cb3ebfe24dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:39.948899 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162676b-4d7c-44d2-88c9-7cb3ebfe24dc admin admin] PATH_INFO: `/v3/projects/f405caf5e07a413190b7459d3015b944` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:39.950389 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162676b-4d7c-44d2-88c9-7cb3ebfe24dc admin admin] RBAC: Authorizing `identity:get_project(project_id=f405caf5e07a413190b7459d3015b944)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:39.952794 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162676b-4d7c-44d2-88c9-7cb3ebfe24dc admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:39.954794 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 165/326] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:39 2021] GET /identity/v3/projects/f405caf5e07a413190b7459d3015b944 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:39.963445 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aab96a-bf19-4397-988e-b8d5908a6c11 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:39.973077 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aab96a-bf19-4397-988e-b8d5908a6c11 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:39.977780 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af8333-a3c5-4286-a321-04a2a2626c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:39.978723 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af8333-a3c5-4286-a321-04a2a2626c1a admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:39.979054 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af8333-a3c5-4286-a321-04a2a2626c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:39.979334 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af8333-a3c5-4286-a321-04a2a2626c1a admin admin] PATH_INFO: `/v3/groups/ee1ac9b1f6e640adadc19b162333a926` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:39.980577 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af8333-a3c5-4286-a321-04a2a2626c1a admin admin] RBAC: Authorizing `identity:get_group(group_id=ee1ac9b1f6e640adadc19b162333a926)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:39.982679 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af8333-a3c5-4286-a321-04a2a2626c1a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:39.984626 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 162/327] 10.222.0.25 () {56 vars in 1201 bytes} [Wed Oct 27 01:20:39 2021] GET /identity/v3/groups/ee1ac9b1f6e640adadc19b162333a926 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:39.990908 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162676b-4d7c-44d2-88c9-7cb3ebfe24dc admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:40.002622 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162676b-4d7c-44d2-88c9-7cb3ebfe24dc admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:40.007754 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3e6f9-834d-4b7b-a623-24e2e0eae5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:40.008424 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3e6f9-834d-4b7b-a623-24e2e0eae5ba admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:40.008754 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3e6f9-834d-4b7b-a623-24e2e0eae5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:40.009173 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3e6f9-834d-4b7b-a623-24e2e0eae5ba admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:40.010588 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3e6f9-834d-4b7b-a623-24e2e0eae5ba admin admin] RBAC: Adding query filter params (group.id=ee1ac9b1f6e640adadc19b162333a926, role.id=22382371cf4846fe84d1403e3ab1785e, scope.project.id=f405caf5e07a413190b7459d3015b944) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:40.010904 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3e6f9-834d-4b7b-a623-24e2e0eae5ba admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:40.012948 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3e6f9-834d-4b7b-a623-24e2e0eae5ba admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:40.019911 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 166/328] 10.222.0.25 () {56 vars in 1397 bytes} [Wed Oct 27 01:20:39 2021] GET /identity/v3/role_assignments?group.id=ee1ac9b1f6e640adadc19b162333a926&scope.project.id=f405caf5e07a413190b7459d3015b944&role.id=22382371cf4846fe84d1403e3ab1785e => generated 611 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:40.225057 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f4b71-967d-4aa7-866a-6dd412f68bb3 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:40.225401 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f4b71-967d-4aa7-866a-6dd412f68bb3 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:40.225606 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f4b71-967d-4aa7-866a-6dd412f68bb3 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:40.227371 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 163/329] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:40.234482 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baede47-6951-40d5-a798-eef55b8308ad None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:40.234772 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baede47-6951-40d5-a798-eef55b8308ad None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:40.235053 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baede47-6951-40d5-a798-eef55b8308ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:40.261387 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-8baede47-6951-40d5-a798-eef55b8308ad None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:40.262612 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-8baede47-6951-40d5-a798-eef55b8308ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:40.270499 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 167/330] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:40.296509 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f4b71-967d-4aa7-866a-6dd412f68bb3 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:40.310181 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f4b71-967d-4aa7-866a-6dd412f68bb3 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:40.314714 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa648cb-0778-4981-9b30-5661faeda113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:40.315501 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa648cb-0778-4981-9b30-5661faeda113 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:40.315783 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa648cb-0778-4981-9b30-5661faeda113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:40.316068 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa648cb-0778-4981-9b30-5661faeda113 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:40.327145 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa648cb-0778-4981-9b30-5661faeda113 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:40.334351 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-afa648cb-0778-4981-9b30-5661faeda113 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:20:40.335606 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 164/331] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:40 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:40.342416 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baede47-6951-40d5-a798-eef55b8308ad None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:40.352112 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baede47-6951-40d5-a798-eef55b8308ad None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:40.358362 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91465ac-b342-4f07-a641-bef7cdee3a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:40.359132 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91465ac-b342-4f07-a641-bef7cdee3a3b admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:40.359454 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91465ac-b342-4f07-a641-bef7cdee3a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:40.359863 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91465ac-b342-4f07-a641-bef7cdee3a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:40.360689 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91465ac-b342-4f07-a641-bef7cdee3a3b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:40.361052 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91465ac-b342-4f07-a641-bef7cdee3a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:40.362871 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91465ac-b342-4f07-a641-bef7cdee3a3b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:40.372366 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 168/332] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Oct 27 01:20:40 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:40.381238 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa648cb-0778-4981-9b30-5661faeda113 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:40.392509 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa648cb-0778-4981-9b30-5661faeda113 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:40.397632 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50295ff7-b52a-4494-8f6d-5869a4549eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:40.398532 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50295ff7-b52a-4494-8f6d-5869a4549eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:40.399079 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50295ff7-b52a-4494-8f6d-5869a4549eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:40.399564 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50295ff7-b52a-4494-8f6d-5869a4549eb8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:40.409760 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50295ff7-b52a-4494-8f6d-5869a4549eb8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:40.411810 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50295ff7-b52a-4494-8f6d-5869a4549eb8 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:40.422642 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 165/333] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:40.428707 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91465ac-b342-4f07-a641-bef7cdee3a3b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:40.439742 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91465ac-b342-4f07-a641-bef7cdee3a3b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:40.444753 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c5a82-6c3f-448b-b5e6-945917d63172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:40.445656 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c5a82-6c3f-448b-b5e6-945917d63172 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:40.445966 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c5a82-6c3f-448b-b5e6-945917d63172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:40.446264 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c5a82-6c3f-448b-b5e6-945917d63172 admin admin] PATH_INFO: `/v3/projects/34499f5a2c02434b979288e28f14fe69` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:40.447531 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c5a82-6c3f-448b-b5e6-945917d63172 admin admin] RBAC: Authorizing `identity:get_project(project_id=34499f5a2c02434b979288e28f14fe69)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:40.449642 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c5a82-6c3f-448b-b5e6-945917d63172 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:40.451501 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 169/334] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:40 2021] GET /identity/v3/projects/34499f5a2c02434b979288e28f14fe69 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:40.457968 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50295ff7-b52a-4494-8f6d-5869a4549eb8 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:40.467222 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50295ff7-b52a-4494-8f6d-5869a4549eb8 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:40.472813 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1502dc-9d54-4f92-bfa5-6db01d76f9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:40.473700 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1502dc-9d54-4f92-bfa5-6db01d76f9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:40.473982 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1502dc-9d54-4f92-bfa5-6db01d76f9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:40.474261 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1502dc-9d54-4f92-bfa5-6db01d76f9d5 admin admin] PATH_INFO: `/v3/groups/ee1ac9b1f6e640adadc19b162333a926` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:40.475502 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1502dc-9d54-4f92-bfa5-6db01d76f9d5 admin admin] RBAC: Authorizing `identity:get_group(group_id=ee1ac9b1f6e640adadc19b162333a926)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:40.477356 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1502dc-9d54-4f92-bfa5-6db01d76f9d5 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:40.485084 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 166/335] 10.222.0.25 () {56 vars in 1201 bytes} [Wed Oct 27 01:20:40 2021] GET /identity/v3/groups/ee1ac9b1f6e640adadc19b162333a926 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:40.486511 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c5a82-6c3f-448b-b5e6-945917d63172 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:40.498414 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c5a82-6c3f-448b-b5e6-945917d63172 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:40.504060 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda9ccc-e9fa-4d5a-b183-b21d2d5aa623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:40.504727 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda9ccc-e9fa-4d5a-b183-b21d2d5aa623 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:40.505016 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda9ccc-e9fa-4d5a-b183-b21d2d5aa623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:40.505296 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda9ccc-e9fa-4d5a-b183-b21d2d5aa623 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:40.506244 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda9ccc-e9fa-4d5a-b183-b21d2d5aa623 admin admin] RBAC: Adding query filter params (group.id=ee1ac9b1f6e640adadc19b162333a926, role.id=540999ece4154e6ba219007ddda3f8f9, scope.project.id=34499f5a2c02434b979288e28f14fe69) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:40.506560 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda9ccc-e9fa-4d5a-b183-b21d2d5aa623 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:40.508489 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda9ccc-e9fa-4d5a-b183-b21d2d5aa623 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:40.515672 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 170/336] 10.222.0.25 () {56 vars in 1397 bytes} [Wed Oct 27 01:20:40 2021] GET /identity/v3/role_assignments?group.id=ee1ac9b1f6e640adadc19b162333a926&scope.project.id=34499f5a2c02434b979288e28f14fe69&role.id=540999ece4154e6ba219007ddda3f8f9 => generated 611 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:40.668204 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfcc95-fa1b-4ee1-a3a5-f7a180e194df None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:40.668606 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfcc95-fa1b-4ee1-a3a5-f7a180e194df None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:40.668850 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfcc95-fa1b-4ee1-a3a5-f7a180e194df None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:40.670756 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 167/337] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:40.677469 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16c295-1d0b-47ae-bfeb-fa57ab577da9 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:40.677868 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16c295-1d0b-47ae-bfeb-fa57ab577da9 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:40.678222 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16c295-1d0b-47ae-bfeb-fa57ab577da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:40.697114 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-8f16c295-1d0b-47ae-bfeb-fa57ab577da9 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:40.698492 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-8f16c295-1d0b-47ae-bfeb-fa57ab577da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:40.707645 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 171/338] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:40.733099 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfcc95-fa1b-4ee1-a3a5-f7a180e194df None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:40.745317 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfcc95-fa1b-4ee1-a3a5-f7a180e194df None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:40.749778 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bdaad7-36dc-4575-a38b-575ab54fede6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:40.750605 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdaad7-36dc-4575-a38b-575ab54fede6 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:40.750884 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdaad7-36dc-4575-a38b-575ab54fede6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:40.751182 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdaad7-36dc-4575-a38b-575ab54fede6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:40.761844 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bdaad7-36dc-4575-a38b-575ab54fede6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:40.769318 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-19bdaad7-36dc-4575-a38b-575ab54fede6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:20:40.770703 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 168/339] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Oct 27 01:20:40 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:40.777415 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16c295-1d0b-47ae-bfeb-fa57ab577da9 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:40.786833 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16c295-1d0b-47ae-bfeb-fa57ab577da9 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:40.792858 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ac462-f92c-4269-ad70-29e75c1f5358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:40.793585 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ac462-f92c-4269-ad70-29e75c1f5358 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:40.793836 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ac462-f92c-4269-ad70-29e75c1f5358 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:40.794114 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ac462-f92c-4269-ad70-29e75c1f5358 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:40.794933 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ac462-f92c-4269-ad70-29e75c1f5358 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:40.795244 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ac462-f92c-4269-ad70-29e75c1f5358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:40.796828 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ac462-f92c-4269-ad70-29e75c1f5358 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:40.809127 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 172/340] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:40 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:40.814926 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bdaad7-36dc-4575-a38b-575ab54fede6 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:40.824931 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bdaad7-36dc-4575-a38b-575ab54fede6 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:40.829446 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187e264-a8b2-4f43-bc44-3f6f673c3926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:40.830239 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187e264-a8b2-4f43-bc44-3f6f673c3926 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:40.830585 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187e264-a8b2-4f43-bc44-3f6f673c3926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:40.830856 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187e264-a8b2-4f43-bc44-3f6f673c3926 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:40.840374 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9187e264-a8b2-4f43-bc44-3f6f673c3926 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:40.842198 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9187e264-a8b2-4f43-bc44-3f6f673c3926 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:40.851682 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 169/341] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:40.857821 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ac462-f92c-4269-ad70-29e75c1f5358 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:40.868155 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ac462-f92c-4269-ad70-29e75c1f5358 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:40.874144 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e71499-a48e-4390-a55a-77f1ff00f3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:40.874999 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e71499-a48e-4390-a55a-77f1ff00f3f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:40.875281 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e71499-a48e-4390-a55a-77f1ff00f3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:40.875554 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e71499-a48e-4390-a55a-77f1ff00f3f1 admin admin] PATH_INFO: `/v3/projects/34499f5a2c02434b979288e28f14fe69` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:40.876744 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e71499-a48e-4390-a55a-77f1ff00f3f1 admin admin] RBAC: Authorizing `identity:get_project(project_id=34499f5a2c02434b979288e28f14fe69)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:40.878861 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e71499-a48e-4390-a55a-77f1ff00f3f1 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:40.880517 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 173/342] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:40 2021] GET /identity/v3/projects/34499f5a2c02434b979288e28f14fe69 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:40.887098 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187e264-a8b2-4f43-bc44-3f6f673c3926 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:40.896210 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187e264-a8b2-4f43-bc44-3f6f673c3926 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:40.901059 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbe587-835f-4d6a-bf67-1fdbf5156077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:40.902018 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbe587-835f-4d6a-bf67-1fdbf5156077 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:40.902308 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbe587-835f-4d6a-bf67-1fdbf5156077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:40.902587 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbe587-835f-4d6a-bf67-1fdbf5156077 admin admin] PATH_INFO: `/v3/groups/ee1ac9b1f6e640adadc19b162333a926` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:40.903803 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbe587-835f-4d6a-bf67-1fdbf5156077 admin admin] RBAC: Authorizing `identity:get_group(group_id=ee1ac9b1f6e640adadc19b162333a926)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:40.905804 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbe587-835f-4d6a-bf67-1fdbf5156077 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:40.907708 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 170/343] 10.222.0.25 () {56 vars in 1201 bytes} [Wed Oct 27 01:20:40 2021] GET /identity/v3/groups/ee1ac9b1f6e640adadc19b162333a926 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:40.913956 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e71499-a48e-4390-a55a-77f1ff00f3f1 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:40.924228 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e71499-a48e-4390-a55a-77f1ff00f3f1 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:40.929131 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcae3b-0bc1-4b27-9c7c-fd10bee90ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:40.929920 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcae3b-0bc1-4b27-9c7c-fd10bee90ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:40.930262 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcae3b-0bc1-4b27-9c7c-fd10bee90ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:40.930554 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcae3b-0bc1-4b27-9c7c-fd10bee90ff9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:40.931998 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcae3b-0bc1-4b27-9c7c-fd10bee90ff9 admin admin] RBAC: Adding query filter params (group.id=ee1ac9b1f6e640adadc19b162333a926, role.id=22382371cf4846fe84d1403e3ab1785e, scope.project.id=34499f5a2c02434b979288e28f14fe69) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:40.932341 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcae3b-0bc1-4b27-9c7c-fd10bee90ff9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:40.934625 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcae3b-0bc1-4b27-9c7c-fd10bee90ff9 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:40.941647 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 174/344] 10.222.0.25 () {56 vars in 1397 bytes} [Wed Oct 27 01:20:40 2021] GET /identity/v3/role_assignments?group.id=ee1ac9b1f6e640adadc19b162333a926&scope.project.id=34499f5a2c02434b979288e28f14fe69&role.id=22382371cf4846fe84d1403e3ab1785e => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:41.124708 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c888643-a983-48e3-86eb-333083dbab06 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:41.125037 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c888643-a983-48e3-86eb-333083dbab06 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:41.125320 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c888643-a983-48e3-86eb-333083dbab06 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:41.127168 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 171/345] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:41.133721 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10480f1c-b982-46dd-85bb-ef96f8ad01bc None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:41.134065 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10480f1c-b982-46dd-85bb-ef96f8ad01bc None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:41.134349 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10480f1c-b982-46dd-85bb-ef96f8ad01bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:41.152179 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-10480f1c-b982-46dd-85bb-ef96f8ad01bc None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:41.153365 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-10480f1c-b982-46dd-85bb-ef96f8ad01bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:41.161000 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 175/346] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:41.186442 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c888643-a983-48e3-86eb-333083dbab06 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:41.198537 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c888643-a983-48e3-86eb-333083dbab06 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:41.203713 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b88ad5-d0ad-4cde-b812-0cee551ded64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:41.204498 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b88ad5-d0ad-4cde-b812-0cee551ded64 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:41.204779 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b88ad5-d0ad-4cde-b812-0cee551ded64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:41.205053 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b88ad5-d0ad-4cde-b812-0cee551ded64 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:41.216326 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b88ad5-d0ad-4cde-b812-0cee551ded64 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:41.223296 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-25b88ad5-d0ad-4cde-b812-0cee551ded64 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:20:41.224461 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 172/347] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:20:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:41.231429 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10480f1c-b982-46dd-85bb-ef96f8ad01bc None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:41.240418 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10480f1c-b982-46dd-85bb-ef96f8ad01bc None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:41.245661 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbae29-e5e1-44d7-aee4-7de0551e1aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:41.246324 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbae29-e5e1-44d7-aee4-7de0551e1aea admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:41.246605 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbae29-e5e1-44d7-aee4-7de0551e1aea admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:41.246881 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbae29-e5e1-44d7-aee4-7de0551e1aea admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:41.247634 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbae29-e5e1-44d7-aee4-7de0551e1aea admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:41.247939 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbae29-e5e1-44d7-aee4-7de0551e1aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:41.249610 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbae29-e5e1-44d7-aee4-7de0551e1aea admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:41.258881 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 176/348] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:41.264943 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b88ad5-d0ad-4cde-b812-0cee551ded64 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:41.274649 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b88ad5-d0ad-4cde-b812-0cee551ded64 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:41.279049 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711afd61-6187-4931-9dc4-01d9faa7f92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:41.279682 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711afd61-6187-4931-9dc4-01d9faa7f92d admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:41.279969 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711afd61-6187-4931-9dc4-01d9faa7f92d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:41.280249 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711afd61-6187-4931-9dc4-01d9faa7f92d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:41.288590 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711afd61-6187-4931-9dc4-01d9faa7f92d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:41.290891 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711afd61-6187-4931-9dc4-01d9faa7f92d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:41.299825 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 173/349] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:41 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:41.305827 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbae29-e5e1-44d7-aee4-7de0551e1aea admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:41.315728 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbae29-e5e1-44d7-aee4-7de0551e1aea admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:41.320581 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a38cc-c13f-4047-ab2a-08a16f2febf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:41.322047 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a38cc-c13f-4047-ab2a-08a16f2febf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:41.322337 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a38cc-c13f-4047-ab2a-08a16f2febf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:41.322639 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a38cc-c13f-4047-ab2a-08a16f2febf1 admin admin] PATH_INFO: `/v3/projects/38379d318e5c49acaf4683887f433419` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:41.323903 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a38cc-c13f-4047-ab2a-08a16f2febf1 admin admin] RBAC: Authorizing `identity:get_project(project_id=38379d318e5c49acaf4683887f433419)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:41.325843 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a38cc-c13f-4047-ab2a-08a16f2febf1 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:41.327597 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 177/350] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:20:41 2021] GET /identity/v3/projects/38379d318e5c49acaf4683887f433419 => generated 344 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:41.333644 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711afd61-6187-4931-9dc4-01d9faa7f92d admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:41.343024 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711afd61-6187-4931-9dc4-01d9faa7f92d admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:41.347450 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36460885-f3c9-41c6-816b-7d41ad20623d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:41.348284 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36460885-f3c9-41c6-816b-7d41ad20623d admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:41.348568 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36460885-f3c9-41c6-816b-7d41ad20623d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:41.348844 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36460885-f3c9-41c6-816b-7d41ad20623d admin admin] PATH_INFO: `/v3/groups/c61b6e05a91b45a8821c6b8fcc313832` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:41.350040 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36460885-f3c9-41c6-816b-7d41ad20623d admin admin] RBAC: Authorizing `identity:get_group(group_id=c61b6e05a91b45a8821c6b8fcc313832)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:41.351899 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36460885-f3c9-41c6-816b-7d41ad20623d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:41.353512 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 174/351] 10.222.0.25 () {56 vars in 1201 bytes} [Wed Oct 27 01:20:41 2021] GET /identity/v3/groups/c61b6e05a91b45a8821c6b8fcc313832 => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:41.359567 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a38cc-c13f-4047-ab2a-08a16f2febf1 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:41.369339 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a38cc-c13f-4047-ab2a-08a16f2febf1 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:41.374034 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e68aa-f89c-4e65-b27e-109eba932260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:41.374759 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e68aa-f89c-4e65-b27e-109eba932260 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:41.375000 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e68aa-f89c-4e65-b27e-109eba932260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:41.375284 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e68aa-f89c-4e65-b27e-109eba932260 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:41.376581 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e68aa-f89c-4e65-b27e-109eba932260 admin admin] RBAC: Adding query filter params (group.id=c61b6e05a91b45a8821c6b8fcc313832, role.id=df3a437e6ea14518a9c1b9a348e18c99, scope.project.id=38379d318e5c49acaf4683887f433419) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:41.376921 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e68aa-f89c-4e65-b27e-109eba932260 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:41.378955 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e68aa-f89c-4e65-b27e-109eba932260 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:41.385568 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 178/352] 10.222.0.25 () {56 vars in 1397 bytes} [Wed Oct 27 01:20:41 2021] GET /identity/v3/role_assignments?group.id=c61b6e05a91b45a8821c6b8fcc313832&scope.project.id=38379d318e5c49acaf4683887f433419&role.id=df3a437e6ea14518a9c1b9a348e18c99 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:44.240255 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377fcb0-9aca-4aea-820a-e4fdd00e8b8a None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:44.240758 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377fcb0-9aca-4aea-820a-e4fdd00e8b8a None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:44.240758 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377fcb0-9aca-4aea-820a-e4fdd00e8b8a None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:44.242872 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 175/353] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:44.249397 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04083e33-1217-4db8-87ab-9133f4961f1a None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:44.249934 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04083e33-1217-4db8-87ab-9133f4961f1a None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:44.250007 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04083e33-1217-4db8-87ab-9133f4961f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:44.275800 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-04083e33-1217-4db8-87ab-9133f4961f1a None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:44.277055 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-04083e33-1217-4db8-87ab-9133f4961f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:44.288457 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 179/354] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:44.332293 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377fcb0-9aca-4aea-820a-e4fdd00e8b8a None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:44.351709 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377fcb0-9aca-4aea-820a-e4fdd00e8b8a None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:44.358174 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ffed3-4e41-4355-907d-37535f889a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:44.358984 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ffed3-4e41-4355-907d-37535f889a3c admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:44.359270 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ffed3-4e41-4355-907d-37535f889a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:44.359543 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ffed3-4e41-4355-907d-37535f889a3c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:44.370620 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ffed3-4e41-4355-907d-37535f889a3c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:44.372448 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ffed3-4e41-4355-907d-37535f889a3c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:44.403917 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-805ffed3-4e41-4355-907d-37535f889a3c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:44.405571 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 176/355] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:44.412048 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04083e33-1217-4db8-87ab-9133f4961f1a None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:44.420079 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae9584-2099-4b67-9f93-4e4da5e61197 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:44.420655 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae9584-2099-4b67-9f93-4e4da5e61197 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:44.421140 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae9584-2099-4b67-9f93-4e4da5e61197 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:44.423196 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 177/356] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:20:44.429248 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a12a9-0e9f-4c58-8e16-256e44ca225c None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:44.429799 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a12a9-0e9f-4c58-8e16-256e44ca225c None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:44.429906 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04083e33-1217-4db8-87ab-9133f4961f1a None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:44.430378 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a12a9-0e9f-4c58-8e16-256e44ca225c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:44.447416 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe60df3-8d90-4d0f-93b3-f3bb2a5e43a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:44.448241 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe60df3-8d90-4d0f-93b3-f3bb2a5e43a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:44.448536 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe60df3-8d90-4d0f-93b3-f3bb2a5e43a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:44.448821 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe60df3-8d90-4d0f-93b3-f3bb2a5e43a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:44.449690 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe60df3-8d90-4d0f-93b3-f3bb2a5e43a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:44.450008 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe60df3-8d90-4d0f-93b3-f3bb2a5e43a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:44.451603 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe60df3-8d90-4d0f-93b3-f3bb2a5e43a4 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:44.452203 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-509a12a9-0e9f-4c58-8e16-256e44ca225c None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:44.453696 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-509a12a9-0e9f-4c58-8e16-256e44ca225c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:44.464128 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 180/357] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:44.470338 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe60df3-8d90-4d0f-93b3-f3bb2a5e43a4 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:44.482492 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 178/358] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:44.486260 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe60df3-8d90-4d0f-93b3-f3bb2a5e43a4 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:44.497798 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1998e22-64e4-462f-982f-b15250430216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:44.498709 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1998e22-64e4-462f-982f-b15250430216 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:44.499220 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1998e22-64e4-462f-982f-b15250430216 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:44.499723 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1998e22-64e4-462f-982f-b15250430216 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:44.500643 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1998e22-64e4-462f-982f-b15250430216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:44.501864 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING py.warnings [None req-b1998e22-64e4-462f-982f-b15250430216 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:44.501864 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: warnings.warn(msg) Oct 27 01:20:44.501864 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: Oct 27 01:20:44.503412 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1998e22-64e4-462f-982f-b15250430216 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:44.508876 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a12a9-0e9f-4c58-8e16-256e44ca225c None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:44.519212 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a12a9-0e9f-4c58-8e16-256e44ca225c None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:44.532005 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2538ed5-7a2a-4798-bed9-7c4f3c2e1292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:44.534412 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2538ed5-7a2a-4798-bed9-7c4f3c2e1292 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:44.534911 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2538ed5-7a2a-4798-bed9-7c4f3c2e1292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:44.535194 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2538ed5-7a2a-4798-bed9-7c4f3c2e1292 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:44.538903 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 181/359] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Oct 27 01:20:44 2021] POST /identity/v3/users => generated 246 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:20:44.551341 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2538ed5-7a2a-4798-bed9-7c4f3c2e1292 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:44.553286 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2538ed5-7a2a-4798-bed9-7c4f3c2e1292 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:44.573710 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-d2538ed5-7a2a-4798-bed9-7c4f3c2e1292 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:44.575280 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 179/360] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:20:44.582082 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1998e22-64e4-462f-982f-b15250430216 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:44.597268 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1998e22-64e4-462f-982f-b15250430216 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:44.607276 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3aec6-bf5d-45d3-b2a1-e12755aa13f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:44.608044 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3aec6-bf5d-45d3-b2a1-e12755aa13f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:44.608341 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3aec6-bf5d-45d3-b2a1-e12755aa13f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:44.608674 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3aec6-bf5d-45d3-b2a1-e12755aa13f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:44.609525 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3aec6-bf5d-45d3-b2a1-e12755aa13f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:44.609891 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3aec6-bf5d-45d3-b2a1-e12755aa13f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:44.611582 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3aec6-bf5d-45d3-b2a1-e12755aa13f5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:44.627513 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 182/361] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:44.634158 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2538ed5-7a2a-4798-bed9-7c4f3c2e1292 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:44.644658 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2538ed5-7a2a-4798-bed9-7c4f3c2e1292 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:44.656293 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450878e1-c1d8-4140-b77e-a17509694db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:44.657044 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450878e1-c1d8-4140-b77e-a17509694db4 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:44.657392 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450878e1-c1d8-4140-b77e-a17509694db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:44.657704 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450878e1-c1d8-4140-b77e-a17509694db4 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:44.658500 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450878e1-c1d8-4140-b77e-a17509694db4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:44.660446 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450878e1-c1d8-4140-b77e-a17509694db4 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:44.692700 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 180/362] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Oct 27 01:20:44 2021] POST /identity/v3/users => generated 248 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:44.827983 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36f4d4-2abc-4a83-a17a-a19ecaba656e None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:44.828297 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36f4d4-2abc-4a83-a17a-a19ecaba656e None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:44.828480 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36f4d4-2abc-4a83-a17a-a19ecaba656e None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:44.830349 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 183/363] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:44.837676 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861e764-2a78-49cb-9d4f-d9158241f7e0 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:44.838349 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861e764-2a78-49cb-9d4f-d9158241f7e0 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:44.838835 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861e764-2a78-49cb-9d4f-d9158241f7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:44.865828 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-d861e764-2a78-49cb-9d4f-d9158241f7e0 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:44.867063 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-d861e764-2a78-49cb-9d4f-d9158241f7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:44.878315 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 181/364] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:44.888843 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1035e1-4ae8-4f06-9d71-50cd963f3ed4 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:44.889506 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1035e1-4ae8-4f06-9d71-50cd963f3ed4 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:44.890019 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1035e1-4ae8-4f06-9d71-50cd963f3ed4 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:44.892077 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 184/365] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:44.898972 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37259a7-ea6a-4629-bb0a-05cdf4cb1101 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:44.899264 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37259a7-ea6a-4629-bb0a-05cdf4cb1101 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:44.900328 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37259a7-ea6a-4629-bb0a-05cdf4cb1101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:44.906864 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1035e1-4ae8-4f06-9d71-50cd963f3ed4 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:44.921927 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-b37259a7-ea6a-4629-bb0a-05cdf4cb1101 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:44.923412 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-b37259a7-ea6a-4629-bb0a-05cdf4cb1101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:44.929208 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1035e1-4ae8-4f06-9d71-50cd963f3ed4 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:44.934926 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 182/366] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:44.939083 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601df097-ee47-4a2b-9715-79b277376f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:44.939989 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601df097-ee47-4a2b-9715-79b277376f6a admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:44.940348 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601df097-ee47-4a2b-9715-79b277376f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:44.940701 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601df097-ee47-4a2b-9715-79b277376f6a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:44.952831 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601df097-ee47-4a2b-9715-79b277376f6a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:44.955120 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601df097-ee47-4a2b-9715-79b277376f6a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:44.966605 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37259a7-ea6a-4629-bb0a-05cdf4cb1101 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:44.979148 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37259a7-ea6a-4629-bb0a-05cdf4cb1101 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:44.984195 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-601df097-ee47-4a2b-9715-79b277376f6a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:44.991229 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538bebd1-6a74-4287-9b7d-582d58b9107f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:44.991229 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bebd1-6a74-4287-9b7d-582d58b9107f admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:44.991229 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bebd1-6a74-4287-9b7d-582d58b9107f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:44.991229 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bebd1-6a74-4287-9b7d-582d58b9107f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:44.991587 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 185/367] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:44.993002 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601df097-ee47-4a2b-9715-79b277376f6a admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:45.010441 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601df097-ee47-4a2b-9715-79b277376f6a admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:45.011121 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538bebd1-6a74-4287-9b7d-582d58b9107f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:45.013080 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538bebd1-6a74-4287-9b7d-582d58b9107f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:45.015068 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289982e4-26bf-4e86-b5ab-ebc1733ac367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:45.015736 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289982e4-26bf-4e86-b5ab-ebc1733ac367 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:45.016024 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289982e4-26bf-4e86-b5ab-ebc1733ac367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:45.016305 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289982e4-26bf-4e86-b5ab-ebc1733ac367 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:45.017036 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289982e4-26bf-4e86-b5ab-ebc1733ac367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:45.017348 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289982e4-26bf-4e86-b5ab-ebc1733ac367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:45.018948 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289982e4-26bf-4e86-b5ab-ebc1733ac367 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:45.032031 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 186/368] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:45.035648 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-538bebd1-6a74-4287-9b7d-582d58b9107f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:45.036839 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 183/369] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:45.042819 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289982e4-26bf-4e86-b5ab-ebc1733ac367 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:45.043627 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538bebd1-6a74-4287-9b7d-582d58b9107f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:45.055353 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289982e4-26bf-4e86-b5ab-ebc1733ac367 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:45.055747 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538bebd1-6a74-4287-9b7d-582d58b9107f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:45.061360 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b6ff6-c755-40a4-aac1-d00274e78b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:45.061616 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a42f3-d756-4f49-b412-3e2e802b4674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:45.062057 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b6ff6-c755-40a4-aac1-d00274e78b90 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:45.062343 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b6ff6-c755-40a4-aac1-d00274e78b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:45.062621 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b6ff6-c755-40a4-aac1-d00274e78b90 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:45.062998 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a42f3-d756-4f49-b412-3e2e802b4674 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:45.063386 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b6ff6-c755-40a4-aac1-d00274e78b90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:45.063614 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a42f3-d756-4f49-b412-3e2e802b4674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:45.063735 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b6ff6-c755-40a4-aac1-d00274e78b90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:45.064249 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a42f3-d756-4f49-b412-3e2e802b4674 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:45.064733 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING py.warnings [None req-520b6ff6-c755-40a4-aac1-d00274e78b90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:45.064733 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: warnings.warn(msg) Oct 27 01:20:45.064733 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: Oct 27 01:20:45.065519 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a42f3-d756-4f49-b412-3e2e802b4674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:45.065668 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b6ff6-c755-40a4-aac1-d00274e78b90 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:45.068127 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a42f3-d756-4f49-b412-3e2e802b4674 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:45.092150 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 187/370] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Oct 27 01:20:45 2021] POST /identity/v3/users => generated 248 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:20:45.097665 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 184/371] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:45.099112 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a42f3-d756-4f49-b412-3e2e802b4674 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:45.110827 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a42f3-d756-4f49-b412-3e2e802b4674 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:45.116180 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41918f5e-4f89-4342-9600-ee1e1413142e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:45.117345 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41918f5e-4f89-4342-9600-ee1e1413142e admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:45.117871 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41918f5e-4f89-4342-9600-ee1e1413142e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:45.119079 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41918f5e-4f89-4342-9600-ee1e1413142e admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:45.120040 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41918f5e-4f89-4342-9600-ee1e1413142e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:45.122391 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41918f5e-4f89-4342-9600-ee1e1413142e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:45.145993 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 188/372] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Oct 27 01:20:45 2021] POST /identity/v3/users => generated 249 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:45.833952 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b4ad4-ea23-406e-b205-d205b60e96b7 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:45.834498 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b4ad4-ea23-406e-b205-d205b60e96b7 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:45.834498 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b4ad4-ea23-406e-b205-d205b60e96b7 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:45.836416 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 185/373] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:45.856603 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadce3c-7e04-42f6-9f3e-42664dadfc74 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:45.857116 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadce3c-7e04-42f6-9f3e-42664dadfc74 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:45.857330 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadce3c-7e04-42f6-9f3e-42664dadfc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:45.882440 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-5fadce3c-7e04-42f6-9f3e-42664dadfc74 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:45.883643 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-5fadce3c-7e04-42f6-9f3e-42664dadfc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:45.891933 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 189/374] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:45.943176 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b4ad4-ea23-406e-b205-d205b60e96b7 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:45.957120 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b4ad4-ea23-406e-b205-d205b60e96b7 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:45.967517 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e7979-5ab9-406a-bbe3-52fe5f6a25fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:45.968193 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e7979-5ab9-406a-bbe3-52fe5f6a25fe admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:45.968484 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e7979-5ab9-406a-bbe3-52fe5f6a25fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:45.968761 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e7979-5ab9-406a-bbe3-52fe5f6a25fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:45.969558 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e7979-5ab9-406a-bbe3-52fe5f6a25fe admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:45.971150 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e7979-5ab9-406a-bbe3-52fe5f6a25fe admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:45.982573 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.sql.core [None req-c51e7979-5ab9-406a-bbe3-52fe5f6a25fe admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 27 01:20:45.982573 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 27 01:20:45.982573 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [parameters: {'id': 'd6762934a9764f67afa35ad1073cac8d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 27 01:20:45.982573 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79473) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 01:20:45.996605 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-c51e7979-5ab9-406a-bbe3-52fe5f6a25fe admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 27 01:20:45.999924 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 186/375] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:45 2021] POST /identity/v3/roles => generated 144 bytes in 57 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:46.010991 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadce3c-7e04-42f6-9f3e-42664dadfc74 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:46.020154 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadce3c-7e04-42f6-9f3e-42664dadfc74 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:46.029830 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32767756-8ea7-4e02-b23f-b949819c11a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:46.030641 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32767756-8ea7-4e02-b23f-b949819c11a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:46.030923 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32767756-8ea7-4e02-b23f-b949819c11a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:46.031200 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32767756-8ea7-4e02-b23f-b949819c11a1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:46.048533 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32767756-8ea7-4e02-b23f-b949819c11a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:46.060523 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-32767756-8ea7-4e02-b23f-b949819c11a1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:20:46.061766 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 190/376] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Oct 27 01:20:46 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:46.068400 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e7979-5ab9-406a-bbe3-52fe5f6a25fe admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:46.083904 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e7979-5ab9-406a-bbe3-52fe5f6a25fe admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:46.092552 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb629fb9-df11-4462-b22f-5f420c3f3a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:46.093150 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb629fb9-df11-4462-b22f-5f420c3f3a45 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:46.093439 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb629fb9-df11-4462-b22f-5f420c3f3a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:46.093740 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb629fb9-df11-4462-b22f-5f420c3f3a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:46.094505 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb629fb9-df11-4462-b22f-5f420c3f3a45 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:46.094809 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb629fb9-df11-4462-b22f-5f420c3f3a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:46.096400 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb629fb9-df11-4462-b22f-5f420c3f3a45 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:46.106128 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 187/377] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:46 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:47.341808 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eea873-ee23-40a5-993c-be30bfa54b09 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:47.342802 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eea873-ee23-40a5-993c-be30bfa54b09 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:47.343289 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eea873-ee23-40a5-993c-be30bfa54b09 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:47.345550 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 191/378] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:47 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:47.351587 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612a765-8f4d-4cbb-8236-a4745cbe69c7 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:47.352408 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612a765-8f4d-4cbb-8236-a4745cbe69c7 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:47.353410 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612a765-8f4d-4cbb-8236-a4745cbe69c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:47.378013 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-7612a765-8f4d-4cbb-8236-a4745cbe69c7 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:47.379522 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-7612a765-8f4d-4cbb-8236-a4745cbe69c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:47.391593 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 188/379] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:47.428901 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eea873-ee23-40a5-993c-be30bfa54b09 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:47.446258 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eea873-ee23-40a5-993c-be30bfa54b09 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:47.452006 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee8b0a-ed48-4987-b274-b4db68ca77c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:47.453024 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee8b0a-ed48-4987-b274-b4db68ca77c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:47.453529 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee8b0a-ed48-4987-b274-b4db68ca77c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:47.454027 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee8b0a-ed48-4987-b274-b4db68ca77c8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:47.472738 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee8b0a-ed48-4987-b274-b4db68ca77c8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:47.480770 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-d4ee8b0a-ed48-4987-b274-b4db68ca77c8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:20:47.486253 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 192/380] 10.222.0.25 () {56 vars in 1123 bytes} [Wed Oct 27 01:20:47 2021] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:47.492760 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612a765-8f4d-4cbb-8236-a4745cbe69c7 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:47.502116 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612a765-8f4d-4cbb-8236-a4745cbe69c7 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:47.509518 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5369da-c397-4799-8a18-1d238535c927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:47.510420 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5369da-c397-4799-8a18-1d238535c927 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:47.510904 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5369da-c397-4799-8a18-1d238535c927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:47.511399 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5369da-c397-4799-8a18-1d238535c927 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:47.512366 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5369da-c397-4799-8a18-1d238535c927 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:47.512870 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5369da-c397-4799-8a18-1d238535c927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:47.514693 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5369da-c397-4799-8a18-1d238535c927 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:47.526564 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 189/381] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Oct 27 01:20:47 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:47.532956 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee8b0a-ed48-4987-b274-b4db68ca77c8 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:47.544246 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee8b0a-ed48-4987-b274-b4db68ca77c8 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:47.555767 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3ce9c-9771-4e6a-b0e5-97311796c1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:47.556839 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3ce9c-9771-4e6a-b0e5-97311796c1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:47.557269 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3ce9c-9771-4e6a-b0e5-97311796c1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:47.557708 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3ce9c-9771-4e6a-b0e5-97311796c1e4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:47.573017 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b3ce9c-9771-4e6a-b0e5-97311796c1e4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:47.575243 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b3ce9c-9771-4e6a-b0e5-97311796c1e4 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:47.605078 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-f9b3ce9c-9771-4e6a-b0e5-97311796c1e4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:47.606538 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 193/382] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:47.612766 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5369da-c397-4799-8a18-1d238535c927 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:47.623560 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5369da-c397-4799-8a18-1d238535c927 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:47.636172 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c509b-452b-42c7-8303-e426e4d2cee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:47.637151 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c509b-452b-42c7-8303-e426e4d2cee9 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:47.637657 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c509b-452b-42c7-8303-e426e4d2cee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:47.638135 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c509b-452b-42c7-8303-e426e4d2cee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:47.639088 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c509b-452b-42c7-8303-e426e4d2cee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:47.639591 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c509b-452b-42c7-8303-e426e4d2cee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:47.641384 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c509b-452b-42c7-8303-e426e4d2cee9 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:47.659363 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 190/383] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:47.665467 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3ce9c-9771-4e6a-b0e5-97311796c1e4 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:47.677441 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3ce9c-9771-4e6a-b0e5-97311796c1e4 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:47.704729 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ca500-ec34-42fc-bf5f-ae2cea6287de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:47.705571 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ca500-ec34-42fc-bf5f-ae2cea6287de admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:47.705861 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ca500-ec34-42fc-bf5f-ae2cea6287de admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:47.706140 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ca500-ec34-42fc-bf5f-ae2cea6287de admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:47.720621 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8685b44-3426-4e37-9968-eb20f18bff95 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:47.721132 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ca500-ec34-42fc-bf5f-ae2cea6287de admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:47.721291 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8685b44-3426-4e37-9968-eb20f18bff95 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:47.721667 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8685b44-3426-4e37-9968-eb20f18bff95 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:47.723710 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 191/384] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:20:47.723995 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ca500-ec34-42fc-bf5f-ae2cea6287de admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:47.730690 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c1f50-f0d5-4c54-b9ef-daff0fcabeaa None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:47.731233 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c1f50-f0d5-4c54-b9ef-daff0fcabeaa None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:47.731763 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c1f50-f0d5-4c54-b9ef-daff0fcabeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:47.744408 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-d47ca500-ec34-42fc-bf5f-ae2cea6287de admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:20:47.745497 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 194/385] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Oct 27 01:20:47 2021] GET /identity/v3/users/nova => generated 82 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:47.755081 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ca500-ec34-42fc-bf5f-ae2cea6287de admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:47.763023 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-587c1f50-f0d5-4c54-b9ef-daff0fcabeaa None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:47.764456 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-587c1f50-f0d5-4c54-b9ef-daff0fcabeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:47.774531 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ca500-ec34-42fc-bf5f-ae2cea6287de admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:47.779074 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 192/386] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:47.782945 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b66b5-37c2-497b-8184-9edb3330539e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:47.783836 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b66b5-37c2-497b-8184-9edb3330539e admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:47.784320 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b66b5-37c2-497b-8184-9edb3330539e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:47.784794 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b66b5-37c2-497b-8184-9edb3330539e admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:47.785918 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b66b5-37c2-497b-8184-9edb3330539e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:47.786443 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b66b5-37c2-497b-8184-9edb3330539e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:47.787634 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING py.warnings [None req-935b66b5-37c2-497b-8184-9edb3330539e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:47.787634 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: warnings.warn(msg) Oct 27 01:20:47.787634 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: Oct 27 01:20:47.789089 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b66b5-37c2-497b-8184-9edb3330539e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:47.812570 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c1f50-f0d5-4c54-b9ef-daff0fcabeaa None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:47.822128 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c1f50-f0d5-4c54-b9ef-daff0fcabeaa None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:47.829752 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600c4c4-b809-4adb-ae09-72d190a4bd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:47.830649 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600c4c4-b809-4adb-ae09-72d190a4bd53 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:47.830940 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600c4c4-b809-4adb-ae09-72d190a4bd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:47.831218 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600c4c4-b809-4adb-ae09-72d190a4bd53 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:47.842041 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600c4c4-b809-4adb-ae09-72d190a4bd53 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:47.849223 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 195/387] 10.222.0.25 () {56 vars in 1154 bytes} [Wed Oct 27 01:20:47 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:47.849444 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-0600c4c4-b809-4adb-ae09-72d190a4bd53 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:20:47.854319 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 193/388] 10.222.0.25 () {56 vars in 1123 bytes} [Wed Oct 27 01:20:47 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:47.854469 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7569a7-2fb5-4407-af8f-58621d95d509 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:47.854469 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7569a7-2fb5-4407-af8f-58621d95d509 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:47.856542 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600c4c4-b809-4adb-ae09-72d190a4bd53 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:47.856666 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7569a7-2fb5-4407-af8f-58621d95d509 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:47.861782 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 196/389] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:47 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:47.862981 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7569a7-2fb5-4407-af8f-58621d95d509 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:47.872683 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600c4c4-b809-4adb-ae09-72d190a4bd53 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:47.878836 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543d02e-4009-4931-ab16-ac6e13a896e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:47.879868 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543d02e-4009-4931-ab16-ac6e13a896e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:47.880158 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543d02e-4009-4931-ab16-ac6e13a896e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:47.880978 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543d02e-4009-4931-ab16-ac6e13a896e5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:47.881992 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7569a7-2fb5-4407-af8f-58621d95d509 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:47.888514 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13beffd-8517-4fe8-b17c-865e9821c301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:47.889407 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13beffd-8517-4fe8-b17c-865e9821c301 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:47.889944 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13beffd-8517-4fe8-b17c-865e9821c301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:47.890985 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13beffd-8517-4fe8-b17c-865e9821c301 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:47.892236 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13beffd-8517-4fe8-b17c-865e9821c301 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:47.892657 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543d02e-4009-4931-ab16-ac6e13a896e5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:47.892955 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13beffd-8517-4fe8-b17c-865e9821c301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:47.894581 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543d02e-4009-4931-ab16-ac6e13a896e5 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:47.895008 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13beffd-8517-4fe8-b17c-865e9821c301 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:47.904522 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 194/390] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:47 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:47.905010 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 197/391] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Oct 27 01:20:47 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:47.909592 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe55d1-e774-436f-ad7d-69a6e04d76f5 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:47.909592 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe55d1-e774-436f-ad7d-69a6e04d76f5 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:47.909592 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe55d1-e774-436f-ad7d-69a6e04d76f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:47.910906 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13beffd-8517-4fe8-b17c-865e9821c301 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:47.923963 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13beffd-8517-4fe8-b17c-865e9821c301 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:47.927139 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-c1fe55d1-e774-436f-ad7d-69a6e04d76f5 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:47.928462 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-c1fe55d1-e774-436f-ad7d-69a6e04d76f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:47.928949 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4673547-e15f-402e-884b-c12551ce3cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:47.930032 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4673547-e15f-402e-884b-c12551ce3cea admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:47.930600 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4673547-e15f-402e-884b-c12551ce3cea admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:47.931707 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4673547-e15f-402e-884b-c12551ce3cea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:47.937985 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 195/392] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:47.938900 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe55d1-e774-436f-ad7d-69a6e04d76f5 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:47.944244 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4673547-e15f-402e-884b-c12551ce3cea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:47.946436 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4673547-e15f-402e-884b-c12551ce3cea admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:47.959766 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe55d1-e774-436f-ad7d-69a6e04d76f5 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:47.966457 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-c4673547-e15f-402e-884b-c12551ce3cea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:47.968283 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 198/393] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:47.969133 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c5af2-e97c-4e26-8176-9c5da49f2570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:47.970550 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c5af2-e97c-4e26-8176-9c5da49f2570 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:47.970550 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c5af2-e97c-4e26-8176-9c5da49f2570 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:47.970706 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c5af2-e97c-4e26-8176-9c5da49f2570 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:47.979265 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4673547-e15f-402e-884b-c12551ce3cea admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:47.991954 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c5af2-e97c-4e26-8176-9c5da49f2570 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:47.993915 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c5af2-e97c-4e26-8176-9c5da49f2570 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:47.999153 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4673547-e15f-402e-884b-c12551ce3cea admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.003916 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee84c8-f96a-4e8f-9e77-70695350c029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.004577 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee84c8-f96a-4e8f-9e77-70695350c029 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.004860 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee84c8-f96a-4e8f-9e77-70695350c029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.005132 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee84c8-f96a-4e8f-9e77-70695350c029 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.005901 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee84c8-f96a-4e8f-9e77-70695350c029 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:48.006205 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee84c8-f96a-4e8f-9e77-70695350c029 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.007777 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee84c8-f96a-4e8f-9e77-70695350c029 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.016800 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-ae8c5af2-e97c-4e26-8176-9c5da49f2570 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:48.018327 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 196/394] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:48.021568 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 199/395] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:48.023752 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee84c8-f96a-4e8f-9e77-70695350c029 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.026745 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c5af2-e97c-4e26-8176-9c5da49f2570 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.036783 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee84c8-f96a-4e8f-9e77-70695350c029 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.037778 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c5af2-e97c-4e26-8176-9c5da49f2570 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.041896 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0c2f2-7f26-4304-b26e-adf4f366cbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.042682 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0c2f2-7f26-4304-b26e-adf4f366cbdc admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.042966 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0c2f2-7f26-4304-b26e-adf4f366cbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.043240 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0c2f2-7f26-4304-b26e-adf4f366cbdc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.044859 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06110b29-5f19-4450-b28f-0e5391870a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.045787 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06110b29-5f19-4450-b28f-0e5391870a9a admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.046302 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06110b29-5f19-4450-b28f-0e5391870a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.046853 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06110b29-5f19-4450-b28f-0e5391870a9a admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.047882 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06110b29-5f19-4450-b28f-0e5391870a9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:48.048726 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06110b29-5f19-4450-b28f-0e5391870a9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.050925 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06110b29-5f19-4450-b28f-0e5391870a9a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.053952 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0c2f2-7f26-4304-b26e-adf4f366cbdc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:48.062281 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-16f0c2f2-7f26-4304-b26e-adf4f366cbdc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:20:48.063795 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 200/396] 10.222.0.25 () {56 vars in 1123 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:48.064583 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0c2f2-7f26-4304-b26e-adf4f366cbdc admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.067990 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 197/397] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:48.074100 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06110b29-5f19-4450-b28f-0e5391870a9a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.074414 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0c2f2-7f26-4304-b26e-adf4f366cbdc admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.079114 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e20c0e-e50a-4e62-80b7-321c822138e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.079890 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e20c0e-e50a-4e62-80b7-321c822138e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.080168 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e20c0e-e50a-4e62-80b7-321c822138e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.080448 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e20c0e-e50a-4e62-80b7-321c822138e2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.086916 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06110b29-5f19-4450-b28f-0e5391870a9a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.088189 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e20c0e-e50a-4e62-80b7-321c822138e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.090185 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e20c0e-e50a-4e62-80b7-321c822138e2 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.092412 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4a870-b49a-4a94-b602-55da64acd689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.093369 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4a870-b49a-4a94-b602-55da64acd689 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.093888 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4a870-b49a-4a94-b602-55da64acd689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.094361 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4a870-b49a-4a94-b602-55da64acd689 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.095470 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4a870-b49a-4a94-b602-55da64acd689 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:48.095987 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4a870-b49a-4a94-b602-55da64acd689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.097976 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4a870-b49a-4a94-b602-55da64acd689 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.103834 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-f5e20c0e-e50a-4e62-80b7-321c822138e2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:20:48.105003 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 201/398] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:48.108233 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 198/399] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:48.110769 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e20c0e-e50a-4e62-80b7-321c822138e2 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.111901 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4a870-b49a-4a94-b602-55da64acd689 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.121370 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e20c0e-e50a-4e62-80b7-321c822138e2 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.123763 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4a870-b49a-4a94-b602-55da64acd689 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.126163 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83059ab0-75bf-41b4-a385-d01ac830ea47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.126976 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83059ab0-75bf-41b4-a385-d01ac830ea47 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.127351 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83059ab0-75bf-41b4-a385-d01ac830ea47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.127664 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83059ab0-75bf-41b4-a385-d01ac830ea47 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.130166 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855dcbcf-2972-4d1b-b3cc-8bbe70a33ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.131124 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dcbcf-2972-4d1b-b3cc-8bbe70a33ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.131620 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dcbcf-2972-4d1b-b3cc-8bbe70a33ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.132095 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dcbcf-2972-4d1b-b3cc-8bbe70a33ff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.133124 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855dcbcf-2972-4d1b-b3cc-8bbe70a33ff5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:48.133734 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855dcbcf-2972-4d1b-b3cc-8bbe70a33ff5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.135007 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING py.warnings [None req-855dcbcf-2972-4d1b-b3cc-8bbe70a33ff5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:48.135007 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: warnings.warn(msg) Oct 27 01:20:48.135007 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: Oct 27 01:20:48.136492 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855dcbcf-2972-4d1b-b3cc-8bbe70a33ff5 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.137150 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83059ab0-75bf-41b4-a385-d01ac830ea47 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.139361 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83059ab0-75bf-41b4-a385-d01ac830ea47 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.154240 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-83059ab0-75bf-41b4-a385-d01ac830ea47 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 27 01:20:48.155428 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 202/400] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/users/glance => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:48.156232 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83059ab0-75bf-41b4-a385-d01ac830ea47 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.157601 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 199/401] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:48.169541 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855dcbcf-2972-4d1b-b3cc-8bbe70a33ff5 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.173889 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83059ab0-75bf-41b4-a385-d01ac830ea47 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.178601 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bf0d6-d045-4eaa-9528-7d2298354d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.179485 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855dcbcf-2972-4d1b-b3cc-8bbe70a33ff5 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.180049 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bf0d6-d045-4eaa-9528-7d2298354d3c admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.180572 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bf0d6-d045-4eaa-9528-7d2298354d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.180988 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bf0d6-d045-4eaa-9528-7d2298354d3c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.184623 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af022e0-54a3-460f-902f-a792c7e918e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.185336 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af022e0-54a3-460f-902f-a792c7e918e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.185735 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af022e0-54a3-460f-902f-a792c7e918e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.186087 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af022e0-54a3-460f-902f-a792c7e918e0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.186993 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af022e0-54a3-460f-902f-a792c7e918e0 admin admin] RBAC: Adding query filter params (role.id=983c0291e0fa484ea053a791ead0e9c5, scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6, user.id=b2f8304b85b64dc4ac58523897306660) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:48.187379 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af022e0-54a3-460f-902f-a792c7e918e0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.189332 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af022e0-54a3-460f-902f-a792c7e918e0 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.194283 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bf0d6-d045-4eaa-9528-7d2298354d3c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.195292 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 200/402] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/role_assignments?user.id=b2f8304b85b64dc4ac58523897306660&scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6&role.id=983c0291e0fa484ea053a791ead0e9c5 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:48.201513 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af022e0-54a3-460f-902f-a792c7e918e0 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.201713 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bf0d6-d045-4eaa-9528-7d2298354d3c admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.220788 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af022e0-54a3-460f-902f-a792c7e918e0 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.231764 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-6d5bf0d6-d045-4eaa-9528-7d2298354d3c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:48.236851 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99627478-6082-4fff-81c0-53613f77786f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.237555 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99627478-6082-4fff-81c0-53613f77786f admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.237845 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99627478-6082-4fff-81c0-53613f77786f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.238126 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99627478-6082-4fff-81c0-53613f77786f admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.239004 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99627478-6082-4fff-81c0-53613f77786f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:48.239319 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99627478-6082-4fff-81c0-53613f77786f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.240362 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING py.warnings [None req-99627478-6082-4fff-81c0-53613f77786f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:48.240362 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: warnings.warn(msg) Oct 27 01:20:48.240362 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: Oct 27 01:20:48.241558 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99627478-6082-4fff-81c0-53613f77786f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.244552 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 203/403] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:48.245648 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bf0d6-d045-4eaa-9528-7d2298354d3c admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.265404 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bf0d6-d045-4eaa-9528-7d2298354d3c admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.270394 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de3361-c257-4447-8556-eb01eaf45019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.271112 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de3361-c257-4447-8556-eb01eaf45019 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.271430 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de3361-c257-4447-8556-eb01eaf45019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.271718 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de3361-c257-4447-8556-eb01eaf45019 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.272524 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de3361-c257-4447-8556-eb01eaf45019 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:48.272837 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de3361-c257-4447-8556-eb01eaf45019 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.275136 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de3361-c257-4447-8556-eb01eaf45019 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.289466 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 204/404] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:48.303776 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de3361-c257-4447-8556-eb01eaf45019 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.307175 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 201/405] 10.222.0.25 () {56 vars in 1158 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:48.318039 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99627478-6082-4fff-81c0-53613f77786f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.327866 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de3361-c257-4447-8556-eb01eaf45019 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.329023 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99627478-6082-4fff-81c0-53613f77786f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.333993 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ae62b-46ac-41ee-914d-b167322702c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.334252 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f1bfd-8af8-48da-a4de-7f260b9b198c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.334837 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f1bfd-8af8-48da-a4de-7f260b9b198c admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.334978 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ae62b-46ac-41ee-914d-b167322702c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.335121 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f1bfd-8af8-48da-a4de-7f260b9b198c admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.335404 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f1bfd-8af8-48da-a4de-7f260b9b198c admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.335563 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ae62b-46ac-41ee-914d-b167322702c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.335973 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ae62b-46ac-41ee-914d-b167322702c8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.346660 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ae62b-46ac-41ee-914d-b167322702c8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.348744 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ae62b-46ac-41ee-914d-b167322702c8 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.354875 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f1bfd-8af8-48da-a4de-7f260b9b198c admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.357024 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f1bfd-8af8-48da-a4de-7f260b9b198c admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.360443 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 202/406] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:20:48.368965 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ae62b-46ac-41ee-914d-b167322702c8 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.378764 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ae62b-46ac-41ee-914d-b167322702c8 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.384663 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd45a9-45b2-463c-bf66-17654d85f0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.385934 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd45a9-45b2-463c-bf66-17654d85f0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.386421 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd45a9-45b2-463c-bf66-17654d85f0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.386903 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd45a9-45b2-463c-bf66-17654d85f0b5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.398505 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd45a9-45b2-463c-bf66-17654d85f0b5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.398696 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-e83f1bfd-8af8-48da-a4de-7f260b9b198c admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 01:20:48.400696 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 205/407] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/users/cinder => generated 84 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:20:48.401774 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd45a9-45b2-463c-bf66-17654d85f0b5 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.408808 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f1bfd-8af8-48da-a4de-7f260b9b198c admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.423985 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f1bfd-8af8-48da-a4de-7f260b9b198c admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.427566 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-c2fd45a9-45b2-463c-bf66-17654d85f0b5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:48.429093 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 203/408] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:48.429200 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5e90c-5a4e-4569-a1e4-fe07ac3f95e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.434804 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5e90c-5a4e-4569-a1e4-fe07ac3f95e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.434804 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5e90c-5a4e-4569-a1e4-fe07ac3f95e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.434804 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5e90c-5a4e-4569-a1e4-fe07ac3f95e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.434804 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5e90c-5a4e-4569-a1e4-fe07ac3f95e4 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:48.434804 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5e90c-5a4e-4569-a1e4-fe07ac3f95e4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.434804 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5e90c-5a4e-4569-a1e4-fe07ac3f95e4 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.436439 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd45a9-45b2-463c-bf66-17654d85f0b5 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.453434 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 206/409] 10.222.0.25 () {56 vars in 1158 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:48.455998 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd45a9-45b2-463c-bf66-17654d85f0b5 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.461179 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564c845-aa0d-4a25-840e-45278c6cd804 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.462312 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564c845-aa0d-4a25-840e-45278c6cd804 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.462840 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564c845-aa0d-4a25-840e-45278c6cd804 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.463969 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538d6d0-b1fa-4ca6-a326-32bf8dbf3221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.464658 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538d6d0-b1fa-4ca6-a326-32bf8dbf3221 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.464764 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 207/410] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:48 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:48.465133 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538d6d0-b1fa-4ca6-a326-32bf8dbf3221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.465304 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538d6d0-b1fa-4ca6-a326-32bf8dbf3221 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.465514 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564c845-aa0d-4a25-840e-45278c6cd804 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.466044 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538d6d0-b1fa-4ca6-a326-32bf8dbf3221 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:48.466554 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538d6d0-b1fa-4ca6-a326-32bf8dbf3221 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.468357 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538d6d0-b1fa-4ca6-a326-32bf8dbf3221 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.479919 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564c845-aa0d-4a25-840e-45278c6cd804 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.482967 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 204/411] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:48.484392 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620e4e0-0611-4221-8a5a-3e98a8a0b4e6 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.484771 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620e4e0-0611-4221-8a5a-3e98a8a0b4e6 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.485128 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620e4e0-0611-4221-8a5a-3e98a8a0b4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.493607 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a61fee-9847-4094-8ebf-d6d882c207fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.493607 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a61fee-9847-4094-8ebf-d6d882c207fa admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.493607 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a61fee-9847-4094-8ebf-d6d882c207fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.493607 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a61fee-9847-4094-8ebf-d6d882c207fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.503478 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-6620e4e0-0611-4221-8a5a-3e98a8a0b4e6 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:48.504806 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-6620e4e0-0611-4221-8a5a-3e98a8a0b4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:48.505513 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a61fee-9847-4094-8ebf-d6d882c207fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.507453 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a61fee-9847-4094-8ebf-d6d882c207fa admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.513858 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 205/412] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:48.517588 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620e4e0-0611-4221-8a5a-3e98a8a0b4e6 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.524117 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620e4e0-0611-4221-8a5a-3e98a8a0b4e6 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.524979 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 208/413] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:48.531263 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a61fee-9847-4094-8ebf-d6d882c207fa admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.540502 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd1e30-7374-47da-a656-037305782033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.541773 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd1e30-7374-47da-a656-037305782033 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.543878 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a61fee-9847-4094-8ebf-d6d882c207fa admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.544349 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd1e30-7374-47da-a656-037305782033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.545457 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd1e30-7374-47da-a656-037305782033 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.555776 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd1e30-7374-47da-a656-037305782033 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.556566 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f00629-661d-4c8d-aac6-c65224a56e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.557573 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f00629-661d-4c8d-aac6-c65224a56e29 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.558288 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f00629-661d-4c8d-aac6-c65224a56e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.558764 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f00629-661d-4c8d-aac6-c65224a56e29 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.560469 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd1e30-7374-47da-a656-037305782033 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.569624 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f00629-661d-4c8d-aac6-c65224a56e29 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.572161 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f00629-661d-4c8d-aac6-c65224a56e29 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.577752 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-eefd1e30-7374-47da-a656-037305782033 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:20:48.584259 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 206/414] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:48.584259 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd1e30-7374-47da-a656-037305782033 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.592017 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd1e30-7374-47da-a656-037305782033 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.596361 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-f6f00629-661d-4c8d-aac6-c65224a56e29 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:48.596875 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed44f2d-e069-4314-b216-7f736ab712e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.597903 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed44f2d-e069-4314-b216-7f736ab712e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.598386 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed44f2d-e069-4314-b216-7f736ab712e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.598543 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 209/415] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:48.599555 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f00629-661d-4c8d-aac6-c65224a56e29 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.601713 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed44f2d-e069-4314-b216-7f736ab712e9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.612705 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f00629-661d-4c8d-aac6-c65224a56e29 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.617629 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837de98b-e63f-4720-8d03-fc62a49f34c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.618060 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed44f2d-e069-4314-b216-7f736ab712e9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:48.618617 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837de98b-e63f-4720-8d03-fc62a49f34c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.619050 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837de98b-e63f-4720-8d03-fc62a49f34c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.619497 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837de98b-e63f-4720-8d03-fc62a49f34c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.620472 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837de98b-e63f-4720-8d03-fc62a49f34c0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:48.620961 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837de98b-e63f-4720-8d03-fc62a49f34c0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.622185 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING py.warnings [None req-837de98b-e63f-4720-8d03-fc62a49f34c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:48.622185 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: warnings.warn(msg) Oct 27 01:20:48.622185 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: Oct 27 01:20:48.623690 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837de98b-e63f-4720-8d03-fc62a49f34c0 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.626502 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-6ed44f2d-e069-4314-b216-7f736ab712e9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:20:48.628410 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 207/416] 10.222.0.25 () {56 vars in 1123 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:48.629302 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed44f2d-e069-4314-b216-7f736ab712e9 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.641263 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed44f2d-e069-4314-b216-7f736ab712e9 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.643783 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 210/417] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:48.649974 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837de98b-e63f-4720-8d03-fc62a49f34c0 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.650098 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144d6ea-4c43-4c35-8dda-923d17a697fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.650098 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144d6ea-4c43-4c35-8dda-923d17a697fe admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.650098 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144d6ea-4c43-4c35-8dda-923d17a697fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.650098 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144d6ea-4c43-4c35-8dda-923d17a697fe admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.650392 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c144d6ea-4c43-4c35-8dda-923d17a697fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:48.650392 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c144d6ea-4c43-4c35-8dda-923d17a697fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.652212 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c144d6ea-4c43-4c35-8dda-923d17a697fe admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.661316 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837de98b-e63f-4720-8d03-fc62a49f34c0 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.666558 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d89909-213a-492a-b441-01729331f4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.667572 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 208/418] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:48.667920 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d89909-213a-492a-b441-01729331f4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.668409 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d89909-213a-492a-b441-01729331f4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.668920 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d89909-213a-492a-b441-01729331f4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.670123 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d89909-213a-492a-b441-01729331f4c8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:48.670650 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d89909-213a-492a-b441-01729331f4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.672478 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d89909-213a-492a-b441-01729331f4c8 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.673187 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144d6ea-4c43-4c35-8dda-923d17a697fe admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.681883 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 211/419] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:48.683237 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d89909-213a-492a-b441-01729331f4c8 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.685146 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144d6ea-4c43-4c35-8dda-923d17a697fe admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.690705 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f0cb2-42bc-4902-acdf-aa10c1877416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.691366 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f0cb2-42bc-4902-acdf-aa10c1877416 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.691838 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f0cb2-42bc-4902-acdf-aa10c1877416 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.692351 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f0cb2-42bc-4902-acdf-aa10c1877416 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.693206 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f0cb2-42bc-4902-acdf-aa10c1877416 admin admin] RBAC: Adding query filter params (role.id=983c0291e0fa484ea053a791ead0e9c5, scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6, user.id=32003a40693246d08640bc7ec45adfc2) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:48.693589 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f0cb2-42bc-4902-acdf-aa10c1877416 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.695038 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d89909-213a-492a-b441-01729331f4c8 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.695615 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f0cb2-42bc-4902-acdf-aa10c1877416 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.700879 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f066bc-7144-4a68-87e6-b7bf5420d8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.702013 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f066bc-7144-4a68-87e6-b7bf5420d8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.702579 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f066bc-7144-4a68-87e6-b7bf5420d8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.703241 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 209/420] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/role_assignments?user.id=32003a40693246d08640bc7ec45adfc2&scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6&role.id=983c0291e0fa484ea053a791ead0e9c5 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:48.703694 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f066bc-7144-4a68-87e6-b7bf5420d8d6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.709549 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f0cb2-42bc-4902-acdf-aa10c1877416 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.715503 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f0cb2-42bc-4902-acdf-aa10c1877416 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.725527 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d58b1b-cc4e-4440-b37c-9f9d859e619f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.725527 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d58b1b-cc4e-4440-b37c-9f9d859e619f admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.725527 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d58b1b-cc4e-4440-b37c-9f9d859e619f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.725527 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d58b1b-cc4e-4440-b37c-9f9d859e619f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.727473 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f066bc-7144-4a68-87e6-b7bf5420d8d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.729811 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f066bc-7144-4a68-87e6-b7bf5420d8d6 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.734471 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d58b1b-cc4e-4440-b37c-9f9d859e619f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.736993 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d58b1b-cc4e-4440-b37c-9f9d859e619f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.753812 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-a3f066bc-7144-4a68-87e6-b7bf5420d8d6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:20:48.755385 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 212/421] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:48.761686 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-58d58b1b-cc4e-4440-b37c-9f9d859e619f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:48.764272 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 210/422] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:48.764761 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f066bc-7144-4a68-87e6-b7bf5420d8d6 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.770096 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d58b1b-cc4e-4440-b37c-9f9d859e619f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.783273 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d58b1b-cc4e-4440-b37c-9f9d859e619f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.786077 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f066bc-7144-4a68-87e6-b7bf5420d8d6 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.788384 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefaf9d-f819-41d0-9549-a890e4edc8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.789190 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefaf9d-f819-41d0-9549-a890e4edc8cb admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.789503 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefaf9d-f819-41d0-9549-a890e4edc8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.789818 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefaf9d-f819-41d0-9549-a890e4edc8cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.790586 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefaf9d-f819-41d0-9549-a890e4edc8cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:48.790944 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefaf9d-f819-41d0-9549-a890e4edc8cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.792594 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefaf9d-f819-41d0-9549-a890e4edc8cb admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.799185 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ab3c8-3275-46af-90dc-cf2e51b4d20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.800225 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ab3c8-3275-46af-90dc-cf2e51b4d20b admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.800639 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ab3c8-3275-46af-90dc-cf2e51b4d20b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.801034 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ab3c8-3275-46af-90dc-cf2e51b4d20b admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.801991 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ab3c8-3275-46af-90dc-cf2e51b4d20b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:48.802409 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ab3c8-3275-46af-90dc-cf2e51b4d20b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.804367 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ab3c8-3275-46af-90dc-cf2e51b4d20b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.806421 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 211/423] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:48.812911 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefaf9d-f819-41d0-9549-a890e4edc8cb admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.823877 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefaf9d-f819-41d0-9549-a890e4edc8cb admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.829005 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044b39d-6fd2-4ab6-af3e-9586dbf7cee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.830261 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044b39d-6fd2-4ab6-af3e-9586dbf7cee1 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.830716 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044b39d-6fd2-4ab6-af3e-9586dbf7cee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.831213 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044b39d-6fd2-4ab6-af3e-9586dbf7cee1 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.832044 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 213/424] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:48.840056 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ab3c8-3275-46af-90dc-cf2e51b4d20b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.842528 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044b39d-6fd2-4ab6-af3e-9586dbf7cee1 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.848184 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044b39d-6fd2-4ab6-af3e-9586dbf7cee1 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.860594 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ab3c8-3275-46af-90dc-cf2e51b4d20b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.873152 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f85fa-a38f-4416-9f4a-c53503919a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.874203 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f85fa-a38f-4416-9f4a-c53503919a26 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.874659 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f85fa-a38f-4416-9f4a-c53503919a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.875104 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f85fa-a38f-4416-9f4a-c53503919a26 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.876181 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f85fa-a38f-4416-9f4a-c53503919a26 admin admin] RBAC: Adding query filter params (role.id=983c0291e0fa484ea053a791ead0e9c5, scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6, user.id=1819142aab4743fbb9e056ba61e3d474) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:48.876667 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f85fa-a38f-4416-9f4a-c53503919a26 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.878973 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-4044b39d-6fd2-4ab6-af3e-9586dbf7cee1 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 01:20:48.880892 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f85fa-a38f-4416-9f4a-c53503919a26 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.882906 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 212/425] 10.222.0.25 () {56 vars in 1123 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/users/neutron => generated 85 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:20:48.890442 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044b39d-6fd2-4ab6-af3e-9586dbf7cee1 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.901044 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 214/426] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/role_assignments?user.id=1819142aab4743fbb9e056ba61e3d474&scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6&role.id=983c0291e0fa484ea053a791ead0e9c5 => generated 259 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:48.908324 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044b39d-6fd2-4ab6-af3e-9586dbf7cee1 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.913642 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c852f-d07d-4ad9-aab1-d9755185642a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.914663 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c852f-d07d-4ad9-aab1-d9755185642a admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.915190 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c852f-d07d-4ad9-aab1-d9755185642a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.915636 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c852f-d07d-4ad9-aab1-d9755185642a admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.916690 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c852f-d07d-4ad9-aab1-d9755185642a admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:48.917208 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c852f-d07d-4ad9-aab1-d9755185642a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.919367 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c852f-d07d-4ad9-aab1-d9755185642a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.950505 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 213/427] 10.222.0.25 () {56 vars in 1160 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:48.957913 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f85fa-a38f-4416-9f4a-c53503919a26 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.983378 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f85fa-a38f-4416-9f4a-c53503919a26 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.990366 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1816c6-dc70-42dc-bcf6-87d494434c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.991415 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1816c6-dc70-42dc-bcf6-87d494434c65 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.991872 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1816c6-dc70-42dc-bcf6-87d494434c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.992326 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1816c6-dc70-42dc-bcf6-87d494434c65 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:49.009619 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1816c6-dc70-42dc-bcf6-87d494434c65 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:49.011624 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1816c6-dc70-42dc-bcf6-87d494434c65 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:49.023094 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 215/428] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:48 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:49.029668 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c852f-d07d-4ad9-aab1-d9755185642a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:49.044252 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c852f-d07d-4ad9-aab1-d9755185642a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:49.059675 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56bd87-3f03-432f-8600-fcbd143365c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:49.060791 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56bd87-3f03-432f-8600-fcbd143365c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:49.061275 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56bd87-3f03-432f-8600-fcbd143365c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:49.061767 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56bd87-3f03-432f-8600-fcbd143365c3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:49.082042 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab56bd87-3f03-432f-8600-fcbd143365c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:49.084250 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab56bd87-3f03-432f-8600-fcbd143365c3 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:49.112234 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-ab56bd87-3f03-432f-8600-fcbd143365c3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:49.114164 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 214/429] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:49.120819 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1816c6-dc70-42dc-bcf6-87d494434c65 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:49.133226 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1816c6-dc70-42dc-bcf6-87d494434c65 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:49.141647 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c4f70-c713-43d6-a598-4cb76f61db4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:49.142316 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c4f70-c713-43d6-a598-4cb76f61db4e admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:49.142601 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c4f70-c713-43d6-a598-4cb76f61db4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:49.142878 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c4f70-c713-43d6-a598-4cb76f61db4e admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:49.143675 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c4f70-c713-43d6-a598-4cb76f61db4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:49.143989 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c4f70-c713-43d6-a598-4cb76f61db4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:49.145612 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c4f70-c713-43d6-a598-4cb76f61db4e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:49.161025 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 216/430] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:49.167401 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56bd87-3f03-432f-8600-fcbd143365c3 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:49.177350 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56bd87-3f03-432f-8600-fcbd143365c3 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:49.182347 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf4e51-c19f-4958-bad6-e18e13f59694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:49.183681 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf4e51-c19f-4958-bad6-e18e13f59694 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:49.184180 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf4e51-c19f-4958-bad6-e18e13f59694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:49.184644 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf4e51-c19f-4958-bad6-e18e13f59694 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:49.192734 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf4e51-c19f-4958-bad6-e18e13f59694 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:49.195123 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf4e51-c19f-4958-bad6-e18e13f59694 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:49.217657 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-7bcf4e51-c19f-4958-bad6-e18e13f59694 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:20:49.219358 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 215/431] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:49.225912 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c4f70-c713-43d6-a598-4cb76f61db4e admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:49.236787 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c4f70-c713-43d6-a598-4cb76f61db4e admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:49.241672 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d7bb8-98e0-4254-a3da-110ff7402cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:49.242608 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d7bb8-98e0-4254-a3da-110ff7402cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:49.243191 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d7bb8-98e0-4254-a3da-110ff7402cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:49.243659 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d7bb8-98e0-4254-a3da-110ff7402cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:49.244691 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d7bb8-98e0-4254-a3da-110ff7402cd9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:49.245190 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d7bb8-98e0-4254-a3da-110ff7402cd9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:49.247389 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d7bb8-98e0-4254-a3da-110ff7402cd9 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:49.261172 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 217/432] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:20:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:49.267684 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf4e51-c19f-4958-bad6-e18e13f59694 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:49.283787 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf4e51-c19f-4958-bad6-e18e13f59694 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:49.290902 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdaa55c-7d88-4a59-9b87-a7021ae09121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:49.291828 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdaa55c-7d88-4a59-9b87-a7021ae09121 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:49.292417 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdaa55c-7d88-4a59-9b87-a7021ae09121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:49.293142 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdaa55c-7d88-4a59-9b87-a7021ae09121 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:49.294317 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdaa55c-7d88-4a59-9b87-a7021ae09121 admin admin] RBAC: Adding query filter params (role.id=983c0291e0fa484ea053a791ead0e9c5, scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6, user.id=bff692322c68420186f2918d380ece98) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:49.294837 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdaa55c-7d88-4a59-9b87-a7021ae09121 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:49.296893 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdaa55c-7d88-4a59-9b87-a7021ae09121 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:49.305709 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 216/433] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:20:49 2021] GET /identity/v3/role_assignments?user.id=bff692322c68420186f2918d380ece98&scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6&role.id=983c0291e0fa484ea053a791ead0e9c5 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:49.356731 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28747f2a-74fe-4246-bd8a-bded06e4c218 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:49.357255 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28747f2a-74fe-4246-bd8a-bded06e4c218 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:49.357255 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28747f2a-74fe-4246-bd8a-bded06e4c218 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:49.359347 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 218/434] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:49.366096 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bb65c-365d-4ee7-ab59-50258ad32201 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:49.366569 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bb65c-365d-4ee7-ab59-50258ad32201 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:49.366645 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bb65c-365d-4ee7-ab59-50258ad32201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:49.389991 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-718bb65c-365d-4ee7-ab59-50258ad32201 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:49.391109 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-718bb65c-365d-4ee7-ab59-50258ad32201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:49.402196 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 217/435] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:49.450225 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28747f2a-74fe-4246-bd8a-bded06e4c218 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:49.468051 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28747f2a-74fe-4246-bd8a-bded06e4c218 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:49.473968 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a565be6-e5d4-47b5-b8d8-fb57c9996280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:49.474830 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a565be6-e5d4-47b5-b8d8-fb57c9996280 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:49.475118 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a565be6-e5d4-47b5-b8d8-fb57c9996280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:49.475392 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a565be6-e5d4-47b5-b8d8-fb57c9996280 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:49.489800 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a565be6-e5d4-47b5-b8d8-fb57c9996280 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:49.491743 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a565be6-e5d4-47b5-b8d8-fb57c9996280 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:49.513275 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-1a565be6-e5d4-47b5-b8d8-fb57c9996280 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:49.514922 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 219/436] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:49.521440 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bb65c-365d-4ee7-ab59-50258ad32201 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:49.531884 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bb65c-365d-4ee7-ab59-50258ad32201 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:49.538250 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035add7-5c38-4faa-9c49-c8b6d22f2847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:49.538965 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035add7-5c38-4faa-9c49-c8b6d22f2847 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:49.539247 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035add7-5c38-4faa-9c49-c8b6d22f2847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:49.539519 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035add7-5c38-4faa-9c49-c8b6d22f2847 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:49.540301 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035add7-5c38-4faa-9c49-c8b6d22f2847 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:49.540604 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035add7-5c38-4faa-9c49-c8b6d22f2847 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:49.542221 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035add7-5c38-4faa-9c49-c8b6d22f2847 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:49.560288 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 218/437] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:49.566845 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a565be6-e5d4-47b5-b8d8-fb57c9996280 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:49.578549 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a565be6-e5d4-47b5-b8d8-fb57c9996280 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:49.584197 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d301870-af3a-4ee0-aef2-0ad99579e383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:49.584887 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d301870-af3a-4ee0-aef2-0ad99579e383 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:49.585216 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d301870-af3a-4ee0-aef2-0ad99579e383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:49.585510 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d301870-af3a-4ee0-aef2-0ad99579e383 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:49.586277 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d301870-af3a-4ee0-aef2-0ad99579e383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:49.588784 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d301870-af3a-4ee0-aef2-0ad99579e383 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:49.613875 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 220/438] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Oct 27 01:20:49 2021] POST /identity/v3/users => generated 247 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:50.929623 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ccea7-899b-4f10-a57b-6fa5dd91b89f None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:50.929623 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ccea7-899b-4f10-a57b-6fa5dd91b89f None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:50.929623 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ccea7-899b-4f10-a57b-6fa5dd91b89f None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:50.930757 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 219/439] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:50.937224 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4b26f-0544-4caa-ac2d-94ea56872c59 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:50.938057 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4b26f-0544-4caa-ac2d-94ea56872c59 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:50.938558 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4b26f-0544-4caa-ac2d-94ea56872c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:50.963319 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-d8b4b26f-0544-4caa-ac2d-94ea56872c59 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:50.964833 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-d8b4b26f-0544-4caa-ac2d-94ea56872c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:50.979585 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 221/440] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:51.015699 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ccea7-899b-4f10-a57b-6fa5dd91b89f None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:51.035084 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ccea7-899b-4f10-a57b-6fa5dd91b89f None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:51.039723 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdafa63-5fd9-4195-8d93-0905052e6564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:51.040583 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdafa63-5fd9-4195-8d93-0905052e6564 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:51.040869 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdafa63-5fd9-4195-8d93-0905052e6564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:51.041148 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdafa63-5fd9-4195-8d93-0905052e6564 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:51.060522 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdafa63-5fd9-4195-8d93-0905052e6564 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:51.067644 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-acdafa63-5fd9-4195-8d93-0905052e6564 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:20:51.069154 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 220/441] 10.222.0.25 () {56 vars in 1123 bytes} [Wed Oct 27 01:20:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:51.075774 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4b26f-0544-4caa-ac2d-94ea56872c59 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:51.091048 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4b26f-0544-4caa-ac2d-94ea56872c59 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:51.101098 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5c159-3563-4ca9-948c-8a54bf7ff0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:51.101801 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5c159-3563-4ca9-948c-8a54bf7ff0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:51.102089 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5c159-3563-4ca9-948c-8a54bf7ff0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:51.102401 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5c159-3563-4ca9-948c-8a54bf7ff0b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:51.103166 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5c159-3563-4ca9-948c-8a54bf7ff0b4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:51.103478 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5c159-3563-4ca9-948c-8a54bf7ff0b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:51.105084 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5c159-3563-4ca9-948c-8a54bf7ff0b4 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:51.119922 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 222/442] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Oct 27 01:20:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:51.126193 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdafa63-5fd9-4195-8d93-0905052e6564 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:51.142645 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdafa63-5fd9-4195-8d93-0905052e6564 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:51.154192 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe3aea-f5a9-4fb8-98d9-63a35797f2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:51.155024 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe3aea-f5a9-4fb8-98d9-63a35797f2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:51.155310 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe3aea-f5a9-4fb8-98d9-63a35797f2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:51.155591 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe3aea-f5a9-4fb8-98d9-63a35797f2a1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:51.177305 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe3aea-f5a9-4fb8-98d9-63a35797f2a1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:51.179250 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe3aea-f5a9-4fb8-98d9-63a35797f2a1 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:51.199594 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-45fe3aea-f5a9-4fb8-98d9-63a35797f2a1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:51.200722 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 221/443] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:51.210799 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5c159-3563-4ca9-948c-8a54bf7ff0b4 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:51.226457 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5c159-3563-4ca9-948c-8a54bf7ff0b4 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:51.231276 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369daf8-7f06-4139-b1ba-3d8877d1394a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:51.231935 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369daf8-7f06-4139-b1ba-3d8877d1394a admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:51.232225 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369daf8-7f06-4139-b1ba-3d8877d1394a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:51.232504 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369daf8-7f06-4139-b1ba-3d8877d1394a admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:51.233242 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369daf8-7f06-4139-b1ba-3d8877d1394a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:51.233575 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369daf8-7f06-4139-b1ba-3d8877d1394a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:51.235158 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369daf8-7f06-4139-b1ba-3d8877d1394a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:51.252664 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 223/444] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:51.259307 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe3aea-f5a9-4fb8-98d9-63a35797f2a1 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:51.270666 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe3aea-f5a9-4fb8-98d9-63a35797f2a1 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:51.275210 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33400323-10a9-48b4-88b2-674df68f5c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:51.276003 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33400323-10a9-48b4-88b2-674df68f5c29 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:51.276290 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33400323-10a9-48b4-88b2-674df68f5c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:51.276569 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33400323-10a9-48b4-88b2-674df68f5c29 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:51.284214 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33400323-10a9-48b4-88b2-674df68f5c29 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:51.286275 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33400323-10a9-48b4-88b2-674df68f5c29 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:51.300390 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-33400323-10a9-48b4-88b2-674df68f5c29 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:20:51.301613 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 222/445] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Oct 27 01:20:51 2021] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:20:51.308586 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369daf8-7f06-4139-b1ba-3d8877d1394a admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:51.322532 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369daf8-7f06-4139-b1ba-3d8877d1394a admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:51.327009 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c25ce-6073-4575-a71c-a9fb22cf1e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:51.327688 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c25ce-6073-4575-a71c-a9fb22cf1e1f admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:51.327974 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c25ce-6073-4575-a71c-a9fb22cf1e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:51.328257 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c25ce-6073-4575-a71c-a9fb22cf1e1f admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:51.329112 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c25ce-6073-4575-a71c-a9fb22cf1e1f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:51.329425 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c25ce-6073-4575-a71c-a9fb22cf1e1f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:51.335406 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c25ce-6073-4575-a71c-a9fb22cf1e1f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:51.360944 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 224/446] 10.222.0.25 () {56 vars in 1154 bytes} [Wed Oct 27 01:20:51 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:51.367255 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33400323-10a9-48b4-88b2-674df68f5c29 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:51.377833 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33400323-10a9-48b4-88b2-674df68f5c29 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:51.382578 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acf1e3-f233-41f6-8e51-f97eae56df58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:51.383405 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acf1e3-f233-41f6-8e51-f97eae56df58 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:51.383740 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acf1e3-f233-41f6-8e51-f97eae56df58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:51.384017 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acf1e3-f233-41f6-8e51-f97eae56df58 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:51.402911 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3acf1e3-f233-41f6-8e51-f97eae56df58 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:51.404771 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3acf1e3-f233-41f6-8e51-f97eae56df58 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:51.422695 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-c3acf1e3-f233-41f6-8e51-f97eae56df58 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:51.424183 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 223/447] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:51.430241 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c25ce-6073-4575-a71c-a9fb22cf1e1f admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:51.440431 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c25ce-6073-4575-a71c-a9fb22cf1e1f admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:51.445046 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04177a-8072-4def-a46e-8f84f6886840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:51.445800 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04177a-8072-4def-a46e-8f84f6886840 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:51.446113 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04177a-8072-4def-a46e-8f84f6886840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:51.446454 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04177a-8072-4def-a46e-8f84f6886840 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:51.447232 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04177a-8072-4def-a46e-8f84f6886840 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:51.447600 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04177a-8072-4def-a46e-8f84f6886840 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:51.449261 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04177a-8072-4def-a46e-8f84f6886840 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:51.462403 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 225/448] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:51.468482 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acf1e3-f233-41f6-8e51-f97eae56df58 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:51.479407 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acf1e3-f233-41f6-8e51-f97eae56df58 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:51.484047 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d83427-6c66-435a-87bd-82d035e964d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:51.484899 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d83427-6c66-435a-87bd-82d035e964d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:51.485183 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d83427-6c66-435a-87bd-82d035e964d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:51.485538 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d83427-6c66-435a-87bd-82d035e964d0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:51.493051 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d83427-6c66-435a-87bd-82d035e964d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:51.495101 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d83427-6c66-435a-87bd-82d035e964d0 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:51.508721 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-29d83427-6c66-435a-87bd-82d035e964d0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:20:51.510321 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 224/449] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:51.516659 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04177a-8072-4def-a46e-8f84f6886840 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:51.527302 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04177a-8072-4def-a46e-8f84f6886840 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:51.529114 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fce7f0-506a-434d-8241-ec2d9f34cd58 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:51.529407 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fce7f0-506a-434d-8241-ec2d9f34cd58 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:51.529719 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fce7f0-506a-434d-8241-ec2d9f34cd58 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:51.531489 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 225/450] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:20:51.532409 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414606ec-b38c-4906-a3ba-b6744dc0db26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:51.533152 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414606ec-b38c-4906-a3ba-b6744dc0db26 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:51.533450 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414606ec-b38c-4906-a3ba-b6744dc0db26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:51.533765 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414606ec-b38c-4906-a3ba-b6744dc0db26 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:51.534625 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414606ec-b38c-4906-a3ba-b6744dc0db26 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:51.534939 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414606ec-b38c-4906-a3ba-b6744dc0db26 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:51.536850 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414606ec-b38c-4906-a3ba-b6744dc0db26 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:51.538932 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1e940-0e51-42e4-8872-ddbccc0a26a7 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:51.539219 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1e940-0e51-42e4-8872-ddbccc0a26a7 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:51.539504 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1e940-0e51-42e4-8872-ddbccc0a26a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:51.551283 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 226/451] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:20:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:51.559292 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414606ec-b38c-4906-a3ba-b6744dc0db26 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:51.570113 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414606ec-b38c-4906-a3ba-b6744dc0db26 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:51.574164 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-7cf1e940-0e51-42e4-8872-ddbccc0a26a7 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:51.575427 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-7cf1e940-0e51-42e4-8872-ddbccc0a26a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:51.576123 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ba94a-83c0-4369-be39-b2923477bc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:51.577287 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ba94a-83c0-4369-be39-b2923477bc39 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:51.577927 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ba94a-83c0-4369-be39-b2923477bc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:51.578519 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ba94a-83c0-4369-be39-b2923477bc39 admin admin] PATH_INFO: `/v3/projects/2b95c6a455e74d9487ae73f44a9ba0e6/users/b2f8304b85b64dc4ac58523897306660/roles/983c0291e0fa484ea053a791ead0e9c5` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:51.594015 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 226/452] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:51.601569 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ba94a-83c0-4369-be39-b2923477bc39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b95c6a455e74d9487ae73f44a9ba0e6, user_id=b2f8304b85b64dc4ac58523897306660, role_id=983c0291e0fa484ea053a791ead0e9c5)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:51.604840 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ba94a-83c0-4369-be39-b2923477bc39 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:51.623056 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 227/453] 10.222.0.25 () {58 vars in 1460 bytes} [Wed Oct 27 01:20:51 2021] PUT /identity/v3/projects/2b95c6a455e74d9487ae73f44a9ba0e6/users/b2f8304b85b64dc4ac58523897306660/roles/983c0291e0fa484ea053a791ead0e9c5 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:51.644852 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1e940-0e51-42e4-8872-ddbccc0a26a7 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:51.655763 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1e940-0e51-42e4-8872-ddbccc0a26a7 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:51.717257 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabd88d-8995-418c-8822-79dde20cd3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:51.718448 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabd88d-8995-418c-8822-79dde20cd3fb admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:51.718964 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabd88d-8995-418c-8822-79dde20cd3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:51.719444 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabd88d-8995-418c-8822-79dde20cd3fb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:51.731393 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eabd88d-8995-418c-8822-79dde20cd3fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:51.739205 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-5eabd88d-8995-418c-8822-79dde20cd3fb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:20:51.741204 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 227/454] 10.222.0.25 () {56 vars in 1123 bytes} [Wed Oct 27 01:20:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:51.747877 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ba94a-83c0-4369-be39-b2923477bc39 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:51.759243 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ba94a-83c0-4369-be39-b2923477bc39 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:51.764376 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b2a79-2433-4e15-879c-b74fc1542739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:51.765447 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b2a79-2433-4e15-879c-b74fc1542739 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:51.766022 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b2a79-2433-4e15-879c-b74fc1542739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:51.766524 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b2a79-2433-4e15-879c-b74fc1542739 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:51.767512 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b2a79-2433-4e15-879c-b74fc1542739 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:51.768063 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b2a79-2433-4e15-879c-b74fc1542739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:51.770792 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b2a79-2433-4e15-879c-b74fc1542739 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:51.771521 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2e1c0-8ca3-42cd-9fb6-5d81555e3d7e None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:51.772029 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2e1c0-8ca3-42cd-9fb6-5d81555e3d7e None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:51.772517 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2e1c0-8ca3-42cd-9fb6-5d81555e3d7e None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:51.775452 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 228/455] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:51.785822 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cba02-0dcd-473e-ac28-48c2ced1595c None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:51.786439 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cba02-0dcd-473e-ac28-48c2ced1595c None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:51.786817 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 228/456] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Oct 27 01:20:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:51.787178 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cba02-0dcd-473e-ac28-48c2ced1595c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:51.799422 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b2a79-2433-4e15-879c-b74fc1542739 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:51.813260 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-db5cba02-0dcd-473e-ac28-48c2ced1595c None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:51.814827 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b2a79-2433-4e15-879c-b74fc1542739 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:51.815108 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-db5cba02-0dcd-473e-ac28-48c2ced1595c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:51.824233 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 229/457] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:51.825921 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca742d2-5616-4870-b21d-b2fa70d52709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:51.827008 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca742d2-5616-4870-b21d-b2fa70d52709 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:51.827537 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca742d2-5616-4870-b21d-b2fa70d52709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:51.828043 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca742d2-5616-4870-b21d-b2fa70d52709 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:51.840587 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca742d2-5616-4870-b21d-b2fa70d52709 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:51.842997 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca742d2-5616-4870-b21d-b2fa70d52709 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:51.850316 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cba02-0dcd-473e-ac28-48c2ced1595c None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:51.860472 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cba02-0dcd-473e-ac28-48c2ced1595c None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:51.865296 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-8ca742d2-5616-4870-b21d-b2fa70d52709 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:51.866208 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968c496-ea4a-4a84-97f1-da6473aeb42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:51.867314 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968c496-ea4a-4a84-97f1-da6473aeb42b admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:51.867898 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968c496-ea4a-4a84-97f1-da6473aeb42b admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:51.868477 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968c496-ea4a-4a84-97f1-da6473aeb42b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:51.875083 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 229/458] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:51.882624 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca742d2-5616-4870-b21d-b2fa70d52709 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:51.888786 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968c496-ea4a-4a84-97f1-da6473aeb42b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:51.896636 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-8968c496-ea4a-4a84-97f1-da6473aeb42b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:20:51.898605 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 230/459] 10.222.0.25 () {56 vars in 1123 bytes} [Wed Oct 27 01:20:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:51.909085 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca742d2-5616-4870-b21d-b2fa70d52709 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:51.910650 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968c496-ea4a-4a84-97f1-da6473aeb42b admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:51.918915 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb5daa-aa34-4186-92be-1207ab6c1c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:51.919592 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb5daa-aa34-4186-92be-1207ab6c1c2e admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:51.919878 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb5daa-aa34-4186-92be-1207ab6c1c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:51.920159 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb5daa-aa34-4186-92be-1207ab6c1c2e admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:51.920904 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb5daa-aa34-4186-92be-1207ab6c1c2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:51.921791 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb5daa-aa34-4186-92be-1207ab6c1c2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:51.922869 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb5daa-aa34-4186-92be-1207ab6c1c2e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:51.926262 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968c496-ea4a-4a84-97f1-da6473aeb42b admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:51.939564 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fd2bb-a69b-44d3-9598-f5ecfca6360a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:51.941257 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fd2bb-a69b-44d3-9598-f5ecfca6360a admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:51.942566 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fd2bb-a69b-44d3-9598-f5ecfca6360a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:51.943115 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fd2bb-a69b-44d3-9598-f5ecfca6360a admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:51.944707 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fd2bb-a69b-44d3-9598-f5ecfca6360a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:51.947013 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fd2bb-a69b-44d3-9598-f5ecfca6360a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:51.948961 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fd2bb-a69b-44d3-9598-f5ecfca6360a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:51.958946 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 230/460] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:51.968355 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb5daa-aa34-4186-92be-1207ab6c1c2e admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:51.969361 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 231/461] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Oct 27 01:20:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:51.979509 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fd2bb-a69b-44d3-9598-f5ecfca6360a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:51.982059 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb5daa-aa34-4186-92be-1207ab6c1c2e admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:51.987218 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff8720-4584-4b39-9924-d4c9b48ec21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:51.988328 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff8720-4584-4b39-9924-d4c9b48ec21d admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:51.988839 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff8720-4584-4b39-9924-d4c9b48ec21d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:51.989318 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff8720-4584-4b39-9924-d4c9b48ec21d admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:51.994274 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fd2bb-a69b-44d3-9598-f5ecfca6360a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:51.999784 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff8720-4584-4b39-9924-d4c9b48ec21d admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:52.000823 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff7fb3-21e3-4562-9e2d-8f4a4161cbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:52.001680 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff7fb3-21e3-4562-9e2d-8f4a4161cbbc admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:52.002018 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff7fb3-21e3-4562-9e2d-8f4a4161cbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:52.002350 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff7fb3-21e3-4562-9e2d-8f4a4161cbbc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:52.003017 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff8720-4584-4b39-9924-d4c9b48ec21d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:52.015288 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff7fb3-21e3-4562-9e2d-8f4a4161cbbc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:52.017257 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff7fb3-21e3-4562-9e2d-8f4a4161cbbc admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:52.018582 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-c4ff8720-4584-4b39-9924-d4c9b48ec21d admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 01:20:52.020272 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 231/462] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:51 2021] GET /identity/v3/users/cinder => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:20:52.024670 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f8203-69fb-4107-831a-5c105c944a9b None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:52.024988 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f8203-69fb-4107-831a-5c105c944a9b None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:52.025274 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f8203-69fb-4107-831a-5c105c944a9b None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:52.027226 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 232/463] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:20:52.027854 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f8203-69fb-4107-831a-5c105c944a9b None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:52.039295 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-8fff7fb3-21e3-4562-9e2d-8f4a4161cbbc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:52.041210 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 232/464] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:52.043364 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55359708-3f78-4a26-827c-697f0be427c7 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:52.044137 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55359708-3f78-4a26-827c-697f0be427c7 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:52.044607 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55359708-3f78-4a26-827c-697f0be427c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:52.046994 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f8203-69fb-4107-831a-5c105c944a9b None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:52.051654 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7510e0-5570-4136-9e6d-7d0b67a6fe35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:52.052308 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7510e0-5570-4136-9e6d-7d0b67a6fe35 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:52.052592 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7510e0-5570-4136-9e6d-7d0b67a6fe35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:52.052864 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7510e0-5570-4136-9e6d-7d0b67a6fe35 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:52.053762 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7510e0-5570-4136-9e6d-7d0b67a6fe35 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:52.054074 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7510e0-5570-4136-9e6d-7d0b67a6fe35 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:52.056446 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7510e0-5570-4136-9e6d-7d0b67a6fe35 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:52.069759 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-55359708-3f78-4a26-827c-697f0be427c7 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:52.072709 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-55359708-3f78-4a26-827c-697f0be427c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:52.079039 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 233/465] 10.222.0.25 () {56 vars in 1158 bytes} [Wed Oct 27 01:20:52 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:52.079692 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7510e0-5570-4136-9e6d-7d0b67a6fe35 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:52.087531 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 233/466] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:52.089114 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55359708-3f78-4a26-827c-697f0be427c7 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:52.096234 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7510e0-5570-4136-9e6d-7d0b67a6fe35 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:52.099815 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55359708-3f78-4a26-827c-697f0be427c7 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:52.103583 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096fbfc-5eef-4e0a-b152-e96d8ad28ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:52.104304 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096fbfc-5eef-4e0a-b152-e96d8ad28ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:52.104686 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096fbfc-5eef-4e0a-b152-e96d8ad28ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:52.104970 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096fbfc-5eef-4e0a-b152-e96d8ad28ad8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:52.105620 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb90a2f-f555-4f7c-aff6-34a3c1e39f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:52.105752 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2096fbfc-5eef-4e0a-b152-e96d8ad28ad8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:52.106079 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2096fbfc-5eef-4e0a-b152-e96d8ad28ad8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:52.106899 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb90a2f-f555-4f7c-aff6-34a3c1e39f3e admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:52.107372 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb90a2f-f555-4f7c-aff6-34a3c1e39f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:52.107830 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2096fbfc-5eef-4e0a-b152-e96d8ad28ad8 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:52.107936 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb90a2f-f555-4f7c-aff6-34a3c1e39f3e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:52.120254 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb90a2f-f555-4f7c-aff6-34a3c1e39f3e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:52.122374 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb90a2f-f555-4f7c-aff6-34a3c1e39f3e admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:52.128630 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 234/467] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:52.135370 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096fbfc-5eef-4e0a-b152-e96d8ad28ad8 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:52.142664 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-fbb90a2f-f555-4f7c-aff6-34a3c1e39f3e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:52.144596 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 234/468] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:20:52.145472 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096fbfc-5eef-4e0a-b152-e96d8ad28ad8 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:52.149735 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb90a2f-f555-4f7c-aff6-34a3c1e39f3e admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:52.152920 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43514c66-868c-4ad2-85f4-0e903fca3948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:52.153961 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43514c66-868c-4ad2-85f4-0e903fca3948 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:52.154414 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43514c66-868c-4ad2-85f4-0e903fca3948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:52.154889 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43514c66-868c-4ad2-85f4-0e903fca3948 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:52.161616 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb90a2f-f555-4f7c-aff6-34a3c1e39f3e admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:52.163656 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43514c66-868c-4ad2-85f4-0e903fca3948 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:52.166219 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43514c66-868c-4ad2-85f4-0e903fca3948 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:52.166724 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef916e-433f-447e-b978-f1746303547d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:52.167561 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef916e-433f-447e-b978-f1746303547d admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:52.167918 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef916e-433f-447e-b978-f1746303547d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:52.168264 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef916e-433f-447e-b978-f1746303547d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:52.179686 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef916e-433f-447e-b978-f1746303547d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:52.184952 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-43514c66-868c-4ad2-85f4-0e903fca3948 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 27 01:20:52.186816 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 235/469] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:52 2021] GET /identity/v3/users/glance => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:52.187750 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-f3ef916e-433f-447e-b978-f1746303547d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:20:52.188046 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43514c66-868c-4ad2-85f4-0e903fca3948 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:52.189402 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 235/470] 10.222.0.25 () {56 vars in 1123 bytes} [Wed Oct 27 01:20:52 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:52.197402 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef916e-433f-447e-b978-f1746303547d admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:52.200817 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43514c66-868c-4ad2-85f4-0e903fca3948 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:52.211016 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef916e-433f-447e-b978-f1746303547d admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:52.214920 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a0598-d3aa-4106-b55d-2aead13aa910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:52.215715 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a0598-d3aa-4106-b55d-2aead13aa910 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:52.216560 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a0598-d3aa-4106-b55d-2aead13aa910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:52.217407 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a0598-d3aa-4106-b55d-2aead13aa910 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:52.218738 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a0598-d3aa-4106-b55d-2aead13aa910 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:52.219403 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a0598-d3aa-4106-b55d-2aead13aa910 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:52.221603 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a0598-d3aa-4106-b55d-2aead13aa910 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:52.222315 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbfc58-552d-4aac-957a-65efe55dedb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:52.223748 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbfc58-552d-4aac-957a-65efe55dedb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:52.224201 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbfc58-552d-4aac-957a-65efe55dedb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:52.225098 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbfc58-552d-4aac-957a-65efe55dedb4 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:52.226249 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbfc58-552d-4aac-957a-65efe55dedb4 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:52.226768 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbfc58-552d-4aac-957a-65efe55dedb4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:52.228902 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbfc58-552d-4aac-957a-65efe55dedb4 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:52.235004 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 236/471] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:52.235933 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a0598-d3aa-4106-b55d-2aead13aa910 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:52.251085 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 236/472] 10.222.0.25 () {56 vars in 1158 bytes} [Wed Oct 27 01:20:52 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:52.251584 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a0598-d3aa-4106-b55d-2aead13aa910 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:52.252397 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbfc58-552d-4aac-957a-65efe55dedb4 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:52.256680 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f27cf2-e7a3-4bf5-b3ed-87a769b92259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:52.257446 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f27cf2-e7a3-4bf5-b3ed-87a769b92259 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:52.257907 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f27cf2-e7a3-4bf5-b3ed-87a769b92259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:52.258282 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f27cf2-e7a3-4bf5-b3ed-87a769b92259 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:52.259268 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f27cf2-e7a3-4bf5-b3ed-87a769b92259 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:52.259693 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f27cf2-e7a3-4bf5-b3ed-87a769b92259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:52.261593 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f27cf2-e7a3-4bf5-b3ed-87a769b92259 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:52.264376 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbfc58-552d-4aac-957a-65efe55dedb4 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:52.269706 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b4084-d33d-4247-9621-00af1e24d150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:52.270343 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 237/473] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Oct 27 01:20:52 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:52.270833 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b4084-d33d-4247-9621-00af1e24d150 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:52.271259 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b4084-d33d-4247-9621-00af1e24d150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:52.271437 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f27cf2-e7a3-4bf5-b3ed-87a769b92259 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:52.271840 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b4084-d33d-4247-9621-00af1e24d150 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:52.280641 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b4084-d33d-4247-9621-00af1e24d150 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:52.283055 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b4084-d33d-4247-9621-00af1e24d150 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:52.283473 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f27cf2-e7a3-4bf5-b3ed-87a769b92259 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:52.288556 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf230d17-cbd5-4273-9d0a-325f42b08356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:52.289459 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf230d17-cbd5-4273-9d0a-325f42b08356 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:52.289965 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf230d17-cbd5-4273-9d0a-325f42b08356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:52.290424 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf230d17-cbd5-4273-9d0a-325f42b08356 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:52.299408 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-829b4084-d33d-4247-9621-00af1e24d150 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:20:52.301632 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 237/474] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:52.302553 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b4084-d33d-4247-9621-00af1e24d150 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:52.306537 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf230d17-cbd5-4273-9d0a-325f42b08356 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:52.308838 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf230d17-cbd5-4273-9d0a-325f42b08356 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:52.314446 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b4084-d33d-4247-9621-00af1e24d150 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:52.319955 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e61658-ee2b-40d6-b57a-af6558319b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:52.321802 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e61658-ee2b-40d6-b57a-af6558319b5a admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:52.322239 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e61658-ee2b-40d6-b57a-af6558319b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:52.322655 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e61658-ee2b-40d6-b57a-af6558319b5a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:52.329361 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-bf230d17-cbd5-4273-9d0a-325f42b08356 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:52.331093 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 238/475] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:52.332035 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf230d17-cbd5-4273-9d0a-325f42b08356 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:52.335309 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e61658-ee2b-40d6-b57a-af6558319b5a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:52.338039 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e61658-ee2b-40d6-b57a-af6558319b5a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:52.343535 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf230d17-cbd5-4273-9d0a-325f42b08356 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:52.348872 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58915f2-6468-4358-82bd-f855b1404f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:52.349935 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58915f2-6468-4358-82bd-f855b1404f0b admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:52.350383 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58915f2-6468-4358-82bd-f855b1404f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:52.350801 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58915f2-6468-4358-82bd-f855b1404f0b admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:52.351702 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58915f2-6468-4358-82bd-f855b1404f0b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:52.352167 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58915f2-6468-4358-82bd-f855b1404f0b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:52.354258 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58915f2-6468-4358-82bd-f855b1404f0b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:52.359269 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-06e61658-ee2b-40d6-b57a-af6558319b5a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:52.360913 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 238/476] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:52.362348 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e61658-ee2b-40d6-b57a-af6558319b5a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:52.366774 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 239/477] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:20:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:52.373100 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58915f2-6468-4358-82bd-f855b1404f0b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:52.373415 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e61658-ee2b-40d6-b57a-af6558319b5a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:52.378760 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666b05c-31d9-465d-876b-aef414b37496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:52.380054 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666b05c-31d9-465d-876b-aef414b37496 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:52.380493 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666b05c-31d9-465d-876b-aef414b37496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:52.380929 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666b05c-31d9-465d-876b-aef414b37496 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:52.382109 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666b05c-31d9-465d-876b-aef414b37496 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:52.382559 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666b05c-31d9-465d-876b-aef414b37496 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:52.384322 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58915f2-6468-4358-82bd-f855b1404f0b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:52.385089 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666b05c-31d9-465d-876b-aef414b37496 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:52.390302 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beccbd5-2f6c-42a8-b7ed-681d151c7e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:52.391159 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beccbd5-2f6c-42a8-b7ed-681d151c7e3b admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:52.391545 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beccbd5-2f6c-42a8-b7ed-681d151c7e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:52.391926 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beccbd5-2f6c-42a8-b7ed-681d151c7e3b admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:52.392890 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beccbd5-2f6c-42a8-b7ed-681d151c7e3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:52.393304 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beccbd5-2f6c-42a8-b7ed-681d151c7e3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:52.395149 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beccbd5-2f6c-42a8-b7ed-681d151c7e3b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:52.400095 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 239/478] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:52.401058 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666b05c-31d9-465d-876b-aef414b37496 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:52.409151 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 240/479] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:52.410175 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beccbd5-2f6c-42a8-b7ed-681d151c7e3b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:52.412404 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666b05c-31d9-465d-876b-aef414b37496 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:52.418041 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021521b-e891-4bd2-9f4b-c59bd675d3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:52.419115 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021521b-e891-4bd2-9f4b-c59bd675d3a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:52.419598 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021521b-e891-4bd2-9f4b-c59bd675d3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:52.420059 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021521b-e891-4bd2-9f4b-c59bd675d3a6 admin admin] PATH_INFO: `/v3/projects/2b95c6a455e74d9487ae73f44a9ba0e6/users/1819142aab4743fbb9e056ba61e3d474/roles/983c0291e0fa484ea053a791ead0e9c5` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:52.420163 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beccbd5-2f6c-42a8-b7ed-681d151c7e3b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:52.425349 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f89c5-4818-437c-9181-3ae634e1ef6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:52.426290 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f89c5-4818-437c-9181-3ae634e1ef6a admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:52.426678 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f89c5-4818-437c-9181-3ae634e1ef6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:52.427026 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f89c5-4818-437c-9181-3ae634e1ef6a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:52.434586 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f89c5-4818-437c-9181-3ae634e1ef6a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:52.436797 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f89c5-4818-437c-9181-3ae634e1ef6a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:52.438733 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021521b-e891-4bd2-9f4b-c59bd675d3a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b95c6a455e74d9487ae73f44a9ba0e6, user_id=1819142aab4743fbb9e056ba61e3d474, role_id=983c0291e0fa484ea053a791ead0e9c5)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:52.441857 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021521b-e891-4bd2-9f4b-c59bd675d3a6 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:52.451560 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-fa3f89c5-4818-437c-9181-3ae634e1ef6a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:20:52.453181 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 241/480] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:52.454177 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f89c5-4818-437c-9181-3ae634e1ef6a admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:52.456783 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 240/481] 10.222.0.25 () {58 vars in 1460 bytes} [Wed Oct 27 01:20:52 2021] PUT /identity/v3/projects/2b95c6a455e74d9487ae73f44a9ba0e6/users/1819142aab4743fbb9e056ba61e3d474/roles/983c0291e0fa484ea053a791ead0e9c5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:52.463331 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021521b-e891-4bd2-9f4b-c59bd675d3a6 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:52.480213 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f89c5-4818-437c-9181-3ae634e1ef6a admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:52.592758 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021521b-e891-4bd2-9f4b-c59bd675d3a6 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:52.598870 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c7c2e-b474-4392-afef-80fa04d5f56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:52.600052 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c7c2e-b474-4392-afef-80fa04d5f56c admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:52.600547 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c7c2e-b474-4392-afef-80fa04d5f56c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:52.601505 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c7c2e-b474-4392-afef-80fa04d5f56c admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:52.602766 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c7c2e-b474-4392-afef-80fa04d5f56c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:52.603394 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c7c2e-b474-4392-afef-80fa04d5f56c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:52.605697 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c7c2e-b474-4392-afef-80fa04d5f56c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:52.618268 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bec70c-bdcd-4469-8593-ea4dde255521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:52.619184 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bec70c-bdcd-4469-8593-ea4dde255521 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:52.619545 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bec70c-bdcd-4469-8593-ea4dde255521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:52.619919 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bec70c-bdcd-4469-8593-ea4dde255521 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:52.620725 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 241/482] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:20:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:52.630893 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c7c2e-b474-4392-afef-80fa04d5f56c admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:52.642318 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bec70c-bdcd-4469-8593-ea4dde255521 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:52.644396 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bec70c-bdcd-4469-8593-ea4dde255521 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:52.652666 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c7c2e-b474-4392-afef-80fa04d5f56c admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:52.663645 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388679e-c4c1-4c89-af29-c4c1957368dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:52.664595 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388679e-c4c1-4c89-af29-c4c1957368dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:52.664974 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388679e-c4c1-4c89-af29-c4c1957368dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:52.665258 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388679e-c4c1-4c89-af29-c4c1957368dc admin admin] PATH_INFO: `/v3/projects/2b95c6a455e74d9487ae73f44a9ba0e6/users/32003a40693246d08640bc7ec45adfc2/roles/983c0291e0fa484ea053a791ead0e9c5` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:52.679227 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-b7bec70c-bdcd-4469-8593-ea4dde255521 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 01:20:52.682305 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 242/483] 10.222.0.25 () {56 vars in 1123 bytes} [Wed Oct 27 01:20:52 2021] GET /identity/v3/users/neutron => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:52.688884 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bec70c-bdcd-4469-8593-ea4dde255521 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:52.697729 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388679e-c4c1-4c89-af29-c4c1957368dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b95c6a455e74d9487ae73f44a9ba0e6, user_id=32003a40693246d08640bc7ec45adfc2, role_id=983c0291e0fa484ea053a791ead0e9c5)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:52.699689 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bec70c-bdcd-4469-8593-ea4dde255521 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:52.700532 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388679e-c4c1-4c89-af29-c4c1957368dc admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:52.705259 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3503d-7e25-473c-8f4d-4190ef8e0ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:52.705259 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3503d-7e25-473c-8f4d-4190ef8e0ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:52.705506 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3503d-7e25-473c-8f4d-4190ef8e0ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:52.705709 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3503d-7e25-473c-8f4d-4190ef8e0ec2 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:52.706542 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3503d-7e25-473c-8f4d-4190ef8e0ec2 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:52.706955 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3503d-7e25-473c-8f4d-4190ef8e0ec2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:52.709905 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3503d-7e25-473c-8f4d-4190ef8e0ec2 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:52.720222 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 242/484] 10.222.0.25 () {58 vars in 1460 bytes} [Wed Oct 27 01:20:52 2021] PUT /identity/v3/projects/2b95c6a455e74d9487ae73f44a9ba0e6/users/32003a40693246d08640bc7ec45adfc2/roles/983c0291e0fa484ea053a791ead0e9c5 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:52.732568 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 243/485] 10.222.0.25 () {56 vars in 1160 bytes} [Wed Oct 27 01:20:52 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:52.738677 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388679e-c4c1-4c89-af29-c4c1957368dc admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:52.820544 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388679e-c4c1-4c89-af29-c4c1957368dc admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:52.825397 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33339438-6e73-4bd2-9e53-4f11048bbbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:52.826326 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33339438-6e73-4bd2-9e53-4f11048bbbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:52.826611 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33339438-6e73-4bd2-9e53-4f11048bbbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:52.826940 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33339438-6e73-4bd2-9e53-4f11048bbbb9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:52.840736 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33339438-6e73-4bd2-9e53-4f11048bbbb9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:52.842785 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33339438-6e73-4bd2-9e53-4f11048bbbb9 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:52.864742 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-33339438-6e73-4bd2-9e53-4f11048bbbb9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:52.866252 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 243/486] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:52.873024 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3503d-7e25-473c-8f4d-4190ef8e0ec2 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:52.886987 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3503d-7e25-473c-8f4d-4190ef8e0ec2 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:52.903242 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29e8ff-5560-4993-8216-52c9c2d30c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:52.904183 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29e8ff-5560-4993-8216-52c9c2d30c67 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:52.904614 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29e8ff-5560-4993-8216-52c9c2d30c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:52.905037 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29e8ff-5560-4993-8216-52c9c2d30c67 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:52.905965 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29e8ff-5560-4993-8216-52c9c2d30c67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:52.906416 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29e8ff-5560-4993-8216-52c9c2d30c67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:52.908160 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29e8ff-5560-4993-8216-52c9c2d30c67 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:52.931140 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 244/487] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:52.937866 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33339438-6e73-4bd2-9e53-4f11048bbbb9 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:52.950637 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33339438-6e73-4bd2-9e53-4f11048bbbb9 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:52.963161 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68064906-6ece-419c-99ad-52288f118a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:52.964089 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68064906-6ece-419c-99ad-52288f118a7c admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:52.964513 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68064906-6ece-419c-99ad-52288f118a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:52.964914 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68064906-6ece-419c-99ad-52288f118a7c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:52.978974 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68064906-6ece-419c-99ad-52288f118a7c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:52.981017 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68064906-6ece-419c-99ad-52288f118a7c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:53.000554 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-68064906-6ece-419c-99ad-52288f118a7c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:20:53.002072 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 244/488] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:53.008143 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29e8ff-5560-4993-8216-52c9c2d30c67 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:53.008687 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda3e0f-e083-45d2-bcc4-04e5ac9b5c82 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:53.008920 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda3e0f-e083-45d2-bcc4-04e5ac9b5c82 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:53.009206 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda3e0f-e083-45d2-bcc4-04e5ac9b5c82 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:53.011185 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 245/489] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:53.023520 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29e8ff-5560-4993-8216-52c9c2d30c67 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:53.025526 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6c0de-f57e-408f-86f6-c84402050f8e None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:53.025815 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6c0de-f57e-408f-86f6-c84402050f8e None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:53.026095 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6c0de-f57e-408f-86f6-c84402050f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:53.030373 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615938a-e164-48ac-bbd9-d1404c2464d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:53.031190 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615938a-e164-48ac-bbd9-d1404c2464d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:53.031573 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615938a-e164-48ac-bbd9-d1404c2464d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:53.032023 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615938a-e164-48ac-bbd9-d1404c2464d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:53.032922 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615938a-e164-48ac-bbd9-d1404c2464d3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:53.033352 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615938a-e164-48ac-bbd9-d1404c2464d3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:53.035340 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615938a-e164-48ac-bbd9-d1404c2464d3 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:53.049761 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 245/490] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:20:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:53.050991 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-91c6c0de-f57e-408f-86f6-c84402050f8e None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:53.052205 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-91c6c0de-f57e-408f-86f6-c84402050f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:53.056386 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615938a-e164-48ac-bbd9-d1404c2464d3 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:53.067607 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 246/491] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:53.068486 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615938a-e164-48ac-bbd9-d1404c2464d3 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:53.074145 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b60102-243d-4f84-a27f-d8db317afe35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:53.075276 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b60102-243d-4f84-a27f-d8db317afe35 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:53.075781 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b60102-243d-4f84-a27f-d8db317afe35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:53.076274 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b60102-243d-4f84-a27f-d8db317afe35 admin admin] PATH_INFO: `/v3/projects/2b95c6a455e74d9487ae73f44a9ba0e6/users/bff692322c68420186f2918d380ece98/roles/983c0291e0fa484ea053a791ead0e9c5` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:53.093259 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b60102-243d-4f84-a27f-d8db317afe35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b95c6a455e74d9487ae73f44a9ba0e6, user_id=bff692322c68420186f2918d380ece98, role_id=983c0291e0fa484ea053a791ead0e9c5)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:53.096231 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b60102-243d-4f84-a27f-d8db317afe35 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:53.098456 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6c0de-f57e-408f-86f6-c84402050f8e None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:53.110844 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6c0de-f57e-408f-86f6-c84402050f8e None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:53.112001 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 246/492] 10.222.0.25 () {58 vars in 1460 bytes} [Wed Oct 27 01:20:53 2021] PUT /identity/v3/projects/2b95c6a455e74d9487ae73f44a9ba0e6/users/bff692322c68420186f2918d380ece98/roles/983c0291e0fa484ea053a791ead0e9c5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:53.175358 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732aacb7-8bf5-4a7f-9c6f-e16366591e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:53.176632 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732aacb7-8bf5-4a7f-9c6f-e16366591e16 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:53.177118 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732aacb7-8bf5-4a7f-9c6f-e16366591e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:53.177633 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732aacb7-8bf5-4a7f-9c6f-e16366591e16 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:53.189598 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732aacb7-8bf5-4a7f-9c6f-e16366591e16 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:53.197755 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-732aacb7-8bf5-4a7f-9c6f-e16366591e16 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:20:53.199641 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 247/493] 10.222.0.25 () {56 vars in 1123 bytes} [Wed Oct 27 01:20:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:20:53.205779 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b60102-243d-4f84-a27f-d8db317afe35 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:53.223869 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b60102-243d-4f84-a27f-d8db317afe35 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:53.229202 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac260968-8e9f-4d86-b973-7ca0e728b208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:53.230350 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac260968-8e9f-4d86-b973-7ca0e728b208 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:53.230837 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac260968-8e9f-4d86-b973-7ca0e728b208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:53.231311 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac260968-8e9f-4d86-b973-7ca0e728b208 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:53.232399 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac260968-8e9f-4d86-b973-7ca0e728b208 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:53.233041 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac260968-8e9f-4d86-b973-7ca0e728b208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:53.235131 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac260968-8e9f-4d86-b973-7ca0e728b208 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:53.249793 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 247/494] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Oct 27 01:20:53 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:53.256324 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732aacb7-8bf5-4a7f-9c6f-e16366591e16 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:53.267305 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732aacb7-8bf5-4a7f-9c6f-e16366591e16 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:53.272363 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cef1b9-29b6-4c80-b54b-6512aa1f010c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:53.273551 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cef1b9-29b6-4c80-b54b-6512aa1f010c admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:53.274055 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cef1b9-29b6-4c80-b54b-6512aa1f010c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:53.275095 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cef1b9-29b6-4c80-b54b-6512aa1f010c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:53.297933 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cef1b9-29b6-4c80-b54b-6512aa1f010c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:53.300201 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cef1b9-29b6-4c80-b54b-6512aa1f010c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:53.322202 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-b2cef1b9-29b6-4c80-b54b-6512aa1f010c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:53.323808 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 248/495] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:53.330322 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac260968-8e9f-4d86-b973-7ca0e728b208 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:53.346391 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac260968-8e9f-4d86-b973-7ca0e728b208 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:53.357650 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2a5da-f8ed-431d-b32c-4cfa095dea3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:53.359334 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2a5da-f8ed-431d-b32c-4cfa095dea3f admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:53.359825 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2a5da-f8ed-431d-b32c-4cfa095dea3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:53.360291 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2a5da-f8ed-431d-b32c-4cfa095dea3f admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:53.361366 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2a5da-f8ed-431d-b32c-4cfa095dea3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:53.361917 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2a5da-f8ed-431d-b32c-4cfa095dea3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:53.364442 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2a5da-f8ed-431d-b32c-4cfa095dea3f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:53.378088 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 248/496] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:53.386549 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cef1b9-29b6-4c80-b54b-6512aa1f010c admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:53.396661 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cef1b9-29b6-4c80-b54b-6512aa1f010c admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:53.401903 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60d778-f982-4da3-b292-3a2767f00292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:53.402867 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60d778-f982-4da3-b292-3a2767f00292 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:53.403143 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60d778-f982-4da3-b292-3a2767f00292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:53.403416 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60d778-f982-4da3-b292-3a2767f00292 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:53.411445 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60d778-f982-4da3-b292-3a2767f00292 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:53.413443 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60d778-f982-4da3-b292-3a2767f00292 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:53.426579 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-3d60d778-f982-4da3-b292-3a2767f00292 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 01:20:53.428075 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 249/497] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:20:53 2021] GET /identity/v3/users/swift => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:53.435055 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2a5da-f8ed-431d-b32c-4cfa095dea3f admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:53.444771 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2a5da-f8ed-431d-b32c-4cfa095dea3f admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:53.450394 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55ef71-aee7-4cfe-9ba8-24e093d5d975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:53.451118 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55ef71-aee7-4cfe-9ba8-24e093d5d975 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:53.451476 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55ef71-aee7-4cfe-9ba8-24e093d5d975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:53.451819 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55ef71-aee7-4cfe-9ba8-24e093d5d975 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:53.452726 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55ef71-aee7-4cfe-9ba8-24e093d5d975 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:53.453099 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55ef71-aee7-4cfe-9ba8-24e093d5d975 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:53.455070 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55ef71-aee7-4cfe-9ba8-24e093d5d975 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:53.474917 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 249/498] 10.222.0.25 () {56 vars in 1156 bytes} [Wed Oct 27 01:20:53 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:53.481124 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60d778-f982-4da3-b292-3a2767f00292 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:53.491366 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60d778-f982-4da3-b292-3a2767f00292 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:53.500660 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf258a72-8c4e-4221-8aa9-cc2e7a04bb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:53.501605 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf258a72-8c4e-4221-8aa9-cc2e7a04bb00 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:53.502038 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf258a72-8c4e-4221-8aa9-cc2e7a04bb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:53.502535 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf258a72-8c4e-4221-8aa9-cc2e7a04bb00 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:53.517403 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf258a72-8c4e-4221-8aa9-cc2e7a04bb00 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:53.519430 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf258a72-8c4e-4221-8aa9-cc2e7a04bb00 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:53.534906 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 250/499] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:53 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:53.542111 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55ef71-aee7-4cfe-9ba8-24e093d5d975 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:53.558701 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55ef71-aee7-4cfe-9ba8-24e093d5d975 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:53.569472 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ccded-b243-47ba-bde5-d978602e116f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:53.570345 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ccded-b243-47ba-bde5-d978602e116f admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:53.570701 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ccded-b243-47ba-bde5-d978602e116f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:53.571065 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ccded-b243-47ba-bde5-d978602e116f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:53.589678 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ccded-b243-47ba-bde5-d978602e116f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:53.591568 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ccded-b243-47ba-bde5-d978602e116f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:53.616938 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-b47ccded-b243-47ba-bde5-d978602e116f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:53.618535 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 250/500] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:20:53.624837 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf258a72-8c4e-4221-8aa9-cc2e7a04bb00 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:53.636955 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf258a72-8c4e-4221-8aa9-cc2e7a04bb00 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:53.641888 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755f7ea-ca57-4860-b402-7db17a065d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:53.642703 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755f7ea-ca57-4860-b402-7db17a065d99 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:53.643138 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755f7ea-ca57-4860-b402-7db17a065d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:53.643624 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755f7ea-ca57-4860-b402-7db17a065d99 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:53.644498 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755f7ea-ca57-4860-b402-7db17a065d99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:53.644997 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755f7ea-ca57-4860-b402-7db17a065d99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:53.646763 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755f7ea-ca57-4860-b402-7db17a065d99 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:53.669014 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 251/501] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:53.675498 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ccded-b243-47ba-bde5-d978602e116f admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:53.690499 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ccded-b243-47ba-bde5-d978602e116f admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:53.697547 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1485c-4bb7-435e-b830-0773c924c880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:53.698414 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1485c-4bb7-435e-b830-0773c924c880 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:53.698773 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1485c-4bb7-435e-b830-0773c924c880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:53.699124 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1485c-4bb7-435e-b830-0773c924c880 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:53.718652 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1485c-4bb7-435e-b830-0773c924c880 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:53.720693 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1485c-4bb7-435e-b830-0773c924c880 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:53.737218 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-ebc1485c-4bb7-435e-b830-0773c924c880 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:20:53.738608 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 251/502] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:53.745307 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755f7ea-ca57-4860-b402-7db17a065d99 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:53.761599 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755f7ea-ca57-4860-b402-7db17a065d99 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:53.766457 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8b01b-4d4d-4b7d-a99c-b54a9dbd15b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:53.767321 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8b01b-4d4d-4b7d-a99c-b54a9dbd15b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:53.767844 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8b01b-4d4d-4b7d-a99c-b54a9dbd15b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:53.768270 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8b01b-4d4d-4b7d-a99c-b54a9dbd15b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:53.769259 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8b01b-4d4d-4b7d-a99c-b54a9dbd15b4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:53.769752 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8b01b-4d4d-4b7d-a99c-b54a9dbd15b4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:53.777505 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8b01b-4d4d-4b7d-a99c-b54a9dbd15b4 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:53.795607 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 252/503] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:20:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:53.802542 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1485c-4bb7-435e-b830-0773c924c880 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:53.818342 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1485c-4bb7-435e-b830-0773c924c880 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:53.830109 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b7632-c8df-4aff-a08a-534ac2d3de9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:53.830847 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b7632-c8df-4aff-a08a-534ac2d3de9d admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:53.831205 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b7632-c8df-4aff-a08a-534ac2d3de9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:53.831557 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b7632-c8df-4aff-a08a-534ac2d3de9d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:53.832472 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b7632-c8df-4aff-a08a-534ac2d3de9d admin admin] RBAC: Adding query filter params (role.id=983c0291e0fa484ea053a791ead0e9c5, scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6, user.id=f386f358fdb241f5a529a2cf3d839201) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:53.832854 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b7632-c8df-4aff-a08a-534ac2d3de9d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:53.834777 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b7632-c8df-4aff-a08a-534ac2d3de9d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:53.840873 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 252/504] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:20:53 2021] GET /identity/v3/role_assignments?user.id=f386f358fdb241f5a529a2cf3d839201&scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6&role.id=983c0291e0fa484ea053a791ead0e9c5 => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:54.467694 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f695f60-caa7-4e9e-beb5-4d7de7526bbf None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:54.468270 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f695f60-caa7-4e9e-beb5-4d7de7526bbf None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:54.468270 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f695f60-caa7-4e9e-beb5-4d7de7526bbf None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:54.470333 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 253/505] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:54.476648 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae6aab-9d7f-4859-a142-eda55ab116fd None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:54.477129 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae6aab-9d7f-4859-a142-eda55ab116fd None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:54.477316 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae6aab-9d7f-4859-a142-eda55ab116fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:54.502448 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-c2ae6aab-9d7f-4859-a142-eda55ab116fd None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:54.503637 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-c2ae6aab-9d7f-4859-a142-eda55ab116fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:54.511441 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 253/506] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:54.535981 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f695f60-caa7-4e9e-beb5-4d7de7526bbf None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:54.551428 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f695f60-caa7-4e9e-beb5-4d7de7526bbf None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:54.562091 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aace21-c2ac-494b-b749-4f9137eadef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:54.562881 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aace21-c2ac-494b-b749-4f9137eadef6 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:54.563164 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aace21-c2ac-494b-b749-4f9137eadef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:54.563442 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aace21-c2ac-494b-b749-4f9137eadef6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:54.578392 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aace21-c2ac-494b-b749-4f9137eadef6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:54.585384 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-00aace21-c2ac-494b-b749-4f9137eadef6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:20:54.586995 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 254/507] 10.222.0.25 () {56 vars in 1123 bytes} [Wed Oct 27 01:20:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:54.593194 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae6aab-9d7f-4859-a142-eda55ab116fd None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:54.602805 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae6aab-9d7f-4859-a142-eda55ab116fd None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:54.613659 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276edc3-93d6-45bd-8b5b-4d7ee49188cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:54.614337 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276edc3-93d6-45bd-8b5b-4d7ee49188cb admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:54.614620 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276edc3-93d6-45bd-8b5b-4d7ee49188cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:54.614897 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276edc3-93d6-45bd-8b5b-4d7ee49188cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:54.615663 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276edc3-93d6-45bd-8b5b-4d7ee49188cb admin admin] RBAC: Adding query filter params (name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:54.615969 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276edc3-93d6-45bd-8b5b-4d7ee49188cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:54.617602 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276edc3-93d6-45bd-8b5b-4d7ee49188cb admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:54.628949 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 254/508] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Oct 27 01:20:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:54.635783 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aace21-c2ac-494b-b749-4f9137eadef6 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:54.648732 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aace21-c2ac-494b-b749-4f9137eadef6 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:54.659502 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78326679-4cb4-4165-813d-e5272e69e26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:54.660291 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78326679-4cb4-4165-813d-e5272e69e26c admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:54.660572 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78326679-4cb4-4165-813d-e5272e69e26c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:54.660847 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78326679-4cb4-4165-813d-e5272e69e26c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:54.677240 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78326679-4cb4-4165-813d-e5272e69e26c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:54.679101 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78326679-4cb4-4165-813d-e5272e69e26c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:54.700633 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-78326679-4cb4-4165-813d-e5272e69e26c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:54.703022 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 255/509] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:54.708437 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276edc3-93d6-45bd-8b5b-4d7ee49188cb admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:54.719398 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276edc3-93d6-45bd-8b5b-4d7ee49188cb admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:54.730414 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09e852-3747-4b77-ba95-f171fa45030b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:54.731093 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09e852-3747-4b77-ba95-f171fa45030b admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:54.731379 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09e852-3747-4b77-ba95-f171fa45030b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:54.731657 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09e852-3747-4b77-ba95-f171fa45030b admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:54.732401 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09e852-3747-4b77-ba95-f171fa45030b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:54.732707 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09e852-3747-4b77-ba95-f171fa45030b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:54.734328 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09e852-3747-4b77-ba95-f171fa45030b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:54.759070 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 255/510] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:54.765410 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78326679-4cb4-4165-813d-e5272e69e26c admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:54.778423 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78326679-4cb4-4165-813d-e5272e69e26c admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:54.786085 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27972c8-c406-42be-85cf-c00c5fe90ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:54.786870 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27972c8-c406-42be-85cf-c00c5fe90ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:54.787153 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27972c8-c406-42be-85cf-c00c5fe90ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:54.787432 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27972c8-c406-42be-85cf-c00c5fe90ba0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:54.795435 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27972c8-c406-42be-85cf-c00c5fe90ba0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:54.797439 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27972c8-c406-42be-85cf-c00c5fe90ba0 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:54.816201 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-c27972c8-c406-42be-85cf-c00c5fe90ba0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:20:54.817546 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 256/511] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Oct 27 01:20:54 2021] GET /identity/v3/users/nova => generated 82 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:54.823969 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09e852-3747-4b77-ba95-f171fa45030b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:54.838533 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09e852-3747-4b77-ba95-f171fa45030b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:54.843121 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69653d01-3a80-44bd-86a2-b3ef261750b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:54.843774 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69653d01-3a80-44bd-86a2-b3ef261750b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:54.844058 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69653d01-3a80-44bd-86a2-b3ef261750b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:54.844356 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69653d01-3a80-44bd-86a2-b3ef261750b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:54.845185 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69653d01-3a80-44bd-86a2-b3ef261750b7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:54.845549 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69653d01-3a80-44bd-86a2-b3ef261750b7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:54.847343 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69653d01-3a80-44bd-86a2-b3ef261750b7 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:54.872249 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 256/512] 10.222.0.25 () {56 vars in 1154 bytes} [Wed Oct 27 01:20:54 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:54.878389 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27972c8-c406-42be-85cf-c00c5fe90ba0 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:54.894606 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27972c8-c406-42be-85cf-c00c5fe90ba0 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:54.900429 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58c396-5481-4ffb-b90b-c498badb141c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:54.901123 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58c396-5481-4ffb-b90b-c498badb141c admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:54.901411 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58c396-5481-4ffb-b90b-c498badb141c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:54.901714 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58c396-5481-4ffb-b90b-c498badb141c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:54.914377 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58c396-5481-4ffb-b90b-c498badb141c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:54.918168 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58c396-5481-4ffb-b90b-c498badb141c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:54.927747 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 257/513] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:54 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:54.934472 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69653d01-3a80-44bd-86a2-b3ef261750b7 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:54.946472 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69653d01-3a80-44bd-86a2-b3ef261750b7 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:54.960892 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20731563-cc7c-409a-acd2-3f0c02b29f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:54.967077 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20731563-cc7c-409a-acd2-3f0c02b29f2c admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:54.967416 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20731563-cc7c-409a-acd2-3f0c02b29f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:54.967703 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20731563-cc7c-409a-acd2-3f0c02b29f2c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:54.979720 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20731563-cc7c-409a-acd2-3f0c02b29f2c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:54.981471 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20731563-cc7c-409a-acd2-3f0c02b29f2c admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:54.998919 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-20731563-cc7c-409a-acd2-3f0c02b29f2c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:55.000502 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 257/514] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:55.006536 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58c396-5481-4ffb-b90b-c498badb141c admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:55.016954 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58c396-5481-4ffb-b90b-c498badb141c admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:55.025573 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bb790-e299-4c1d-877d-6a059add3d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:55.026236 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bb790-e299-4c1d-877d-6a059add3d77 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:55.026907 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bb790-e299-4c1d-877d-6a059add3d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:55.027184 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bb790-e299-4c1d-877d-6a059add3d77 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:55.028386 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631bb790-e299-4c1d-877d-6a059add3d77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:55.028689 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631bb790-e299-4c1d-877d-6a059add3d77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:55.030352 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631bb790-e299-4c1d-877d-6a059add3d77 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:55.050525 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 258/515] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:55.056913 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20731563-cc7c-409a-acd2-3f0c02b29f2c admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:55.068996 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20731563-cc7c-409a-acd2-3f0c02b29f2c admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:55.075986 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff611e0f-4293-43b0-ae92-91f634ac132c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:55.076780 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff611e0f-4293-43b0-ae92-91f634ac132c admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:55.077121 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff611e0f-4293-43b0-ae92-91f634ac132c admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:55.077400 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff611e0f-4293-43b0-ae92-91f634ac132c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:55.089614 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff611e0f-4293-43b0-ae92-91f634ac132c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:55.091625 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff611e0f-4293-43b0-ae92-91f634ac132c admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:55.106922 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-ff611e0f-4293-43b0-ae92-91f634ac132c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:20:55.108447 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 258/516] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:55.114536 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bb790-e299-4c1d-877d-6a059add3d77 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:55.125348 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bb790-e299-4c1d-877d-6a059add3d77 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:55.131095 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77423055-9f99-4bca-9e41-cc2a604609bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:55.131800 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77423055-9f99-4bca-9e41-cc2a604609bd admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:55.132187 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77423055-9f99-4bca-9e41-cc2a604609bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:55.132465 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77423055-9f99-4bca-9e41-cc2a604609bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:55.133307 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77423055-9f99-4bca-9e41-cc2a604609bd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:55.133672 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77423055-9f99-4bca-9e41-cc2a604609bd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:55.135689 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77423055-9f99-4bca-9e41-cc2a604609bd admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:55.154975 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 259/517] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:20:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:55.161602 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff611e0f-4293-43b0-ae92-91f634ac132c admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:55.173664 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff611e0f-4293-43b0-ae92-91f634ac132c admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:55.179580 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c69145-0a99-4467-970e-f5a3f70a8507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:55.180804 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c69145-0a99-4467-970e-f5a3f70a8507 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:55.181124 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c69145-0a99-4467-970e-f5a3f70a8507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:55.181402 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c69145-0a99-4467-970e-f5a3f70a8507 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:55.182361 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c69145-0a99-4467-970e-f5a3f70a8507 admin admin] RBAC: Adding query filter params (role.id=983c0291e0fa484ea053a791ead0e9c5, scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6, user.id=b2f8304b85b64dc4ac58523897306660) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:55.182672 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c69145-0a99-4467-970e-f5a3f70a8507 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:55.184812 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c69145-0a99-4467-970e-f5a3f70a8507 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:55.194127 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 259/518] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:20:55 2021] GET /identity/v3/role_assignments?user.id=b2f8304b85b64dc4ac58523897306660&scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6&role.id=983c0291e0fa484ea053a791ead0e9c5 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:55.469113 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cca176-7a23-4474-b47b-fed6eb998ee5 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:55.469827 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cca176-7a23-4474-b47b-fed6eb998ee5 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:55.469827 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cca176-7a23-4474-b47b-fed6eb998ee5 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:55.471685 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 260/519] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:55.478790 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d1827-cd22-47b4-b2d1-6e9011d353f5 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:55.479346 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d1827-cd22-47b4-b2d1-6e9011d353f5 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:55.479346 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d1827-cd22-47b4-b2d1-6e9011d353f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:55.502534 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-189d1827-cd22-47b4-b2d1-6e9011d353f5 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:55.504050 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-189d1827-cd22-47b4-b2d1-6e9011d353f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:55.514682 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 260/520] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:55.540717 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cca176-7a23-4474-b47b-fed6eb998ee5 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:55.560340 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cca176-7a23-4474-b47b-fed6eb998ee5 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:55.565307 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936ed1d-2008-4288-b321-93af7b26d694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:55.567395 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936ed1d-2008-4288-b321-93af7b26d694 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:55.567890 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936ed1d-2008-4288-b321-93af7b26d694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:55.568369 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936ed1d-2008-4288-b321-93af7b26d694 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:55.586184 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936ed1d-2008-4288-b321-93af7b26d694 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:55.594511 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-c936ed1d-2008-4288-b321-93af7b26d694 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:20:55.596229 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 261/521] 10.222.0.25 () {56 vars in 1123 bytes} [Wed Oct 27 01:20:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:55.603011 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d1827-cd22-47b4-b2d1-6e9011d353f5 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:55.612671 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d1827-cd22-47b4-b2d1-6e9011d353f5 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:55.621200 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98c492-d0d2-4f20-b247-42e9c9c3f3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:55.622078 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98c492-d0d2-4f20-b247-42e9c9c3f3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:55.622471 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98c492-d0d2-4f20-b247-42e9c9c3f3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:55.622854 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98c492-d0d2-4f20-b247-42e9c9c3f3d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:55.623724 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98c492-d0d2-4f20-b247-42e9c9c3f3d5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:55.624139 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98c492-d0d2-4f20-b247-42e9c9c3f3d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:55.625861 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98c492-d0d2-4f20-b247-42e9c9c3f3d5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:55.636769 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 261/522] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Oct 27 01:20:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:55.642882 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936ed1d-2008-4288-b321-93af7b26d694 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:55.654072 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936ed1d-2008-4288-b321-93af7b26d694 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:55.660596 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3788d-a7c8-4cf1-859a-f86fda48d9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:55.661531 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3788d-a7c8-4cf1-859a-f86fda48d9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:55.661928 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3788d-a7c8-4cf1-859a-f86fda48d9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:55.662309 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3788d-a7c8-4cf1-859a-f86fda48d9a1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:55.679915 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3788d-a7c8-4cf1-859a-f86fda48d9a1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:55.682407 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3788d-a7c8-4cf1-859a-f86fda48d9a1 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:55.701892 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-1ef3788d-a7c8-4cf1-859a-f86fda48d9a1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:55.703514 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 262/523] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:55.709674 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98c492-d0d2-4f20-b247-42e9c9c3f3d5 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:55.726968 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98c492-d0d2-4f20-b247-42e9c9c3f3d5 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:55.737799 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480a216-36ae-4783-b009-7c8782de9888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:55.738605 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480a216-36ae-4783-b009-7c8782de9888 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:55.738991 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480a216-36ae-4783-b009-7c8782de9888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:55.739372 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480a216-36ae-4783-b009-7c8782de9888 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:55.740223 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480a216-36ae-4783-b009-7c8782de9888 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:55.740655 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480a216-36ae-4783-b009-7c8782de9888 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:55.742387 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480a216-36ae-4783-b009-7c8782de9888 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:55.763971 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 262/524] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:55.770157 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3788d-a7c8-4cf1-859a-f86fda48d9a1 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:55.785067 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3788d-a7c8-4cf1-859a-f86fda48d9a1 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:55.793703 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04948e-92e3-4ccb-b30f-d53b291d37bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:55.794502 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04948e-92e3-4ccb-b30f-d53b291d37bf admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:55.794890 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04948e-92e3-4ccb-b30f-d53b291d37bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:55.795168 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04948e-92e3-4ccb-b30f-d53b291d37bf admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:55.806520 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04948e-92e3-4ccb-b30f-d53b291d37bf admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:55.808883 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04948e-92e3-4ccb-b30f-d53b291d37bf admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:55.828016 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-8e04948e-92e3-4ccb-b30f-d53b291d37bf admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 01:20:55.829230 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 263/525] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:55 2021] GET /identity/v3/users/cinder => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:55.835904 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480a216-36ae-4783-b009-7c8782de9888 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:55.842627 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c06cb-a32c-45c6-8b55-14562bc93de9 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:55.843151 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c06cb-a32c-45c6-8b55-14562bc93de9 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:55.843597 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c06cb-a32c-45c6-8b55-14562bc93de9 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:55.845952 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 264/526] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:20:55.852685 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3708d76-0237-456e-aa52-2e6079abe1d8 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:55.853205 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3708d76-0237-456e-aa52-2e6079abe1d8 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:55.854136 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3708d76-0237-456e-aa52-2e6079abe1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:55.855712 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480a216-36ae-4783-b009-7c8782de9888 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:55.874120 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-b3708d76-0237-456e-aa52-2e6079abe1d8 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:55.875649 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-b3708d76-0237-456e-aa52-2e6079abe1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:55.876453 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04ed22-620f-4948-a96d-3b65d4c0c203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:55.877249 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04ed22-620f-4948-a96d-3b65d4c0c203 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:55.877673 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04ed22-620f-4948-a96d-3b65d4c0c203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:55.878073 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04ed22-620f-4948-a96d-3b65d4c0c203 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:55.879157 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04ed22-620f-4948-a96d-3b65d4c0c203 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:55.879579 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04ed22-620f-4948-a96d-3b65d4c0c203 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:55.881516 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04ed22-620f-4948-a96d-3b65d4c0c203 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:55.889841 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 265/527] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:55.911064 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3708d76-0237-456e-aa52-2e6079abe1d8 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:55.920037 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 263/528] 10.222.0.25 () {56 vars in 1158 bytes} [Wed Oct 27 01:20:55 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:55.926757 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04ed22-620f-4948-a96d-3b65d4c0c203 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:55.928802 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3708d76-0237-456e-aa52-2e6079abe1d8 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:55.939583 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04ed22-620f-4948-a96d-3b65d4c0c203 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:55.941388 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b5426-6d6d-4621-8f40-2f50d1ab90f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:55.942218 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b5426-6d6d-4621-8f40-2f50d1ab90f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:55.942505 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b5426-6d6d-4621-8f40-2f50d1ab90f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:55.942813 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b5426-6d6d-4621-8f40-2f50d1ab90f9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:55.954998 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cc365-ee8c-427b-ab83-a4dadf68bee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:55.954998 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cc365-ee8c-427b-ab83-a4dadf68bee5 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:55.954998 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cc365-ee8c-427b-ab83-a4dadf68bee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:55.954998 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cc365-ee8c-427b-ab83-a4dadf68bee5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:55.965354 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b5426-6d6d-4621-8f40-2f50d1ab90f9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:55.973513 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-7e0b5426-6d6d-4621-8f40-2f50d1ab90f9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:20:55.973635 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431cc365-ee8c-427b-ab83-a4dadf68bee5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:55.973973 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 266/529] 10.222.0.25 () {56 vars in 1123 bytes} [Wed Oct 27 01:20:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:55.975534 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431cc365-ee8c-427b-ab83-a4dadf68bee5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:55.980537 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b5426-6d6d-4621-8f40-2f50d1ab90f9 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:55.985382 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 264/530] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:55 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:55.990927 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cc365-ee8c-427b-ab83-a4dadf68bee5 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.003749 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b5426-6d6d-4621-8f40-2f50d1ab90f9 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.004103 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cc365-ee8c-427b-ab83-a4dadf68bee5 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.011472 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcb045-35cf-4733-8340-47b7f988394d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.012129 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcb045-35cf-4733-8340-47b7f988394d admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.012420 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcb045-35cf-4733-8340-47b7f988394d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.012704 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcb045-35cf-4733-8340-47b7f988394d admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.013465 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bcb045-35cf-4733-8340-47b7f988394d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:56.013811 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bcb045-35cf-4733-8340-47b7f988394d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.015387 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bcb045-35cf-4733-8340-47b7f988394d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.017228 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45e224-78cf-488d-af29-ce4a0849d126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.018031 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45e224-78cf-488d-af29-ce4a0849d126 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.018313 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45e224-78cf-488d-af29-ce4a0849d126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.018590 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45e224-78cf-488d-af29-ce4a0849d126 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.027409 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 267/531] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Oct 27 01:20:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:56.029271 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c61aaa-b815-4886-91cd-93fbef21a8c2 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.029398 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45e224-78cf-488d-af29-ce4a0849d126 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.029987 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c61aaa-b815-4886-91cd-93fbef21a8c2 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.030465 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c61aaa-b815-4886-91cd-93fbef21a8c2 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.031250 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45e224-78cf-488d-af29-ce4a0849d126 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.032628 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 268/532] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:56.033743 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c61aaa-b815-4886-91cd-93fbef21a8c2 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.053773 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c61aaa-b815-4886-91cd-93fbef21a8c2 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.058796 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-6e45e224-78cf-488d-af29-ce4a0849d126 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:56.059273 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb733cfa-3976-4fb9-a3ed-eb3bdd17ca17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.060080 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb733cfa-3976-4fb9-a3ed-eb3bdd17ca17 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.060381 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb733cfa-3976-4fb9-a3ed-eb3bdd17ca17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.060660 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb733cfa-3976-4fb9-a3ed-eb3bdd17ca17 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.061518 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 265/533] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:56.062964 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22ec39-11c8-40dd-b0d6-bb2ddaa5d8dc None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.063491 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22ec39-11c8-40dd-b0d6-bb2ddaa5d8dc None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.064001 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22ec39-11c8-40dd-b0d6-bb2ddaa5d8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.078262 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb733cfa-3976-4fb9-a3ed-eb3bdd17ca17 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.080836 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb733cfa-3976-4fb9-a3ed-eb3bdd17ca17 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.084739 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-5a22ec39-11c8-40dd-b0d6-bb2ddaa5d8dc None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:56.086185 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-5a22ec39-11c8-40dd-b0d6-bb2ddaa5d8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:56.095491 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 266/534] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:56.096482 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22ec39-11c8-40dd-b0d6-bb2ddaa5d8dc None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.100802 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-fb733cfa-3976-4fb9-a3ed-eb3bdd17ca17 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:56.108074 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 269/535] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:56.110539 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb733cfa-3976-4fb9-a3ed-eb3bdd17ca17 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.113147 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22ec39-11c8-40dd-b0d6-bb2ddaa5d8dc None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.126613 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7bf83-506d-4ebf-90bf-86bb96eebf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.127263 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7bf83-506d-4ebf-90bf-86bb96eebf5b admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.127550 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7bf83-506d-4ebf-90bf-86bb96eebf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.127826 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7bf83-506d-4ebf-90bf-86bb96eebf5b admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.128554 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7bf83-506d-4ebf-90bf-86bb96eebf5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:56.128858 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7bf83-506d-4ebf-90bf-86bb96eebf5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.130480 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7bf83-506d-4ebf-90bf-86bb96eebf5b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.132207 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb733cfa-3976-4fb9-a3ed-eb3bdd17ca17 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.138294 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603eec2-924c-4447-9aa7-0f2094c74924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.139174 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603eec2-924c-4447-9aa7-0f2094c74924 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.140089 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603eec2-924c-4447-9aa7-0f2094c74924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.140836 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603eec2-924c-4447-9aa7-0f2094c74924 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.141804 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603eec2-924c-4447-9aa7-0f2094c74924 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:56.142339 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603eec2-924c-4447-9aa7-0f2094c74924 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.142943 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 267/536] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:56.144676 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603eec2-924c-4447-9aa7-0f2094c74924 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.148700 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7bf83-506d-4ebf-90bf-86bb96eebf5b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.157641 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 270/537] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:56.158740 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603eec2-924c-4447-9aa7-0f2094c74924 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.159462 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7bf83-506d-4ebf-90bf-86bb96eebf5b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.165356 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9a4f6-f40c-4d23-9cab-5a0649caf19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.166183 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9a4f6-f40c-4d23-9cab-5a0649caf19c admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.166468 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9a4f6-f40c-4d23-9cab-5a0649caf19c admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.166795 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9a4f6-f40c-4d23-9cab-5a0649caf19c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.170105 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603eec2-924c-4447-9aa7-0f2094c74924 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.174975 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099df04e-c991-464b-8b22-f381f5d1db08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.175977 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099df04e-c991-464b-8b22-f381f5d1db08 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.176462 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099df04e-c991-464b-8b22-f381f5d1db08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.176942 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099df04e-c991-464b-8b22-f381f5d1db08 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.178179 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9a4f6-f40c-4d23-9cab-5a0649caf19c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:56.185272 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099df04e-c991-464b-8b22-f381f5d1db08 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.186501 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-3aa9a4f6-f40c-4d23-9cab-5a0649caf19c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:20:56.187706 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099df04e-c991-464b-8b22-f381f5d1db08 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.193031 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 268/538] 10.222.0.25 () {56 vars in 1123 bytes} [Wed Oct 27 01:20:56 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:56.193031 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9a4f6-f40c-4d23-9cab-5a0649caf19c admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.202991 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9a4f6-f40c-4d23-9cab-5a0649caf19c admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.207755 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895049e-fdc1-4394-8430-2de7071ccc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.208435 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-099df04e-c991-464b-8b22-f381f5d1db08 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:20:56.208545 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895049e-fdc1-4394-8430-2de7071ccc39 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.208884 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895049e-fdc1-4394-8430-2de7071ccc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.209162 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895049e-fdc1-4394-8430-2de7071ccc39 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.210637 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 271/539] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:56.211713 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099df04e-c991-464b-8b22-f381f5d1db08 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.221406 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099df04e-c991-464b-8b22-f381f5d1db08 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.223590 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895049e-fdc1-4394-8430-2de7071ccc39 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.226274 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895049e-fdc1-4394-8430-2de7071ccc39 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.226712 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbbad0-b35a-4e2f-86f1-7eb7c7af603f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.228119 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbbad0-b35a-4e2f-86f1-7eb7c7af603f admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.228612 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbbad0-b35a-4e2f-86f1-7eb7c7af603f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.229093 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbbad0-b35a-4e2f-86f1-7eb7c7af603f admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.230095 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbbad0-b35a-4e2f-86f1-7eb7c7af603f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:56.230661 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbbad0-b35a-4e2f-86f1-7eb7c7af603f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.232439 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbbad0-b35a-4e2f-86f1-7eb7c7af603f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.240996 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 272/540] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Oct 27 01:20:56 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:56.245518 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbbad0-b35a-4e2f-86f1-7eb7c7af603f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.245676 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-8895049e-fdc1-4394-8430-2de7071ccc39 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 27 01:20:56.245676 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 269/541] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:56 2021] GET /identity/v3/users/glance => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:56.249712 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895049e-fdc1-4394-8430-2de7071ccc39 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.258601 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbbad0-b35a-4e2f-86f1-7eb7c7af603f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.261462 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895049e-fdc1-4394-8430-2de7071ccc39 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.263840 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3ce92-3676-462b-9ec9-589ffb6888aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.264748 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3ce92-3676-462b-9ec9-589ffb6888aa admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.265298 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3ce92-3676-462b-9ec9-589ffb6888aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.265806 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3ce92-3676-462b-9ec9-589ffb6888aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.266333 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d6e39-6104-49b9-a8cf-af5bd92efcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.267097 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d6e39-6104-49b9-a8cf-af5bd92efcd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.267369 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3ce92-3676-462b-9ec9-589ffb6888aa admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:56.267487 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d6e39-6104-49b9-a8cf-af5bd92efcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.267660 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d6e39-6104-49b9-a8cf-af5bd92efcd0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.268197 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3ce92-3676-462b-9ec9-589ffb6888aa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.270362 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3ce92-3676-462b-9ec9-589ffb6888aa admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.279502 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d6e39-6104-49b9-a8cf-af5bd92efcd0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.282071 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d6e39-6104-49b9-a8cf-af5bd92efcd0 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.284282 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 273/542] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:20:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:56.285317 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3ce92-3676-462b-9ec9-589ffb6888aa admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.300089 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3ce92-3676-462b-9ec9-589ffb6888aa admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.305126 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73105787-6ba1-46f9-9c7b-e517bdec3cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.306167 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73105787-6ba1-46f9-9c7b-e517bdec3cbb admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.306713 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73105787-6ba1-46f9-9c7b-e517bdec3cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.306834 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-373d6e39-6104-49b9-a8cf-af5bd92efcd0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:56.307335 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73105787-6ba1-46f9-9c7b-e517bdec3cbb admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.308372 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 270/543] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:56.313845 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d6e39-6104-49b9-a8cf-af5bd92efcd0 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.313961 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73105787-6ba1-46f9-9c7b-e517bdec3cbb admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:56.314038 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73105787-6ba1-46f9-9c7b-e517bdec3cbb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.319434 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73105787-6ba1-46f9-9c7b-e517bdec3cbb admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.324627 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d6e39-6104-49b9-a8cf-af5bd92efcd0 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.329664 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076052d-1169-4a29-88f9-21c44c678d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.331136 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076052d-1169-4a29-88f9-21c44c678d05 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.331500 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076052d-1169-4a29-88f9-21c44c678d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.331845 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076052d-1169-4a29-88f9-21c44c678d05 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.332770 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076052d-1169-4a29-88f9-21c44c678d05 admin admin] RBAC: Adding query filter params (role.id=983c0291e0fa484ea053a791ead0e9c5, scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6, user.id=1819142aab4743fbb9e056ba61e3d474) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:56.333150 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076052d-1169-4a29-88f9-21c44c678d05 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.335088 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076052d-1169-4a29-88f9-21c44c678d05 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.343784 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 274/545] 10.222.0.25 () {56 vars in 1158 bytes} [Wed Oct 27 01:20:56 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:56.345016 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73105787-6ba1-46f9-9c7b-e517bdec3cbb admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.348882 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 271/545] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:20:56 2021] GET /identity/v3/role_assignments?user.id=1819142aab4743fbb9e056ba61e3d474&scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6&role.id=983c0291e0fa484ea053a791ead0e9c5 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:56.349968 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076052d-1169-4a29-88f9-21c44c678d05 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.360110 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73105787-6ba1-46f9-9c7b-e517bdec3cbb admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.365236 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9f025-c4ac-4c3a-b3f1-64a15f8b39ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.366243 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9f025-c4ac-4c3a-b3f1-64a15f8b39ec admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.366477 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076052d-1169-4a29-88f9-21c44c678d05 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.366954 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9f025-c4ac-4c3a-b3f1-64a15f8b39ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.367415 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9f025-c4ac-4c3a-b3f1-64a15f8b39ec admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.369206 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9f025-c4ac-4c3a-b3f1-64a15f8b39ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:56.369753 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9f025-c4ac-4c3a-b3f1-64a15f8b39ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.371696 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9f025-c4ac-4c3a-b3f1-64a15f8b39ec admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.373284 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d769735-d7c4-40ed-af05-d7dbf998df20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.374294 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d769735-d7c4-40ed-af05-d7dbf998df20 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.374647 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d769735-d7c4-40ed-af05-d7dbf998df20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.375001 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d769735-d7c4-40ed-af05-d7dbf998df20 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.385966 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 275/546] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:56.394539 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d769735-d7c4-40ed-af05-d7dbf998df20 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.396761 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d769735-d7c4-40ed-af05-d7dbf998df20 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.407771 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9f025-c4ac-4c3a-b3f1-64a15f8b39ec admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.408754 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 272/547] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:56 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:20:56.421526 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d769735-d7c4-40ed-af05-d7dbf998df20 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.425554 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9f025-c4ac-4c3a-b3f1-64a15f8b39ec admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.430552 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1e323-b99d-4257-82be-fe48feed0a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.431430 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d769735-d7c4-40ed-af05-d7dbf998df20 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.431938 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1e323-b99d-4257-82be-fe48feed0a79 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.432428 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1e323-b99d-4257-82be-fe48feed0a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.433169 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1e323-b99d-4257-82be-fe48feed0a79 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.442333 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1e323-b99d-4257-82be-fe48feed0a79 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.444825 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1e323-b99d-4257-82be-fe48feed0a79 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.447344 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0847e-192a-492c-b855-cdbbf2c4efed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.448227 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0847e-192a-492c-b855-cdbbf2c4efed admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.448517 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0847e-192a-492c-b855-cdbbf2c4efed admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.448801 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0847e-192a-492c-b855-cdbbf2c4efed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.462732 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-d2b1e323-b99d-4257-82be-fe48feed0a79 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 01:20:56.464336 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 276/548] 10.222.0.25 () {56 vars in 1123 bytes} [Wed Oct 27 01:20:56 2021] GET /identity/v3/users/neutron => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:20:56.468494 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0847e-192a-492c-b855-cdbbf2c4efed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.470800 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1e323-b99d-4257-82be-fe48feed0a79 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.477388 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0847e-192a-492c-b855-cdbbf2c4efed admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.485519 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1e323-b99d-4257-82be-fe48feed0a79 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.497417 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ad16d-30cd-4f05-aa37-7c10ce18dc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.504364 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ad16d-30cd-4f05-aa37-7c10ce18dc82 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.504985 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ad16d-30cd-4f05-aa37-7c10ce18dc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.505466 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ad16d-30cd-4f05-aa37-7c10ce18dc82 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.506591 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ad16d-30cd-4f05-aa37-7c10ce18dc82 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:56.507108 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ad16d-30cd-4f05-aa37-7c10ce18dc82 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.509244 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ad16d-30cd-4f05-aa37-7c10ce18dc82 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.513374 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-6df0847e-192a-492c-b855-cdbbf2c4efed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:56.516298 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 273/549] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:20:56.527860 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0847e-192a-492c-b855-cdbbf2c4efed admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.546306 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 277/550] 10.222.0.25 () {56 vars in 1160 bytes} [Wed Oct 27 01:20:56 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:56.548886 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0847e-192a-492c-b855-cdbbf2c4efed admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.552551 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ad16d-30cd-4f05-aa37-7c10ce18dc82 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.564006 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ad16d-30cd-4f05-aa37-7c10ce18dc82 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.564823 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45ca05-f82b-4993-815a-59aefab9c175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.565532 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45ca05-f82b-4993-815a-59aefab9c175 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.565815 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45ca05-f82b-4993-815a-59aefab9c175 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.566086 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45ca05-f82b-4993-815a-59aefab9c175 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.566847 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45ca05-f82b-4993-815a-59aefab9c175 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:56.567153 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45ca05-f82b-4993-815a-59aefab9c175 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.568758 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45ca05-f82b-4993-815a-59aefab9c175 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.583315 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87b38e-bd0b-455b-b79d-6201afbf0a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.583978 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87b38e-bd0b-455b-b79d-6201afbf0a51 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.584265 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87b38e-bd0b-455b-b79d-6201afbf0a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.584539 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87b38e-bd0b-455b-b79d-6201afbf0a51 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.592804 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 274/551] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:56.596689 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87b38e-bd0b-455b-b79d-6201afbf0a51 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.598717 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87b38e-bd0b-455b-b79d-6201afbf0a51 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.599691 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45ca05-f82b-4993-815a-59aefab9c175 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.616844 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45ca05-f82b-4993-815a-59aefab9c175 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.618801 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 278/552] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:56 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:20:56.624662 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67652777-50dc-4ce8-a765-c13cfd05cf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.625535 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67652777-50dc-4ce8-a765-c13cfd05cf2e admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.625818 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87b38e-bd0b-455b-b79d-6201afbf0a51 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.625945 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67652777-50dc-4ce8-a765-c13cfd05cf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.626124 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67652777-50dc-4ce8-a765-c13cfd05cf2e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.635143 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67652777-50dc-4ce8-a765-c13cfd05cf2e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.636667 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67652777-50dc-4ce8-a765-c13cfd05cf2e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.639694 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87b38e-bd0b-455b-b79d-6201afbf0a51 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.646298 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31d830-e3eb-4b42-9b46-d0e9689c4856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.647348 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31d830-e3eb-4b42-9b46-d0e9689c4856 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.647840 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31d830-e3eb-4b42-9b46-d0e9689c4856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.648715 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31d830-e3eb-4b42-9b46-d0e9689c4856 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.653343 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-67652777-50dc-4ce8-a765-c13cfd05cf2e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:20:56.654745 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 275/553] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:20:56.660768 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67652777-50dc-4ce8-a765-c13cfd05cf2e admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.662219 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31d830-e3eb-4b42-9b46-d0e9689c4856 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.664419 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31d830-e3eb-4b42-9b46-d0e9689c4856 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.675105 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67652777-50dc-4ce8-a765-c13cfd05cf2e admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.679801 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d318c31-1492-45b7-a116-b2608e17cee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.680530 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d318c31-1492-45b7-a116-b2608e17cee3 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.680862 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d318c31-1492-45b7-a116-b2608e17cee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.681145 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d318c31-1492-45b7-a116-b2608e17cee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.682037 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d318c31-1492-45b7-a116-b2608e17cee3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:56.682346 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d318c31-1492-45b7-a116-b2608e17cee3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.684646 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d318c31-1492-45b7-a116-b2608e17cee3 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.687732 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-ee31d830-e3eb-4b42-9b46-d0e9689c4856 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:56.689468 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 279/554] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:56.697651 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31d830-e3eb-4b42-9b46-d0e9689c4856 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.702423 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 276/555] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:20:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:56.708923 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d318c31-1492-45b7-a116-b2608e17cee3 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.710802 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31d830-e3eb-4b42-9b46-d0e9689c4856 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.717544 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159d853-3037-4d65-a1a7-a2b827183fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.718308 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159d853-3037-4d65-a1a7-a2b827183fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.718598 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159d853-3037-4d65-a1a7-a2b827183fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.718881 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159d853-3037-4d65-a1a7-a2b827183fd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.719668 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4159d853-3037-4d65-a1a7-a2b827183fd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:56.719981 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4159d853-3037-4d65-a1a7-a2b827183fd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.721746 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4159d853-3037-4d65-a1a7-a2b827183fd5 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.721962 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d318c31-1492-45b7-a116-b2608e17cee3 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.728264 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d33f1-71e9-4d09-b4a1-7f15f31c70c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.729153 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d33f1-71e9-4d09-b4a1-7f15f31c70c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.729612 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d33f1-71e9-4d09-b4a1-7f15f31c70c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.730058 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d33f1-71e9-4d09-b4a1-7f15f31c70c7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.731078 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d33f1-71e9-4d09-b4a1-7f15f31c70c7 admin admin] RBAC: Adding query filter params (role.id=983c0291e0fa484ea053a791ead0e9c5, scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6, user.id=32003a40693246d08640bc7ec45adfc2) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:56.731552 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d33f1-71e9-4d09-b4a1-7f15f31c70c7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.733604 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d33f1-71e9-4d09-b4a1-7f15f31c70c7 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.740578 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 277/556] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:20:56 2021] GET /identity/v3/role_assignments?user.id=32003a40693246d08640bc7ec45adfc2&scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6&role.id=983c0291e0fa484ea053a791ead0e9c5 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:56.745612 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 280/557] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:56.746933 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d33f1-71e9-4d09-b4a1-7f15f31c70c7 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.758297 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d33f1-71e9-4d09-b4a1-7f15f31c70c7 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.764042 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1196ae-3e32-4bdf-8cbd-134e8f15f6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.765363 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1196ae-3e32-4bdf-8cbd-134e8f15f6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.766065 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1196ae-3e32-4bdf-8cbd-134e8f15f6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.766620 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1196ae-3e32-4bdf-8cbd-134e8f15f6d8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.776173 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1196ae-3e32-4bdf-8cbd-134e8f15f6d8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.778795 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1196ae-3e32-4bdf-8cbd-134e8f15f6d8 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.794872 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-5a1196ae-3e32-4bdf-8cbd-134e8f15f6d8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:20:56.801643 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 278/558] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:56.803650 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159d853-3037-4d65-a1a7-a2b827183fd5 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.814915 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159d853-3037-4d65-a1a7-a2b827183fd5 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.820283 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef06b2-f3a2-4f21-a7d2-d190878920ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.821928 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef06b2-f3a2-4f21-a7d2-d190878920ea admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.822425 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef06b2-f3a2-4f21-a7d2-d190878920ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.822926 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef06b2-f3a2-4f21-a7d2-d190878920ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.823919 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef06b2-f3a2-4f21-a7d2-d190878920ea admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:56.824459 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef06b2-f3a2-4f21-a7d2-d190878920ea admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.826625 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef06b2-f3a2-4f21-a7d2-d190878920ea admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.845639 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 281/559] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:20:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:56.848973 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1196ae-3e32-4bdf-8cbd-134e8f15f6d8 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.860841 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1196ae-3e32-4bdf-8cbd-134e8f15f6d8 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.866074 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d4008-309c-44d1-8c74-cb9bd6ed1182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.867036 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d4008-309c-44d1-8c74-cb9bd6ed1182 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.867585 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d4008-309c-44d1-8c74-cb9bd6ed1182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.868606 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d4008-309c-44d1-8c74-cb9bd6ed1182 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.869861 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d4008-309c-44d1-8c74-cb9bd6ed1182 admin admin] RBAC: Adding query filter params (role.id=983c0291e0fa484ea053a791ead0e9c5, scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6, user.id=bff692322c68420186f2918d380ece98) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:56.870358 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d4008-309c-44d1-8c74-cb9bd6ed1182 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.872509 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d4008-309c-44d1-8c74-cb9bd6ed1182 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.883942 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 279/560] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:20:56 2021] GET /identity/v3/role_assignments?user.id=bff692322c68420186f2918d380ece98&scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6&role.id=983c0291e0fa484ea053a791ead0e9c5 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:56.903555 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feddc46-3a67-422b-a836-55db98bc3bb3 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.903867 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feddc46-3a67-422b-a836-55db98bc3bb3 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.904127 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feddc46-3a67-422b-a836-55db98bc3bb3 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.906125 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 282/561] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:56.912894 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7562b-a526-40c9-9d2b-8bbdbde42c0d None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.913206 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7562b-a526-40c9-9d2b-8bbdbde42c0d None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.913450 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7562b-a526-40c9-9d2b-8bbdbde42c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.935691 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-5eb7562b-a526-40c9-9d2b-8bbdbde42c0d None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:56.936937 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-5eb7562b-a526-40c9-9d2b-8bbdbde42c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:56.949657 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 280/562] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:56.970213 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feddc46-3a67-422b-a836-55db98bc3bb3 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.984723 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feddc46-3a67-422b-a836-55db98bc3bb3 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.999211 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da05912-5906-415b-b801-5334f0a82339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.999947 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da05912-5906-415b-b801-5334f0a82339 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:57.000295 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da05912-5906-415b-b801-5334f0a82339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:57.000576 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da05912-5906-415b-b801-5334f0a82339 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:57.015558 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da05912-5906-415b-b801-5334f0a82339 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:57.023039 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-7da05912-5906-415b-b801-5334f0a82339 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:20:57.024380 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 283/563] 10.222.0.25 () {56 vars in 1123 bytes} [Wed Oct 27 01:20:56 2021] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:57.031497 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7562b-a526-40c9-9d2b-8bbdbde42c0d None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:57.042471 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7562b-a526-40c9-9d2b-8bbdbde42c0d None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:57.047257 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c330ee7-b994-4d7b-9a49-c217698de846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:57.047941 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c330ee7-b994-4d7b-9a49-c217698de846 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:57.048229 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c330ee7-b994-4d7b-9a49-c217698de846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:57.048511 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c330ee7-b994-4d7b-9a49-c217698de846 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:57.049282 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c330ee7-b994-4d7b-9a49-c217698de846 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:57.049625 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c330ee7-b994-4d7b-9a49-c217698de846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:57.051295 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c330ee7-b994-4d7b-9a49-c217698de846 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:57.062581 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 281/564] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Oct 27 01:20:57 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:57.069119 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da05912-5906-415b-b801-5334f0a82339 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:57.083488 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da05912-5906-415b-b801-5334f0a82339 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:57.088970 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21afe0-97b1-4363-83de-4d93b3f2654a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:57.089851 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21afe0-97b1-4363-83de-4d93b3f2654a admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:57.090193 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21afe0-97b1-4363-83de-4d93b3f2654a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:57.090472 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21afe0-97b1-4363-83de-4d93b3f2654a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:57.103433 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21afe0-97b1-4363-83de-4d93b3f2654a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:57.105396 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21afe0-97b1-4363-83de-4d93b3f2654a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:57.123576 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-ce21afe0-97b1-4363-83de-4d93b3f2654a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:57.124888 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 284/565] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:57.131802 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c330ee7-b994-4d7b-9a49-c217698de846 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:57.143901 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c330ee7-b994-4d7b-9a49-c217698de846 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:57.147488 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146af17a-d1d8-41f4-886c-775db8dba638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:57.148206 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146af17a-d1d8-41f4-886c-775db8dba638 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:57.148492 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146af17a-d1d8-41f4-886c-775db8dba638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:57.148769 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146af17a-d1d8-41f4-886c-775db8dba638 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:57.149666 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146af17a-d1d8-41f4-886c-775db8dba638 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:57.149975 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146af17a-d1d8-41f4-886c-775db8dba638 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:57.151662 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146af17a-d1d8-41f4-886c-775db8dba638 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:57.167716 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 282/566] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:57.173084 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21afe0-97b1-4363-83de-4d93b3f2654a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:57.186075 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21afe0-97b1-4363-83de-4d93b3f2654a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:57.190583 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdda59-bf19-47f5-b4d5-a8b648175399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:57.191377 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdda59-bf19-47f5-b4d5-a8b648175399 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:57.191664 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdda59-bf19-47f5-b4d5-a8b648175399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:57.191944 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdda59-bf19-47f5-b4d5-a8b648175399 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:57.201671 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bdda59-bf19-47f5-b4d5-a8b648175399 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:57.203681 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bdda59-bf19-47f5-b4d5-a8b648175399 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:57.217366 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-52bdda59-bf19-47f5-b4d5-a8b648175399 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 01:20:57.218895 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 285/567] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:20:57 2021] GET /identity/v3/users/swift => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:57.226455 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146af17a-d1d8-41f4-886c-775db8dba638 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:57.239069 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146af17a-d1d8-41f4-886c-775db8dba638 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:57.245366 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10198b-5b29-48e9-88a9-ae3836879fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:57.246264 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10198b-5b29-48e9-88a9-ae3836879fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:57.246695 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10198b-5b29-48e9-88a9-ae3836879fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:57.247116 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10198b-5b29-48e9-88a9-ae3836879fa3 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:57.248277 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10198b-5b29-48e9-88a9-ae3836879fa3 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:57.248785 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10198b-5b29-48e9-88a9-ae3836879fa3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:57.254887 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10198b-5b29-48e9-88a9-ae3836879fa3 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:57.275859 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 283/568] 10.222.0.25 () {56 vars in 1156 bytes} [Wed Oct 27 01:20:57 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:57.281903 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdda59-bf19-47f5-b4d5-a8b648175399 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:57.294758 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdda59-bf19-47f5-b4d5-a8b648175399 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:57.306180 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836a2e9-1531-4c11-b76e-13cfeb0fd7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:57.307059 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836a2e9-1531-4c11-b76e-13cfeb0fd7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:57.307436 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836a2e9-1531-4c11-b76e-13cfeb0fd7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:57.308033 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836a2e9-1531-4c11-b76e-13cfeb0fd7b6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:57.325088 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836a2e9-1531-4c11-b76e-13cfeb0fd7b6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:57.326938 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836a2e9-1531-4c11-b76e-13cfeb0fd7b6 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:57.357687 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-6836a2e9-1531-4c11-b76e-13cfeb0fd7b6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:57.358915 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 286/569] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:57.365157 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10198b-5b29-48e9-88a9-ae3836879fa3 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:57.381208 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10198b-5b29-48e9-88a9-ae3836879fa3 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:57.391253 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba3448-9513-4a51-b6b3-407de3002a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:57.391921 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba3448-9513-4a51-b6b3-407de3002a54 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:57.392211 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba3448-9513-4a51-b6b3-407de3002a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:57.392494 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba3448-9513-4a51-b6b3-407de3002a54 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:57.393303 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba3448-9513-4a51-b6b3-407de3002a54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:57.393715 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba3448-9513-4a51-b6b3-407de3002a54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:57.395376 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba3448-9513-4a51-b6b3-407de3002a54 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:57.415158 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 284/570] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:57.421430 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836a2e9-1531-4c11-b76e-13cfeb0fd7b6 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:57.435256 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836a2e9-1531-4c11-b76e-13cfeb0fd7b6 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:57.442976 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce5a5d-44be-417d-9c3d-58b2b36ed03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:57.443763 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce5a5d-44be-417d-9c3d-58b2b36ed03d admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:57.444046 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce5a5d-44be-417d-9c3d-58b2b36ed03d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:57.444322 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce5a5d-44be-417d-9c3d-58b2b36ed03d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:57.456375 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce5a5d-44be-417d-9c3d-58b2b36ed03d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:57.458427 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce5a5d-44be-417d-9c3d-58b2b36ed03d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:57.480260 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-95ce5a5d-44be-417d-9c3d-58b2b36ed03d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:20:57.481640 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 287/571] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:57.488008 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba3448-9513-4a51-b6b3-407de3002a54 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:57.501884 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba3448-9513-4a51-b6b3-407de3002a54 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:57.511448 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270da6b-927e-4088-b4e7-2e346951740c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:57.512057 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270da6b-927e-4088-b4e7-2e346951740c admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:57.512344 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270da6b-927e-4088-b4e7-2e346951740c admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:57.512680 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270da6b-927e-4088-b4e7-2e346951740c admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:57.513549 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270da6b-927e-4088-b4e7-2e346951740c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:57.514128 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270da6b-927e-4088-b4e7-2e346951740c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:57.515896 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270da6b-927e-4088-b4e7-2e346951740c admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:57.538438 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 285/572] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:20:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:57.545122 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce5a5d-44be-417d-9c3d-58b2b36ed03d admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:57.555017 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce5a5d-44be-417d-9c3d-58b2b36ed03d admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:57.566980 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14f6da-6be0-4d60-b475-53a83cc5b9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:57.568113 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14f6da-6be0-4d60-b475-53a83cc5b9bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:57.568591 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14f6da-6be0-4d60-b475-53a83cc5b9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:57.569062 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14f6da-6be0-4d60-b475-53a83cc5b9bd admin admin] PATH_INFO: `/v3/projects/2b95c6a455e74d9487ae73f44a9ba0e6/users/f386f358fdb241f5a529a2cf3d839201/roles/983c0291e0fa484ea053a791ead0e9c5` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:57.591708 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14f6da-6be0-4d60-b475-53a83cc5b9bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b95c6a455e74d9487ae73f44a9ba0e6, user_id=f386f358fdb241f5a529a2cf3d839201, role_id=983c0291e0fa484ea053a791ead0e9c5)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:57.594654 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14f6da-6be0-4d60-b475-53a83cc5b9bd admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:57.613464 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 288/573] 10.222.0.25 () {58 vars in 1460 bytes} [Wed Oct 27 01:20:57 2021] PUT /identity/v3/projects/2b95c6a455e74d9487ae73f44a9ba0e6/users/f386f358fdb241f5a529a2cf3d839201/roles/983c0291e0fa484ea053a791ead0e9c5 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:57.999380 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce29eb5-0ce2-4e2d-ae58-fe808b3638fa None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:58.000027 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce29eb5-0ce2-4e2d-ae58-fe808b3638fa None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:58.000497 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce29eb5-0ce2-4e2d-ae58-fe808b3638fa None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:58.002918 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 286/574] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:57 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:58.008825 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a761ea1-165d-4791-b33f-b84c461e6ecb None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:58.009363 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a761ea1-165d-4791-b33f-b84c461e6ecb None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:58.009856 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a761ea1-165d-4791-b33f-b84c461e6ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:58.031459 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-8a761ea1-165d-4791-b33f-b84c461e6ecb None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:58.032671 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-8a761ea1-165d-4791-b33f-b84c461e6ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:58.103866 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 289/575] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:58.128598 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce29eb5-0ce2-4e2d-ae58-fe808b3638fa None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:58.147284 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce29eb5-0ce2-4e2d-ae58-fe808b3638fa None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:58.153406 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0afd47-4c92-40b8-9791-5bb5656f4ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:58.154486 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0afd47-4c92-40b8-9791-5bb5656f4ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:58.154962 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0afd47-4c92-40b8-9791-5bb5656f4ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:58.155429 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0afd47-4c92-40b8-9791-5bb5656f4ff8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:58.178426 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0afd47-4c92-40b8-9791-5bb5656f4ff8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:20:58.186405 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-6e0afd47-4c92-40b8-9791-5bb5656f4ff8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:20:58.188147 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 287/576] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:20:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:58.194314 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a761ea1-165d-4791-b33f-b84c461e6ecb None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:58.206598 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a761ea1-165d-4791-b33f-b84c461e6ecb None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:58.214807 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea31d6d-72ba-4eeb-ba09-735e7db068ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:58.215481 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea31d6d-72ba-4eeb-ba09-735e7db068ca admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:58.215764 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea31d6d-72ba-4eeb-ba09-735e7db068ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:58.216042 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea31d6d-72ba-4eeb-ba09-735e7db068ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:58.216816 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea31d6d-72ba-4eeb-ba09-735e7db068ca admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:58.217123 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea31d6d-72ba-4eeb-ba09-735e7db068ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:58.218796 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea31d6d-72ba-4eeb-ba09-735e7db068ca admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:58.233124 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 290/577] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:20:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:58.238877 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0afd47-4c92-40b8-9791-5bb5656f4ff8 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:58.252958 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0afd47-4c92-40b8-9791-5bb5656f4ff8 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:58.261703 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb3267-e962-48d5-b9fc-789b8594d1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:58.262737 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb3267-e962-48d5-b9fc-789b8594d1fd admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:58.263239 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb3267-e962-48d5-b9fc-789b8594d1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:58.263725 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb3267-e962-48d5-b9fc-789b8594d1fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:58.281025 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb3267-e962-48d5-b9fc-789b8594d1fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:58.283143 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb3267-e962-48d5-b9fc-789b8594d1fd admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:58.304780 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-3abb3267-e962-48d5-b9fc-789b8594d1fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:58.306831 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 288/578] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:58.313354 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea31d6d-72ba-4eeb-ba09-735e7db068ca admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:58.326494 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea31d6d-72ba-4eeb-ba09-735e7db068ca admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:58.337092 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1185d48-cc67-4859-ae73-f0cdd1773028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:58.337783 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1185d48-cc67-4859-ae73-f0cdd1773028 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:58.338066 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1185d48-cc67-4859-ae73-f0cdd1773028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:58.338340 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1185d48-cc67-4859-ae73-f0cdd1773028 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:58.339078 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1185d48-cc67-4859-ae73-f0cdd1773028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:58.339386 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1185d48-cc67-4859-ae73-f0cdd1773028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:58.340959 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1185d48-cc67-4859-ae73-f0cdd1773028 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:58.355841 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 291/579] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:58.361622 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb3267-e962-48d5-b9fc-789b8594d1fd admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:58.374307 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb3267-e962-48d5-b9fc-789b8594d1fd admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:58.380735 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004ede7-f58b-4791-85de-06e61666e6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:58.381825 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004ede7-f58b-4791-85de-06e61666e6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:58.382321 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004ede7-f58b-4791-85de-06e61666e6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:58.382787 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004ede7-f58b-4791-85de-06e61666e6a8 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:58.397276 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004ede7-f58b-4791-85de-06e61666e6a8 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:58.399635 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004ede7-f58b-4791-85de-06e61666e6a8 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:58.419643 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-c004ede7-f58b-4791-85de-06e61666e6a8 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:20:58.421148 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 289/580] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Oct 27 01:20:58 2021] GET /identity/v3/users/nova => generated 82 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:58.427407 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1185d48-cc67-4859-ae73-f0cdd1773028 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:58.442451 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1185d48-cc67-4859-ae73-f0cdd1773028 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:58.450902 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0af486-750d-44e4-a19f-07a2be928e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:58.451576 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0af486-750d-44e4-a19f-07a2be928e14 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:58.451862 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0af486-750d-44e4-a19f-07a2be928e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:58.452141 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0af486-750d-44e4-a19f-07a2be928e14 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:58.452988 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0af486-750d-44e4-a19f-07a2be928e14 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:58.453298 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0af486-750d-44e4-a19f-07a2be928e14 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:58.455143 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0af486-750d-44e4-a19f-07a2be928e14 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:58.474125 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 292/581] 10.222.0.25 () {56 vars in 1154 bytes} [Wed Oct 27 01:20:58 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:58.480383 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004ede7-f58b-4791-85de-06e61666e6a8 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:58.490333 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004ede7-f58b-4791-85de-06e61666e6a8 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:58.497440 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572fc97-2923-4863-bc53-f741fbb28b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:58.498317 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572fc97-2923-4863-bc53-f741fbb28b0f admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:58.498815 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572fc97-2923-4863-bc53-f741fbb28b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:58.499282 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572fc97-2923-4863-bc53-f741fbb28b0f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:58.513716 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572fc97-2923-4863-bc53-f741fbb28b0f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:58.516301 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572fc97-2923-4863-bc53-f741fbb28b0f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:58.526843 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 290/582] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:20:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:58.532766 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0af486-750d-44e4-a19f-07a2be928e14 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:58.543627 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0af486-750d-44e4-a19f-07a2be928e14 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:58.550008 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e090c-76b0-4f1d-b0a6-628d87ee6fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:58.551040 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e090c-76b0-4f1d-b0a6-628d87ee6fdc admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:58.551531 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e090c-76b0-4f1d-b0a6-628d87ee6fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:58.551995 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e090c-76b0-4f1d-b0a6-628d87ee6fdc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:58.569101 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e090c-76b0-4f1d-b0a6-628d87ee6fdc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:58.571411 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e090c-76b0-4f1d-b0a6-628d87ee6fdc admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:58.594629 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-036e090c-76b0-4f1d-b0a6-628d87ee6fdc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:20:58.596113 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 293/583] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:20:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:58.602777 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572fc97-2923-4863-bc53-f741fbb28b0f admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:58.611886 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572fc97-2923-4863-bc53-f741fbb28b0f admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:58.622147 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7fdca-9d62-47b2-b8ba-3361528c6ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:58.622801 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7fdca-9d62-47b2-b8ba-3361528c6ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:58.623083 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7fdca-9d62-47b2-b8ba-3361528c6ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:58.623357 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7fdca-9d62-47b2-b8ba-3361528c6ee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:58.624089 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be7fdca-9d62-47b2-b8ba-3361528c6ee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:58.624397 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be7fdca-9d62-47b2-b8ba-3361528c6ee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:58.625979 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be7fdca-9d62-47b2-b8ba-3361528c6ee4 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:58.651367 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 291/584] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:20:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:58.657390 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e090c-76b0-4f1d-b0a6-628d87ee6fdc admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:58.670485 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e090c-76b0-4f1d-b0a6-628d87ee6fdc admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:58.681576 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135b5a6-5697-49c7-a773-73439f6bee8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:58.682661 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135b5a6-5697-49c7-a773-73439f6bee8f admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:58.683401 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135b5a6-5697-49c7-a773-73439f6bee8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:58.683877 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135b5a6-5697-49c7-a773-73439f6bee8f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:58.696455 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135b5a6-5697-49c7-a773-73439f6bee8f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:58.698678 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135b5a6-5697-49c7-a773-73439f6bee8f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:58.715169 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-9135b5a6-5697-49c7-a773-73439f6bee8f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:20:58.716937 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 294/585] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:58.722896 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7fdca-9d62-47b2-b8ba-3361528c6ee4 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:58.738470 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7fdca-9d62-47b2-b8ba-3361528c6ee4 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:58.742849 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea154d-d803-45a0-96b8-63839db8e759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:58.743508 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea154d-d803-45a0-96b8-63839db8e759 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:58.743792 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea154d-d803-45a0-96b8-63839db8e759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:58.744070 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea154d-d803-45a0-96b8-63839db8e759 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:58.744869 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea154d-d803-45a0-96b8-63839db8e759 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:58.745178 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea154d-d803-45a0-96b8-63839db8e759 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:58.747050 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea154d-d803-45a0-96b8-63839db8e759 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:58.765602 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 292/586] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:20:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:58.771716 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135b5a6-5697-49c7-a773-73439f6bee8f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:58.786423 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135b5a6-5697-49c7-a773-73439f6bee8f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:58.794071 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e965528-7230-4aa8-8901-ed58adaf19fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:58.794953 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e965528-7230-4aa8-8901-ed58adaf19fc admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:58.795458 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e965528-7230-4aa8-8901-ed58adaf19fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:58.795929 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e965528-7230-4aa8-8901-ed58adaf19fc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:58.796946 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e965528-7230-4aa8-8901-ed58adaf19fc admin admin] RBAC: Adding query filter params (role.id=df3a437e6ea14518a9c1b9a348e18c99, scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6, user.id=b2f8304b85b64dc4ac58523897306660) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:58.797456 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e965528-7230-4aa8-8901-ed58adaf19fc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:58.799474 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e965528-7230-4aa8-8901-ed58adaf19fc admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:58.809711 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 295/587] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:20:58 2021] GET /identity/v3/role_assignments?user.id=b2f8304b85b64dc4ac58523897306660&scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6&role.id=df3a437e6ea14518a9c1b9a348e18c99 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:59.221608 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901d758-8c19-4273-bd66-633de7d5f4e6 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:59.221943 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901d758-8c19-4273-bd66-633de7d5f4e6 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:59.222170 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901d758-8c19-4273-bd66-633de7d5f4e6 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:59.224211 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 293/588] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:59.243553 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b64ff7-77a6-4b03-85b5-29dd94b53502 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:59.244131 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b64ff7-77a6-4b03-85b5-29dd94b53502 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:59.244605 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b64ff7-77a6-4b03-85b5-29dd94b53502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:59.266521 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-d6b64ff7-77a6-4b03-85b5-29dd94b53502 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:59.267708 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-d6b64ff7-77a6-4b03-85b5-29dd94b53502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:59.275730 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 296/589] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:59.322933 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901d758-8c19-4273-bd66-633de7d5f4e6 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:59.339215 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901d758-8c19-4273-bd66-633de7d5f4e6 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:59.343539 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c701f-cdd1-4dca-8c59-98adcfd5eea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:59.344347 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c701f-cdd1-4dca-8c59-98adcfd5eea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:59.344631 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c701f-cdd1-4dca-8c59-98adcfd5eea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:59.344909 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c701f-cdd1-4dca-8c59-98adcfd5eea4 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:59.345610 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c701f-cdd1-4dca-8c59-98adcfd5eea4 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:59.346609 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING py.warnings [None req-bd3c701f-cdd1-4dca-8c59-98adcfd5eea4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:59.346609 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: warnings.warn(msg) Oct 27 01:20:59.346609 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: Oct 27 01:20:59.347491 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c701f-cdd1-4dca-8c59-98adcfd5eea4 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:59.365097 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-bd3c701f-cdd1-4dca-8c59-98adcfd5eea4 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 01:20:59.366676 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 294/590] 10.222.0.25 () {56 vars in 1150 bytes} [Wed Oct 27 01:20:59 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:20:59.373632 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b64ff7-77a6-4b03-85b5-29dd94b53502 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:59.390580 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b64ff7-77a6-4b03-85b5-29dd94b53502 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:59.401680 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08fec80-10d0-4319-80f1-5fc266c4f895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:59.402353 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fec80-10d0-4319-80f1-5fc266c4f895 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:59.402637 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fec80-10d0-4319-80f1-5fc266c4f895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:59.402914 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fec80-10d0-4319-80f1-5fc266c4f895 admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:59.403638 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08fec80-10d0-4319-80f1-5fc266c4f895 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:59.404135 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08fec80-10d0-4319-80f1-5fc266c4f895 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:59.404946 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING py.warnings [None req-f08fec80-10d0-4319-80f1-5fc266c4f895 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:59.404946 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: warnings.warn(msg) Oct 27 01:20:59.404946 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: Oct 27 01:20:59.417870 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08fec80-10d0-4319-80f1-5fc266c4f895 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:59.417870 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 297/591] 10.222.0.25 () {56 vars in 1145 bytes} [Wed Oct 27 01:20:59 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:59.418319 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c701f-cdd1-4dca-8c59-98adcfd5eea4 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:59.441771 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c701f-cdd1-4dca-8c59-98adcfd5eea4 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:59.446796 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16175f09-4511-4c55-a984-53454aeaf0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:59.453980 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16175f09-4511-4c55-a984-53454aeaf0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:59.454260 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16175f09-4511-4c55-a984-53454aeaf0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:59.454548 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16175f09-4511-4c55-a984-53454aeaf0d0 admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:59.455297 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16175f09-4511-4c55-a984-53454aeaf0d0 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:59.455607 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16175f09-4511-4c55-a984-53454aeaf0d0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:59.456606 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING py.warnings [None req-16175f09-4511-4c55-a984-53454aeaf0d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:20:59.456606 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: warnings.warn(msg) Oct 27 01:20:59.456606 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: Oct 27 01:20:59.457500 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16175f09-4511-4c55-a984-53454aeaf0d0 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:59.468615 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 295/592] 10.222.0.25 () {56 vars in 1145 bytes} [Wed Oct 27 01:20:59 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:59.917606 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218386b-9cb8-46c1-9193-ab7a829125eb None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:59.918298 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218386b-9cb8-46c1-9193-ab7a829125eb None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:59.918298 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218386b-9cb8-46c1-9193-ab7a829125eb None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:59.921147 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 298/593] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:20:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:20:59.926437 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c812d-a010-4b90-98a5-0e30fce3fb54 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:59.926946 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c812d-a010-4b90-98a5-0e30fce3fb54 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:59.927105 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c812d-a010-4b90-98a5-0e30fce3fb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:59.946368 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-f82c812d-a010-4b90-98a5-0e30fce3fb54 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:59.947565 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-f82c812d-a010-4b90-98a5-0e30fce3fb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:59.960170 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 296/594] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:20:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:59.989592 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218386b-9cb8-46c1-9193-ab7a829125eb None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:00.002727 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218386b-9cb8-46c1-9193-ab7a829125eb None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:00.011149 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b47643-71c0-4a4f-b76d-55ebd1a0f9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:00.011943 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b47643-71c0-4a4f-b76d-55ebd1a0f9ce admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:00.012228 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b47643-71c0-4a4f-b76d-55ebd1a0f9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:00.012505 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b47643-71c0-4a4f-b76d-55ebd1a0f9ce admin admin] PATH_INFO: `/v3/services/network` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:00.013164 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b47643-71c0-4a4f-b76d-55ebd1a0f9ce admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:00.014196 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING py.warnings [None req-b7b47643-71c0-4a4f-b76d-55ebd1a0f9ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:21:00.014196 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: warnings.warn(msg) Oct 27 01:21:00.014196 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: Oct 27 01:21:00.015071 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b47643-71c0-4a4f-b76d-55ebd1a0f9ce admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:00.029884 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-b7b47643-71c0-4a4f-b76d-55ebd1a0f9ce admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 01:21:00.031401 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 299/595] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:20:59 2021] GET /identity/v3/services/network => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:00.037750 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c812d-a010-4b90-98a5-0e30fce3fb54 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:00.047077 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c812d-a010-4b90-98a5-0e30fce3fb54 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:00.047485 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456e381-a4ac-4e26-98c3-a2467836e50b None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:00.048060 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456e381-a4ac-4e26-98c3-a2467836e50b None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:00.048706 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456e381-a4ac-4e26-98c3-a2467836e50b None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:00.051374 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 300/596] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:00 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:21:00.053823 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf1ae2-f385-492b-a2ea-72e4361045da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:00.054592 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf1ae2-f385-492b-a2ea-72e4361045da admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:00.054960 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf1ae2-f385-492b-a2ea-72e4361045da admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:00.055381 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf1ae2-f385-492b-a2ea-72e4361045da admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:00.056175 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf1ae2-f385-492b-a2ea-72e4361045da admin admin] RBAC: Adding query filter params (name=network) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:00.056552 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf1ae2-f385-492b-a2ea-72e4361045da admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:00.059150 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558e6db-2301-41d2-9ff4-3b27fe25c8cc None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:00.059391 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf1ae2-f385-492b-a2ea-72e4361045da admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:00.059835 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558e6db-2301-41d2-9ff4-3b27fe25c8cc None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:00.060290 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558e6db-2301-41d2-9ff4-3b27fe25c8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:00.064627 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 297/597] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Oct 27 01:21:00 2021] GET /identity/v3/services?name=network => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:00.078545 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf1ae2-f385-492b-a2ea-72e4361045da admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:00.087147 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-3558e6db-2301-41d2-9ff4-3b27fe25c8cc None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:00.088548 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3558e6db-2301-41d2-9ff4-3b27fe25c8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:00.098799 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf1ae2-f385-492b-a2ea-72e4361045da admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:00.104089 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 301/598] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:21:00.111031 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236471dd-5841-4ff7-9826-2dc32c5a05f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:00.111710 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236471dd-5841-4ff7-9826-2dc32c5a05f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:00.111998 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236471dd-5841-4ff7-9826-2dc32c5a05f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:00.112281 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236471dd-5841-4ff7-9826-2dc32c5a05f5 admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:00.113007 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236471dd-5841-4ff7-9826-2dc32c5a05f5 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:00.113318 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236471dd-5841-4ff7-9826-2dc32c5a05f5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:00.115035 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236471dd-5841-4ff7-9826-2dc32c5a05f5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:00.125934 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 298/599] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Oct 27 01:21:00 2021] GET /identity/v3/services?type=network => generated 124 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:00.128525 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558e6db-2301-41d2-9ff4-3b27fe25c8cc None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:00.139202 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558e6db-2301-41d2-9ff4-3b27fe25c8cc None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:00.144076 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ba777-d01e-4ebd-aa02-fefad7682dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:00.145004 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ba777-d01e-4ebd-aa02-fefad7682dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:00.145376 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ba777-d01e-4ebd-aa02-fefad7682dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:00.145826 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ba777-d01e-4ebd-aa02-fefad7682dd7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:00.166453 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ba777-d01e-4ebd-aa02-fefad7682dd7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:00.168681 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ba777-d01e-4ebd-aa02-fefad7682dd7 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:00.201260 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-b44ba777-d01e-4ebd-aa02-fefad7682dd7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:00.202831 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 302/600] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:00.209718 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236471dd-5841-4ff7-9826-2dc32c5a05f5 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:00.226942 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236471dd-5841-4ff7-9826-2dc32c5a05f5 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:00.243892 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f52d2-f3dd-449d-812f-0b348555c753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:00.244579 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f52d2-f3dd-449d-812f-0b348555c753 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:00.244864 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f52d2-f3dd-449d-812f-0b348555c753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:00.245146 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f52d2-f3dd-449d-812f-0b348555c753 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:00.245924 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f52d2-f3dd-449d-812f-0b348555c753 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:00.246233 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f52d2-f3dd-449d-812f-0b348555c753 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:00.247840 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f52d2-f3dd-449d-812f-0b348555c753 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:00.271251 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 299/601] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:00.277881 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ba777-d01e-4ebd-aa02-fefad7682dd7 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:00.292645 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ba777-d01e-4ebd-aa02-fefad7682dd7 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:00.301495 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5755ac7-96a9-4d5d-b46a-b5329d2067ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:00.302578 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5755ac7-96a9-4d5d-b46a-b5329d2067ac admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:00.303079 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5755ac7-96a9-4d5d-b46a-b5329d2067ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:00.303556 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5755ac7-96a9-4d5d-b46a-b5329d2067ac admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:00.304488 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5755ac7-96a9-4d5d-b46a-b5329d2067ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:00.307180 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5755ac7-96a9-4d5d-b46a-b5329d2067ac admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:00.335942 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 303/602] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Oct 27 01:21:00 2021] POST /identity/v3/users => generated 254 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:21:00.838248 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b20c3d-46ce-4b20-b7d3-a6941d024ad3 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:00.838904 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b20c3d-46ce-4b20-b7d3-a6941d024ad3 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:00.839405 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b20c3d-46ce-4b20-b7d3-a6941d024ad3 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:00.841660 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 300/603] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:00.847677 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910a2ad-68a9-4124-883e-3317637f4b1e None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:00.848188 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910a2ad-68a9-4124-883e-3317637f4b1e None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:00.848691 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910a2ad-68a9-4124-883e-3317637f4b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:00.871071 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-d910a2ad-68a9-4124-883e-3317637f4b1e None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:00.872562 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-d910a2ad-68a9-4124-883e-3317637f4b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:00.883708 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 304/604] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:00.909887 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b20c3d-46ce-4b20-b7d3-a6941d024ad3 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:00.923064 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b20c3d-46ce-4b20-b7d3-a6941d024ad3 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:00.929809 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f52dc-3079-4e14-b2a9-719b72112953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:00.931293 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f52dc-3079-4e14-b2a9-719b72112953 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:00.931781 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f52dc-3079-4e14-b2a9-719b72112953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:00.932276 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f52dc-3079-4e14-b2a9-719b72112953 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:00.945978 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f52dc-3079-4e14-b2a9-719b72112953 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:21:00.958433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-dd4f52dc-3079-4e14-b2a9-719b72112953 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:21:00.960455 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 301/605] 10.222.0.25 () {56 vars in 1123 bytes} [Wed Oct 27 01:21:00 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:00.969231 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910a2ad-68a9-4124-883e-3317637f4b1e None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:00.977677 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910a2ad-68a9-4124-883e-3317637f4b1e None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:00.983076 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0478d-b024-4c10-b04d-1238adcea780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:00.983762 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0478d-b024-4c10-b04d-1238adcea780 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:00.984052 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0478d-b024-4c10-b04d-1238adcea780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:00.984349 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0478d-b024-4c10-b04d-1238adcea780 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:00.985119 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0478d-b024-4c10-b04d-1238adcea780 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:00.985429 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0478d-b024-4c10-b04d-1238adcea780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:00.987053 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0478d-b024-4c10-b04d-1238adcea780 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:00.996744 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 305/606] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Oct 27 01:21:00 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:01.003132 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f52dc-3079-4e14-b2a9-719b72112953 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:01.013601 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f52dc-3079-4e14-b2a9-719b72112953 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:01.021310 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d2af1-ac67-4d48-8224-858e142398bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:01.022175 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d2af1-ac67-4d48-8224-858e142398bc admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:01.022480 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d2af1-ac67-4d48-8224-858e142398bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:01.022815 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d2af1-ac67-4d48-8224-858e142398bc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:01.034241 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d2af1-ac67-4d48-8224-858e142398bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:01.036117 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d2af1-ac67-4d48-8224-858e142398bc admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:01.061323 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-969d2af1-ac67-4d48-8224-858e142398bc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:01.062952 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 302/607] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:01.069333 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0478d-b024-4c10-b04d-1238adcea780 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:01.083787 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0478d-b024-4c10-b04d-1238adcea780 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:01.099216 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35ed00-aa83-4885-9501-880eb7eacae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:01.099890 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35ed00-aa83-4885-9501-880eb7eacae1 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:01.100197 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35ed00-aa83-4885-9501-880eb7eacae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:01.100505 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35ed00-aa83-4885-9501-880eb7eacae1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:01.101289 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35ed00-aa83-4885-9501-880eb7eacae1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:01.101661 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35ed00-aa83-4885-9501-880eb7eacae1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:01.103442 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35ed00-aa83-4885-9501-880eb7eacae1 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:01.124299 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 306/608] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:01.130645 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d2af1-ac67-4d48-8224-858e142398bc admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:01.143706 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d2af1-ac67-4d48-8224-858e142398bc admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:01.154287 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd9b83-a958-40f0-8eec-ac0eeae30625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:01.155180 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd9b83-a958-40f0-8eec-ac0eeae30625 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:01.155465 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd9b83-a958-40f0-8eec-ac0eeae30625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:01.155746 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd9b83-a958-40f0-8eec-ac0eeae30625 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:01.169142 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd9b83-a958-40f0-8eec-ac0eeae30625 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:01.171236 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd9b83-a958-40f0-8eec-ac0eeae30625 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:01.188563 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-1dfd9b83-a958-40f0-8eec-ac0eeae30625 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 01:21:01.190108 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 303/609] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:21:01 2021] GET /identity/v3/users/swift => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:01.196948 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35ed00-aa83-4885-9501-880eb7eacae1 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:01.211499 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35ed00-aa83-4885-9501-880eb7eacae1 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:01.221808 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21e5e2-1d4d-466c-b559-c188ea557419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:01.222550 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21e5e2-1d4d-466c-b559-c188ea557419 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:01.222857 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21e5e2-1d4d-466c-b559-c188ea557419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:01.223167 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21e5e2-1d4d-466c-b559-c188ea557419 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:01.224053 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21e5e2-1d4d-466c-b559-c188ea557419 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:01.224421 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21e5e2-1d4d-466c-b559-c188ea557419 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:01.226413 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21e5e2-1d4d-466c-b559-c188ea557419 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:01.260216 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 307/610] 10.222.0.25 () {56 vars in 1156 bytes} [Wed Oct 27 01:21:01 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:01.266706 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd9b83-a958-40f0-8eec-ac0eeae30625 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:01.280410 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd9b83-a958-40f0-8eec-ac0eeae30625 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:01.290297 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cf434-7fb3-49e3-8ae6-2bc2c6f4136c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:01.290950 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cf434-7fb3-49e3-8ae6-2bc2c6f4136c admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:01.291243 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cf434-7fb3-49e3-8ae6-2bc2c6f4136c admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:01.291564 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cf434-7fb3-49e3-8ae6-2bc2c6f4136c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:01.305301 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3cf434-7fb3-49e3-8ae6-2bc2c6f4136c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:01.307164 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3cf434-7fb3-49e3-8ae6-2bc2c6f4136c admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:01.318927 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 304/611] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:21:01 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:21:01.326290 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21e5e2-1d4d-466c-b559-c188ea557419 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:01.336526 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21e5e2-1d4d-466c-b559-c188ea557419 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:01.349848 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84005d6c-1248-45b4-a004-3f98533a41f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:01.350590 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84005d6c-1248-45b4-a004-3f98533a41f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:01.350878 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84005d6c-1248-45b4-a004-3f98533a41f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:01.351159 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84005d6c-1248-45b4-a004-3f98533a41f4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:01.368471 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84005d6c-1248-45b4-a004-3f98533a41f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:01.370750 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84005d6c-1248-45b4-a004-3f98533a41f4 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:01.393770 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-84005d6c-1248-45b4-a004-3f98533a41f4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:01.395407 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 308/612] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:01.402096 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cf434-7fb3-49e3-8ae6-2bc2c6f4136c admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:01.415869 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cf434-7fb3-49e3-8ae6-2bc2c6f4136c admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:01.431654 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c36546-48d9-4d41-85eb-af8dfed34566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:01.432608 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c36546-48d9-4d41-85eb-af8dfed34566 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:01.433351 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c36546-48d9-4d41-85eb-af8dfed34566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:01.433856 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c36546-48d9-4d41-85eb-af8dfed34566 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:01.434912 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c36546-48d9-4d41-85eb-af8dfed34566 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:01.435413 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c36546-48d9-4d41-85eb-af8dfed34566 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:01.437172 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c36546-48d9-4d41-85eb-af8dfed34566 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:01.454812 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 305/613] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:01.461608 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84005d6c-1248-45b4-a004-3f98533a41f4 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:01.472081 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84005d6c-1248-45b4-a004-3f98533a41f4 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:01.485882 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ed2b5-384e-4508-bbd3-ad44eec8f9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:01.486713 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ed2b5-384e-4508-bbd3-ad44eec8f9bb admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:01.487019 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ed2b5-384e-4508-bbd3-ad44eec8f9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:01.487325 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ed2b5-384e-4508-bbd3-ad44eec8f9bb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:01.499528 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ed2b5-384e-4508-bbd3-ad44eec8f9bb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:01.501523 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ed2b5-384e-4508-bbd3-ad44eec8f9bb admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:01.524739 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-3b6ed2b5-384e-4508-bbd3-ad44eec8f9bb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:21:01.526465 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 309/614] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:21:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:01.534079 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c36546-48d9-4d41-85eb-af8dfed34566 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:01.548763 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c36546-48d9-4d41-85eb-af8dfed34566 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:01.558815 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf7be6-c02d-42ed-acfc-4682c3fa1806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:01.559697 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf7be6-c02d-42ed-acfc-4682c3fa1806 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:01.560194 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf7be6-c02d-42ed-acfc-4682c3fa1806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:01.560684 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf7be6-c02d-42ed-acfc-4682c3fa1806 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:01.561716 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf7be6-c02d-42ed-acfc-4682c3fa1806 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:01.562225 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf7be6-c02d-42ed-acfc-4682c3fa1806 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:01.564234 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf7be6-c02d-42ed-acfc-4682c3fa1806 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:01.582968 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 306/615] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:21:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:01.589742 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ed2b5-384e-4508-bbd3-ad44eec8f9bb admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:01.605808 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ed2b5-384e-4508-bbd3-ad44eec8f9bb admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:01.613912 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1f891-9a14-4380-8f23-042a5b9efb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:01.614632 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1f891-9a14-4380-8f23-042a5b9efb5c admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:01.614950 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1f891-9a14-4380-8f23-042a5b9efb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:01.615260 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1f891-9a14-4380-8f23-042a5b9efb5c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:01.616167 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1f891-9a14-4380-8f23-042a5b9efb5c admin admin] RBAC: Adding query filter params (role.id=983c0291e0fa484ea053a791ead0e9c5, scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6, user.id=f386f358fdb241f5a529a2cf3d839201) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:01.616515 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1f891-9a14-4380-8f23-042a5b9efb5c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:01.619035 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1f891-9a14-4380-8f23-042a5b9efb5c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:01.634415 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 310/616] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:21:01 2021] GET /identity/v3/role_assignments?user.id=f386f358fdb241f5a529a2cf3d839201&scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6&role.id=983c0291e0fa484ea053a791ead0e9c5 => generated 608 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:01.784082 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7f96f-a633-4808-8879-fdf636394b33 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:01.784470 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7f96f-a633-4808-8879-fdf636394b33 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:01.784668 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7f96f-a633-4808-8879-fdf636394b33 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:01.787000 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 307/617] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:01.794330 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07b3ec-e9f5-427b-bd55-a5b41c464b7c None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:01.794647 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07b3ec-e9f5-427b-bd55-a5b41c464b7c None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:01.794895 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07b3ec-e9f5-427b-bd55-a5b41c464b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:01.818271 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-4d07b3ec-e9f5-427b-bd55-a5b41c464b7c None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:01.819573 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4d07b3ec-e9f5-427b-bd55-a5b41c464b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:01.832230 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 311/618] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:01.857635 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7f96f-a633-4808-8879-fdf636394b33 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:01.875720 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7f96f-a633-4808-8879-fdf636394b33 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:01.887819 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7bdef-7f99-46cd-a84c-902e0d03b425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:01.888981 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7bdef-7f99-46cd-a84c-902e0d03b425 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:01.889465 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7bdef-7f99-46cd-a84c-902e0d03b425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:01.889986 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7bdef-7f99-46cd-a84c-902e0d03b425 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:01.904412 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7bdef-7f99-46cd-a84c-902e0d03b425 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:21:01.912029 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-9ff7bdef-7f99-46cd-a84c-902e0d03b425 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:21:01.913364 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 308/619] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:21:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:01.920646 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07b3ec-e9f5-427b-bd55-a5b41c464b7c None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:01.931432 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07b3ec-e9f5-427b-bd55-a5b41c464b7c None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:01.936529 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8e6ca-cb46-4a4c-9648-37acd836886d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:01.937411 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8e6ca-cb46-4a4c-9648-37acd836886d admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:01.937934 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8e6ca-cb46-4a4c-9648-37acd836886d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:01.938407 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8e6ca-cb46-4a4c-9648-37acd836886d admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:01.939396 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8e6ca-cb46-4a4c-9648-37acd836886d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:01.939960 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8e6ca-cb46-4a4c-9648-37acd836886d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:01.941755 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8e6ca-cb46-4a4c-9648-37acd836886d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:01.956716 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 312/620] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:21:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:01.968775 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7bdef-7f99-46cd-a84c-902e0d03b425 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:01.980327 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7bdef-7f99-46cd-a84c-902e0d03b425 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:01.985274 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f143d3-e88d-42c0-a911-5480882292a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:01.986321 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f143d3-e88d-42c0-a911-5480882292a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:01.986873 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f143d3-e88d-42c0-a911-5480882292a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:01.987348 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f143d3-e88d-42c0-a911-5480882292a7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:02.008030 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f143d3-e88d-42c0-a911-5480882292a7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:02.010912 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f143d3-e88d-42c0-a911-5480882292a7 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:02.028551 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-a5f143d3-e88d-42c0-a911-5480882292a7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:02.030055 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 309/621] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:02.036391 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8e6ca-cb46-4a4c-9648-37acd836886d admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:02.047385 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8e6ca-cb46-4a4c-9648-37acd836886d admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:02.052299 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa442e0-eb4d-43ca-b7a3-1161d1a7bbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:02.053244 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa442e0-eb4d-43ca-b7a3-1161d1a7bbd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:02.053825 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa442e0-eb4d-43ca-b7a3-1161d1a7bbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:02.054415 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa442e0-eb4d-43ca-b7a3-1161d1a7bbd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:02.055988 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa442e0-eb4d-43ca-b7a3-1161d1a7bbd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:02.056547 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa442e0-eb4d-43ca-b7a3-1161d1a7bbd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:02.058693 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa442e0-eb4d-43ca-b7a3-1161d1a7bbd6 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:02.072790 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 313/622] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:02.079141 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f143d3-e88d-42c0-a911-5480882292a7 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:02.090207 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f143d3-e88d-42c0-a911-5480882292a7 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:02.114604 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7018e-c7c4-4c8a-9d35-b27928fa1141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:02.115728 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7018e-c7c4-4c8a-9d35-b27928fa1141 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:02.116221 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7018e-c7c4-4c8a-9d35-b27928fa1141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:02.116713 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7018e-c7c4-4c8a-9d35-b27928fa1141 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:02.126750 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7018e-c7c4-4c8a-9d35-b27928fa1141 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:02.129162 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7018e-c7c4-4c8a-9d35-b27928fa1141 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:02.143705 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-7ce7018e-c7c4-4c8a-9d35-b27928fa1141 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:21:02.145535 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 310/623] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Oct 27 01:21:02 2021] GET /identity/v3/users/nova => generated 82 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:02.151984 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa442e0-eb4d-43ca-b7a3-1161d1a7bbd6 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:02.162516 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa442e0-eb4d-43ca-b7a3-1161d1a7bbd6 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:02.168259 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3f844-2f13-4574-abf9-3bece617ccfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:02.169436 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3f844-2f13-4574-abf9-3bece617ccfd admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:02.170018 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3f844-2f13-4574-abf9-3bece617ccfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:02.170506 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3f844-2f13-4574-abf9-3bece617ccfd admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:02.171644 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3f844-2f13-4574-abf9-3bece617ccfd admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:02.172223 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3f844-2f13-4574-abf9-3bece617ccfd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:02.174409 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3f844-2f13-4574-abf9-3bece617ccfd admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:02.194713 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 314/624] 10.222.0.25 () {56 vars in 1154 bytes} [Wed Oct 27 01:21:02 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:02.201229 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7018e-c7c4-4c8a-9d35-b27928fa1141 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:02.212543 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7018e-c7c4-4c8a-9d35-b27928fa1141 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:02.217429 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240d589-959c-4dc5-84b2-4dc43a427401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:02.218413 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240d589-959c-4dc5-84b2-4dc43a427401 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:02.218888 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240d589-959c-4dc5-84b2-4dc43a427401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:02.219304 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240d589-959c-4dc5-84b2-4dc43a427401 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:02.231088 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240d589-959c-4dc5-84b2-4dc43a427401 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:02.233084 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240d589-959c-4dc5-84b2-4dc43a427401 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:02.250449 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-c240d589-959c-4dc5-84b2-4dc43a427401 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:02.252101 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 311/625] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:02.258363 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3f844-2f13-4574-abf9-3bece617ccfd admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:02.268444 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3f844-2f13-4574-abf9-3bece617ccfd admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:02.273355 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b7d5a-8665-4080-a2d1-a25815846ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:02.274250 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b7d5a-8665-4080-a2d1-a25815846ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:02.274710 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b7d5a-8665-4080-a2d1-a25815846ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:02.275151 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b7d5a-8665-4080-a2d1-a25815846ee0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:02.276076 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b7d5a-8665-4080-a2d1-a25815846ee0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:02.276535 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b7d5a-8665-4080-a2d1-a25815846ee0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:02.278371 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b7d5a-8665-4080-a2d1-a25815846ee0 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:02.291561 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 315/626] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:02.297802 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240d589-959c-4dc5-84b2-4dc43a427401 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:02.308915 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240d589-959c-4dc5-84b2-4dc43a427401 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:02.313754 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74b541-3bfb-40a9-9a4e-100f21bc3123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:02.314752 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74b541-3bfb-40a9-9a4e-100f21bc3123 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:02.315181 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74b541-3bfb-40a9-9a4e-100f21bc3123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:02.315599 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74b541-3bfb-40a9-9a4e-100f21bc3123 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:02.324099 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74b541-3bfb-40a9-9a4e-100f21bc3123 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:02.326313 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74b541-3bfb-40a9-9a4e-100f21bc3123 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:02.342277 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-0f74b541-3bfb-40a9-9a4e-100f21bc3123 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:21:02.344259 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 312/627] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:21:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:02.351066 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b7d5a-8665-4080-a2d1-a25815846ee0 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:02.363076 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b7d5a-8665-4080-a2d1-a25815846ee0 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:02.368825 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d39494-4d6e-471e-8a50-527818588192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:02.369817 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d39494-4d6e-471e-8a50-527818588192 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:02.370329 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d39494-4d6e-471e-8a50-527818588192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:02.370790 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d39494-4d6e-471e-8a50-527818588192 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:02.371757 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d39494-4d6e-471e-8a50-527818588192 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:02.372275 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d39494-4d6e-471e-8a50-527818588192 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:02.374456 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d39494-4d6e-471e-8a50-527818588192 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:02.389115 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 316/628] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:21:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:02.395774 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74b541-3bfb-40a9-9a4e-100f21bc3123 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:02.406627 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74b541-3bfb-40a9-9a4e-100f21bc3123 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:02.411401 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8e6dc-801c-4ba2-b1d0-77615e15335f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:02.412565 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8e6dc-801c-4ba2-b1d0-77615e15335f admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:02.413046 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8e6dc-801c-4ba2-b1d0-77615e15335f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:02.413505 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8e6dc-801c-4ba2-b1d0-77615e15335f admin admin] PATH_INFO: `/v3/projects/2b95c6a455e74d9487ae73f44a9ba0e6/users/b2f8304b85b64dc4ac58523897306660/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:02.416358 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8e6dc-801c-4ba2-b1d0-77615e15335f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b95c6a455e74d9487ae73f44a9ba0e6, user_id=b2f8304b85b64dc4ac58523897306660, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:02.419274 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8e6dc-801c-4ba2-b1d0-77615e15335f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:02.434443 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 313/629] 10.222.0.25 () {58 vars in 1460 bytes} [Wed Oct 27 01:21:02 2021] PUT /identity/v3/projects/2b95c6a455e74d9487ae73f44a9ba0e6/users/b2f8304b85b64dc4ac58523897306660/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:02.548200 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e92ee-be7a-43ee-a2a5-474935fcd3ca None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:02.548722 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e92ee-be7a-43ee-a2a5-474935fcd3ca None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:02.549147 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e92ee-be7a-43ee-a2a5-474935fcd3ca None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:02.551166 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 317/630] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:02.557564 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bdeaa-bf55-474b-8288-b42e105b36cf None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:02.558118 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bdeaa-bf55-474b-8288-b42e105b36cf None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:02.558401 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bdeaa-bf55-474b-8288-b42e105b36cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:02.587775 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-7d7bdeaa-bf55-474b-8288-b42e105b36cf None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:02.589008 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-7d7bdeaa-bf55-474b-8288-b42e105b36cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:02.676640 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 314/631] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:21:02.700287 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e92ee-be7a-43ee-a2a5-474935fcd3ca None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:02.719336 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e92ee-be7a-43ee-a2a5-474935fcd3ca None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:02.723886 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c69f47-ca5c-48f9-a184-8646b9fca63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:02.724556 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c69f47-ca5c-48f9-a184-8646b9fca63f admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:02.724842 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c69f47-ca5c-48f9-a184-8646b9fca63f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:02.725124 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c69f47-ca5c-48f9-a184-8646b9fca63f admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:02.725909 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c69f47-ca5c-48f9-a184-8646b9fca63f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:02.727018 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING py.warnings [None req-12c69f47-ca5c-48f9-a184-8646b9fca63f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:21:02.727018 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: warnings.warn(msg) Oct 27 01:21:02.727018 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: Oct 27 01:21:02.728359 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c69f47-ca5c-48f9-a184-8646b9fca63f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:02.747664 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 318/632] 10.222.0.25 () {60 vars in 1162 bytes} [Wed Oct 27 01:21:02 2021] POST /identity/v3/services => generated 251 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:21:02.996884 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc95d3-56e2-4e8d-a94d-c12167c678b4 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:02.997386 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc95d3-56e2-4e8d-a94d-c12167c678b4 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:02.997516 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc95d3-56e2-4e8d-a94d-c12167c678b4 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:02.999376 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 315/633] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:03.005751 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3df2f6-c4f5-47ec-b531-c729051582e2 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:03.006305 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3df2f6-c4f5-47ec-b531-c729051582e2 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:03.006784 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3df2f6-c4f5-47ec-b531-c729051582e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:03.026157 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-5d3df2f6-c4f5-47ec-b531-c729051582e2 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:03.027643 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-5d3df2f6-c4f5-47ec-b531-c729051582e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:03.045041 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 319/634] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:03 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:03.071451 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc95d3-56e2-4e8d-a94d-c12167c678b4 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:03.089640 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc95d3-56e2-4e8d-a94d-c12167c678b4 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:03.097408 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ae18e-5457-4480-a8f8-833cc80176d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:03.098091 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ae18e-5457-4480-a8f8-833cc80176d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:03.098376 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ae18e-5457-4480-a8f8-833cc80176d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:03.098653 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ae18e-5457-4480-a8f8-833cc80176d7 admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:03.099404 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ae18e-5457-4480-a8f8-833cc80176d7 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:03.100402 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING py.warnings [None req-fc9ae18e-5457-4480-a8f8-833cc80176d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:21:03.100402 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: warnings.warn(msg) Oct 27 01:21:03.100402 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: Oct 27 01:21:03.101291 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ae18e-5457-4480-a8f8-833cc80176d7 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:03.116976 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 316/635] 10.222.0.25 () {60 vars in 1162 bytes} [Wed Oct 27 01:21:03 2021] POST /identity/v3/services => generated 240 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:21:03.339411 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922c155-29a1-48cf-9075-d539342cfd53 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:03.339942 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922c155-29a1-48cf-9075-d539342cfd53 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:03.340369 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922c155-29a1-48cf-9075-d539342cfd53 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:03.342365 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 320/636] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:03.348646 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80968216-855a-4478-8eac-e307489d19a2 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:03.348935 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80968216-855a-4478-8eac-e307489d19a2 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:03.349215 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80968216-855a-4478-8eac-e307489d19a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:03.370543 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-80968216-855a-4478-8eac-e307489d19a2 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:03.371739 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-80968216-855a-4478-8eac-e307489d19a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:03.411658 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 317/637] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:03 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:03.454262 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922c155-29a1-48cf-9075-d539342cfd53 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:03.471965 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922c155-29a1-48cf-9075-d539342cfd53 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:03.476589 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2cd18-595d-40eb-9908-b04d10fd8fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:03.477678 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2cd18-595d-40eb-9908-b04d10fd8fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:03.478109 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2cd18-595d-40eb-9908-b04d10fd8fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:03.478531 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2cd18-595d-40eb-9908-b04d10fd8fc1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:03.489239 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2cd18-595d-40eb-9908-b04d10fd8fc1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:21:03.497977 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-eff2cd18-595d-40eb-9908-b04d10fd8fc1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:21:03.499614 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 321/638] 10.222.0.25 () {56 vars in 1123 bytes} [Wed Oct 27 01:21:03 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:03.505653 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80968216-855a-4478-8eac-e307489d19a2 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:03.515680 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80968216-855a-4478-8eac-e307489d19a2 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:03.525803 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287bf65-fa80-4935-b4bd-30e93fa18433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:03.526491 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287bf65-fa80-4935-b4bd-30e93fa18433 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:03.526778 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287bf65-fa80-4935-b4bd-30e93fa18433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:03.527059 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287bf65-fa80-4935-b4bd-30e93fa18433 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:03.527822 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287bf65-fa80-4935-b4bd-30e93fa18433 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:03.528135 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287bf65-fa80-4935-b4bd-30e93fa18433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:03.529745 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287bf65-fa80-4935-b4bd-30e93fa18433 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:03.544270 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 318/639] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Oct 27 01:21:03 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:03.545439 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2cd18-595d-40eb-9908-b04d10fd8fc1 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:03.556142 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2cd18-595d-40eb-9908-b04d10fd8fc1 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:03.561921 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d7c46-df7e-4c67-9314-dde65d449471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:03.562888 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d7c46-df7e-4c67-9314-dde65d449471 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:03.563318 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d7c46-df7e-4c67-9314-dde65d449471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:03.563736 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d7c46-df7e-4c67-9314-dde65d449471 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:03.575204 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d7c46-df7e-4c67-9314-dde65d449471 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:03.577251 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d7c46-df7e-4c67-9314-dde65d449471 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:03.601611 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-4d3d7c46-df7e-4c67-9314-dde65d449471 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:03.603896 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 322/640] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:03.609875 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287bf65-fa80-4935-b4bd-30e93fa18433 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:03.632071 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287bf65-fa80-4935-b4bd-30e93fa18433 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:03.646149 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55be86b-5f22-4562-b83e-848fc5725728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:03.646831 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55be86b-5f22-4562-b83e-848fc5725728 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:03.647121 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55be86b-5f22-4562-b83e-848fc5725728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:03.647400 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55be86b-5f22-4562-b83e-848fc5725728 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:03.648313 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55be86b-5f22-4562-b83e-848fc5725728 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:03.648631 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55be86b-5f22-4562-b83e-848fc5725728 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:03.650289 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55be86b-5f22-4562-b83e-848fc5725728 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:03.667460 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 319/641] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:03.673637 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d7c46-df7e-4c67-9314-dde65d449471 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:03.684857 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d7c46-df7e-4c67-9314-dde65d449471 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:03.693163 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac82b9-84e3-446d-913a-9d4b6e6d7c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:03.694247 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac82b9-84e3-446d-913a-9d4b6e6d7c5a admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:03.694713 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac82b9-84e3-446d-913a-9d4b6e6d7c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:03.695167 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac82b9-84e3-446d-913a-9d4b6e6d7c5a admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:03.713152 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac82b9-84e3-446d-913a-9d4b6e6d7c5a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:03.715504 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac82b9-84e3-446d-913a-9d4b6e6d7c5a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:03.734773 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-69ac82b9-84e3-446d-913a-9d4b6e6d7c5a admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 01:21:03.736533 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 323/642] 10.222.0.25 () {56 vars in 1138 bytes} [Wed Oct 27 01:21:03 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:03.742386 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55be86b-5f22-4562-b83e-848fc5725728 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:03.762611 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55be86b-5f22-4562-b83e-848fc5725728 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:03.774756 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670d1ed-129c-45ec-948a-f2796e70761b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:03.775435 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670d1ed-129c-45ec-948a-f2796e70761b admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:03.775724 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670d1ed-129c-45ec-948a-f2796e70761b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:03.776007 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670d1ed-129c-45ec-948a-f2796e70761b admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:03.776870 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670d1ed-129c-45ec-948a-f2796e70761b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:03.777182 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670d1ed-129c-45ec-948a-f2796e70761b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:03.779070 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670d1ed-129c-45ec-948a-f2796e70761b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:03.812416 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 320/643] 10.222.0.25 () {56 vars in 1170 bytes} [Wed Oct 27 01:21:03 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:03.818611 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac82b9-84e3-446d-913a-9d4b6e6d7c5a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:03.828777 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac82b9-84e3-446d-913a-9d4b6e6d7c5a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:03.841055 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc60c58-d4ee-4781-a8b9-d44a35f4eeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:03.841946 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc60c58-d4ee-4781-a8b9-d44a35f4eeef admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:03.842411 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc60c58-d4ee-4781-a8b9-d44a35f4eeef admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:03.842863 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc60c58-d4ee-4781-a8b9-d44a35f4eeef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:03.851190 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc60c58-d4ee-4781-a8b9-d44a35f4eeef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:03.857803 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc60c58-d4ee-4781-a8b9-d44a35f4eeef admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:03.868267 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 324/644] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:21:03 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:03.874019 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670d1ed-129c-45ec-948a-f2796e70761b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:03.890429 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670d1ed-129c-45ec-948a-f2796e70761b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:03.895059 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfcb41-0113-436e-9bf9-c66fb18576bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:03.895854 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfcb41-0113-436e-9bf9-c66fb18576bf admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:03.896139 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfcb41-0113-436e-9bf9-c66fb18576bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:03.896421 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfcb41-0113-436e-9bf9-c66fb18576bf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:03.914498 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bfcb41-0113-436e-9bf9-c66fb18576bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:03.916799 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bfcb41-0113-436e-9bf9-c66fb18576bf admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:03.940160 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-c1bfcb41-0113-436e-9bf9-c66fb18576bf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:03.941688 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 321/645] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:03.947809 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc60c58-d4ee-4781-a8b9-d44a35f4eeef admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:03.974552 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc60c58-d4ee-4781-a8b9-d44a35f4eeef admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:03.985071 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d300c9a-33ca-4cdb-ba78-afc5f7a39d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:03.985990 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d300c9a-33ca-4cdb-ba78-afc5f7a39d9e admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:03.986478 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d300c9a-33ca-4cdb-ba78-afc5f7a39d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:03.986953 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d300c9a-33ca-4cdb-ba78-afc5f7a39d9e admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:03.987889 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d300c9a-33ca-4cdb-ba78-afc5f7a39d9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:03.988425 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d300c9a-33ca-4cdb-ba78-afc5f7a39d9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:03.990279 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d300c9a-33ca-4cdb-ba78-afc5f7a39d9e admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:04.007563 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 325/646] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:04.013355 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfcb41-0113-436e-9bf9-c66fb18576bf admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:04.034943 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfcb41-0113-436e-9bf9-c66fb18576bf admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:04.048762 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d035a-f892-4ebd-8a12-c9554072c7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:04.049609 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d035a-f892-4ebd-8a12-c9554072c7ac admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:04.049900 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d035a-f892-4ebd-8a12-c9554072c7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:04.050182 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d035a-f892-4ebd-8a12-c9554072c7ac admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:04.062668 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d035a-f892-4ebd-8a12-c9554072c7ac admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:04.064639 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d035a-f892-4ebd-8a12-c9554072c7ac admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:04.083223 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-5a6d035a-f892-4ebd-8a12-c9554072c7ac admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:21:04.084723 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 322/647] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:21:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:04.091250 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d300c9a-33ca-4cdb-ba78-afc5f7a39d9e admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:04.104932 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d300c9a-33ca-4cdb-ba78-afc5f7a39d9e admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:04.114773 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41e4f7-1c2f-40ad-ac6d-45a7495a53d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:04.115386 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41e4f7-1c2f-40ad-ac6d-45a7495a53d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:04.115675 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41e4f7-1c2f-40ad-ac6d-45a7495a53d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:04.115956 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41e4f7-1c2f-40ad-ac6d-45a7495a53d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:04.116768 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41e4f7-1c2f-40ad-ac6d-45a7495a53d6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:04.117081 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41e4f7-1c2f-40ad-ac6d-45a7495a53d6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:04.119480 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41e4f7-1c2f-40ad-ac6d-45a7495a53d6 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:04.138314 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 326/648] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:21:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:04.144992 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d035a-f892-4ebd-8a12-c9554072c7ac admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:04.156412 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d035a-f892-4ebd-8a12-c9554072c7ac admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:04.161011 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b484c69-3f9a-4be1-9945-9956206aa7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:04.161691 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b484c69-3f9a-4be1-9945-9956206aa7dc admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:04.161980 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b484c69-3f9a-4be1-9945-9956206aa7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:04.162261 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b484c69-3f9a-4be1-9945-9956206aa7dc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:04.163098 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b484c69-3f9a-4be1-9945-9956206aa7dc admin admin] RBAC: Adding query filter params (role.id=983c0291e0fa484ea053a791ead0e9c5, scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6, user.id=56895529b11b4236bccb5956a8ccb5b2) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:04.163412 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b484c69-3f9a-4be1-9945-9956206aa7dc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:04.165845 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b484c69-3f9a-4be1-9945-9956206aa7dc admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:04.171913 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 323/649] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:21:04 2021] GET /identity/v3/role_assignments?user.id=56895529b11b4236bccb5956a8ccb5b2&scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6&role.id=983c0291e0fa484ea053a791ead0e9c5 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:05.315523 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96276c14-12f5-4835-8876-f0c1777df55e None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.316030 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96276c14-12f5-4835-8876-f0c1777df55e None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.316030 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96276c14-12f5-4835-8876-f0c1777df55e None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.318093 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 327/650] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:05.324031 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a6683-6e56-46fb-be47-795fe687a24d None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.324442 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a6683-6e56-46fb-be47-795fe687a24d None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.324630 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a6683-6e56-46fb-be47-795fe687a24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.347075 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-564a6683-6e56-46fb-be47-795fe687a24d None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:05.348446 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-564a6683-6e56-46fb-be47-795fe687a24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:05.355728 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869987f2-34bb-45cb-9893-8cc0e48b8755 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.356021 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869987f2-34bb-45cb-9893-8cc0e48b8755 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.356310 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869987f2-34bb-45cb-9893-8cc0e48b8755 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.358362 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 328/651] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:21:05.360875 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 324/652] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:05 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:21:05.366702 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a302b-47bb-465a-a877-dd727854c941 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.366995 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a302b-47bb-465a-a877-dd727854c941 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.367282 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a302b-47bb-465a-a877-dd727854c941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.398583 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-ec6a302b-47bb-465a-a877-dd727854c941 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:05.400402 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-ec6a302b-47bb-465a-a877-dd727854c941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:05.411841 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a6683-6e56-46fb-be47-795fe687a24d None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:05.413013 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 329/653] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:05 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:05.428353 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a6683-6e56-46fb-be47-795fe687a24d None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:05.433237 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b73ef-6c37-44ba-95d3-21456285a88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:05.434072 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b73ef-6c37-44ba-95d3-21456285a88c admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.434359 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b73ef-6c37-44ba-95d3-21456285a88c admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.434637 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b73ef-6c37-44ba-95d3-21456285a88c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.451177 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b73ef-6c37-44ba-95d3-21456285a88c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:21:05.458093 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-689b73ef-6c37-44ba-95d3-21456285a88c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:21:05.459282 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 325/654] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:21:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:21:05.466205 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a302b-47bb-465a-a877-dd727854c941 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:05.473302 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b73ef-6c37-44ba-95d3-21456285a88c admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:05.479190 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a302b-47bb-465a-a877-dd727854c941 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:05.484209 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b73ef-6c37-44ba-95d3-21456285a88c admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:05.489014 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee959e11-6e92-4fc1-ae4b-8cda471a268e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:05.489843 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee959e11-6e92-4fc1-ae4b-8cda471a268e admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.490163 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee959e11-6e92-4fc1-ae4b-8cda471a268e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.490289 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12339a7b-8289-4d49-a97b-2156ed3228b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:05.490486 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee959e11-6e92-4fc1-ae4b-8cda471a268e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.491365 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12339a7b-8289-4d49-a97b-2156ed3228b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.491847 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12339a7b-8289-4d49-a97b-2156ed3228b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.492320 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12339a7b-8289-4d49-a97b-2156ed3228b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.493335 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12339a7b-8289-4d49-a97b-2156ed3228b3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:05.493865 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12339a7b-8289-4d49-a97b-2156ed3228b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:05.495670 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12339a7b-8289-4d49-a97b-2156ed3228b3 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:05.502012 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee959e11-6e92-4fc1-ae4b-8cda471a268e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:21:05.508165 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 330/655] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:21:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:05.509208 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-ee959e11-6e92-4fc1-ae4b-8cda471a268e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:21:05.510677 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 326/656] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:21:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:21:05.514207 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12339a7b-8289-4d49-a97b-2156ed3228b3 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:05.517055 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee959e11-6e92-4fc1-ae4b-8cda471a268e admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:05.527971 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee959e11-6e92-4fc1-ae4b-8cda471a268e admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:05.530630 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12339a7b-8289-4d49-a97b-2156ed3228b3 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:05.532722 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec519b9-17e3-4086-aa69-9ec098e6a083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:05.533537 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec519b9-17e3-4086-aa69-9ec098e6a083 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.533851 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec519b9-17e3-4086-aa69-9ec098e6a083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.534158 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec519b9-17e3-4086-aa69-9ec098e6a083 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.535072 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec519b9-17e3-4086-aa69-9ec098e6a083 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:05.535407 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec519b9-17e3-4086-aa69-9ec098e6a083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:05.537194 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec519b9-17e3-4086-aa69-9ec098e6a083 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:05.542020 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9732e5e-754a-40cb-bbae-1d53ff3b5743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:05.542821 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9732e5e-754a-40cb-bbae-1d53ff3b5743 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.543106 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9732e5e-754a-40cb-bbae-1d53ff3b5743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.543381 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9732e5e-754a-40cb-bbae-1d53ff3b5743 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.547545 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 327/657] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:21:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:05.548974 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394180f0-291a-49c7-a725-0255ae103c96 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.549270 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394180f0-291a-49c7-a725-0255ae103c96 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.553655 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394180f0-291a-49c7-a725-0255ae103c96 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.555678 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 328/658] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:05 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:05.558239 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394180f0-291a-49c7-a725-0255ae103c96 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:05.561231 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9732e5e-754a-40cb-bbae-1d53ff3b5743 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:05.563111 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9732e5e-754a-40cb-bbae-1d53ff3b5743 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:05.571090 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394180f0-291a-49c7-a725-0255ae103c96 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:05.575833 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cade09a-2239-4c22-8d58-30a6433cac5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:05.576681 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cade09a-2239-4c22-8d58-30a6433cac5c admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.577023 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cade09a-2239-4c22-8d58-30a6433cac5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.577325 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cade09a-2239-4c22-8d58-30a6433cac5c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.582347 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-e9732e5e-754a-40cb-bbae-1d53ff3b5743 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:05.583889 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 331/659] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:21:05.585662 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1c81a-b5f1-432e-8762-ac4ba3eedde3 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.585964 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1c81a-b5f1-432e-8762-ac4ba3eedde3 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.586775 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1c81a-b5f1-432e-8762-ac4ba3eedde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.589842 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cade09a-2239-4c22-8d58-30a6433cac5c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:05.591806 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cade09a-2239-4c22-8d58-30a6433cac5c admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:05.607114 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-7af1c81a-b5f1-432e-8762-ac4ba3eedde3 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:05.608305 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-7af1c81a-b5f1-432e-8762-ac4ba3eedde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:05.609555 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-1cade09a-2239-4c22-8d58-30a6433cac5c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:05.611285 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 329/660] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:21:05.612138 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cade09a-2239-4c22-8d58-30a6433cac5c admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:05.625361 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 332/661] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:05 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:05.626254 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1c81a-b5f1-432e-8762-ac4ba3eedde3 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:05.631528 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cade09a-2239-4c22-8d58-30a6433cac5c admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:05.637182 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1c81a-b5f1-432e-8762-ac4ba3eedde3 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:05.641625 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bbd48-25d2-4641-900a-c3b5ac347b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:05.642293 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bbd48-25d2-4641-900a-c3b5ac347b0e admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.642573 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bbd48-25d2-4641-900a-c3b5ac347b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.642948 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bbd48-25d2-4641-900a-c3b5ac347b0e admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.643420 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e6972-0990-42f2-bf9e-f620e064ea35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:05.643697 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902bbd48-25d2-4641-900a-c3b5ac347b0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:05.644005 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902bbd48-25d2-4641-900a-c3b5ac347b0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:05.644313 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e6972-0990-42f2-bf9e-f620e064ea35 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.644611 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e6972-0990-42f2-bf9e-f620e064ea35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.644893 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e6972-0990-42f2-bf9e-f620e064ea35 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.645614 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902bbd48-25d2-4641-900a-c3b5ac347b0e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:05.646010 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e6972-0990-42f2-bf9e-f620e064ea35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:05.646319 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e6972-0990-42f2-bf9e-f620e064ea35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:05.648630 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e6972-0990-42f2-bf9e-f620e064ea35 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:05.665337 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 333/662] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:05.674336 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 330/663] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:05.677531 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bbd48-25d2-4641-900a-c3b5ac347b0e admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:05.677750 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e6972-0990-42f2-bf9e-f620e064ea35 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:05.688402 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e6972-0990-42f2-bf9e-f620e064ea35 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:05.690033 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bbd48-25d2-4641-900a-c3b5ac347b0e admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:05.693597 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791ba7c-5c96-4ea6-ad4f-ee8e636191ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:05.694536 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791ba7c-5c96-4ea6-ad4f-ee8e636191ee admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.694827 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791ba7c-5c96-4ea6-ad4f-ee8e636191ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.694990 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c763cc-fd8c-4375-9ce0-8bd165a29cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:05.695201 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791ba7c-5c96-4ea6-ad4f-ee8e636191ee admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.695803 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c763cc-fd8c-4375-9ce0-8bd165a29cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.695970 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791ba7c-5c96-4ea6-ad4f-ee8e636191ee admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:05.696115 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c763cc-fd8c-4375-9ce0-8bd165a29cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.696345 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c763cc-fd8c-4375-9ce0-8bd165a29cf0 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.697875 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791ba7c-5c96-4ea6-ad4f-ee8e636191ee admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:05.703955 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c763cc-fd8c-4375-9ce0-8bd165a29cf0 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:05.705967 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c763cc-fd8c-4375-9ce0-8bd165a29cf0 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:05.711058 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-f791ba7c-5c96-4ea6-ad4f-ee8e636191ee admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 01:21:05.713161 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 334/664] 10.222.0.25 () {56 vars in 1150 bytes} [Wed Oct 27 01:21:05 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:05.713969 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791ba7c-5c96-4ea6-ad4f-ee8e636191ee admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:05.723894 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791ba7c-5c96-4ea6-ad4f-ee8e636191ee admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:05.726673 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-29c763cc-fd8c-4375-9ce0-8bd165a29cf0 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 01:21:05.728599 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 331/665] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:21:05 2021] GET /identity/v3/users/swift => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:05.729567 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c763cc-fd8c-4375-9ce0-8bd165a29cf0 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:05.737766 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68af488-b6f2-4abc-9f63-93fd267a26b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:05.738697 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68af488-b6f2-4abc-9f63-93fd267a26b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.739042 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68af488-b6f2-4abc-9f63-93fd267a26b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.739323 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68af488-b6f2-4abc-9f63-93fd267a26b5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.744017 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c763cc-fd8c-4375-9ce0-8bd165a29cf0 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:05.748671 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd812496-bfaa-4813-bd48-0a2b555a5f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:05.749335 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd812496-bfaa-4813-bd48-0a2b555a5f1a admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.749622 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68af488-b6f2-4abc-9f63-93fd267a26b5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:05.749796 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd812496-bfaa-4813-bd48-0a2b555a5f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.749959 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd812496-bfaa-4813-bd48-0a2b555a5f1a admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.750622 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd812496-bfaa-4813-bd48-0a2b555a5f1a admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:05.750929 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd812496-bfaa-4813-bd48-0a2b555a5f1a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:05.751798 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68af488-b6f2-4abc-9f63-93fd267a26b5 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:05.752683 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd812496-bfaa-4813-bd48-0a2b555a5f1a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:05.757569 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 332/666] 10.222.0.25 () {56 vars in 1145 bytes} [Wed Oct 27 01:21:05 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:05.763360 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd812496-bfaa-4813-bd48-0a2b555a5f1a admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:05.766965 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-f68af488-b6f2-4abc-9f63-93fd267a26b5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:21:05.768308 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 335/667] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Oct 27 01:21:05 2021] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:05.768952 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68af488-b6f2-4abc-9f63-93fd267a26b5 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:05.778567 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd812496-bfaa-4813-bd48-0a2b555a5f1a admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:05.779531 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68af488-b6f2-4abc-9f63-93fd267a26b5 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:05.783521 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f6387-1545-4576-9e73-99724e25c68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:05.784261 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f6387-1545-4576-9e73-99724e25c68c admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.784551 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f6387-1545-4576-9e73-99724e25c68c admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.784731 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c8022-d5cd-4d02-868a-fc236472ebdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:05.784898 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f6387-1545-4576-9e73-99724e25c68c admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.785418 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c8022-d5cd-4d02-868a-fc236472ebdc admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.785688 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f6387-1545-4576-9e73-99724e25c68c admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:05.785851 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c8022-d5cd-4d02-868a-fc236472ebdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.786007 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f6387-1545-4576-9e73-99724e25c68c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:05.786151 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c8022-d5cd-4d02-868a-fc236472ebdc admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.786805 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c8022-d5cd-4d02-868a-fc236472ebdc admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:05.787169 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c8022-d5cd-4d02-868a-fc236472ebdc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:05.787802 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f6387-1545-4576-9e73-99724e25c68c admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:05.788836 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c8022-d5cd-4d02-868a-fc236472ebdc admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:05.795455 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 336/668] 10.222.0.25 () {56 vars in 1145 bytes} [Wed Oct 27 01:21:05 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:05.796193 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c8022-d5cd-4d02-868a-fc236472ebdc admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:05.806089 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c8022-d5cd-4d02-868a-fc236472ebdc admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:05.811311 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd6fd1-2c53-4ae5-a0e4-7df79073f958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:05.811798 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 333/669] 10.222.0.25 () {56 vars in 1156 bytes} [Wed Oct 27 01:21:05 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:05.812247 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd6fd1-2c53-4ae5-a0e4-7df79073f958 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.812536 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd6fd1-2c53-4ae5-a0e4-7df79073f958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.812707 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f6387-1545-4576-9e73-99724e25c68c admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:05.812859 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd6fd1-2c53-4ae5-a0e4-7df79073f958 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.818173 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd6fd1-2c53-4ae5-a0e4-7df79073f958 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:05.818497 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd6fd1-2c53-4ae5-a0e4-7df79073f958 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:05.820354 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd6fd1-2c53-4ae5-a0e4-7df79073f958 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:05.823570 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f6387-1545-4576-9e73-99724e25c68c admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:05.828884 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707cf69-f838-4fb4-81d4-6938891961ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:05.829629 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707cf69-f838-4fb4-81d4-6938891961ec admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.829917 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707cf69-f838-4fb4-81d4-6938891961ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.830217 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707cf69-f838-4fb4-81d4-6938891961ec admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.831198 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707cf69-f838-4fb4-81d4-6938891961ec admin admin] RBAC: Adding query filter params (interface=public, service_id=aa1c0fef2cc543e0a9cbb6cb579f7cea, region_id=RegionOne) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:05.831569 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707cf69-f838-4fb4-81d4-6938891961ec admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:05.832581 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING py.warnings [None req-2707cf69-f838-4fb4-81d4-6938891961ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:21:05.832581 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: warnings.warn(msg) Oct 27 01:21:05.832581 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: Oct 27 01:21:05.833620 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707cf69-f838-4fb4-81d4-6938891961ec admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:05.841787 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 337/670] 10.222.0.25 () {56 vars in 1154 bytes} [Wed Oct 27 01:21:05 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:05.842652 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd6fd1-2c53-4ae5-a0e4-7df79073f958 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:05.848009 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 334/671] 10.222.0.25 () {56 vars in 1272 bytes} [Wed Oct 27 01:21:05 2021] GET /identity/v3/endpoints?service_id=aa1c0fef2cc543e0a9cbb6cb579f7cea&interface=public®ion_id=RegionOne => generated 194 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:05.850105 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707cf69-f838-4fb4-81d4-6938891961ec admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:05.852778 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd6fd1-2c53-4ae5-a0e4-7df79073f958 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:05.862411 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04d180-af40-4baa-909e-3c55686b7c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:05.863124 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04d180-af40-4baa-909e-3c55686b7c10 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.863414 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04d180-af40-4baa-909e-3c55686b7c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.863695 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04d180-af40-4baa-909e-3c55686b7c10 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.867185 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707cf69-f838-4fb4-81d4-6938891961ec admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:05.872993 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afdc5f-5643-4953-bc42-f043f354e4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:05.873719 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afdc5f-5643-4953-bc42-f043f354e4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.874013 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afdc5f-5643-4953-bc42-f043f354e4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.874297 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afdc5f-5643-4953-bc42-f043f354e4e1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.876351 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04d180-af40-4baa-909e-3c55686b7c10 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:05.878575 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04d180-af40-4baa-909e-3c55686b7c10 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:05.884230 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afdc5f-5643-4953-bc42-f043f354e4e1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:05.887078 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afdc5f-5643-4953-bc42-f043f354e4e1 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:05.891345 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 338/672] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:21:05 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:05.892888 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04d180-af40-4baa-909e-3c55686b7c10 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:05.904132 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04d180-af40-4baa-909e-3c55686b7c10 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:05.909515 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 335/673] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:21:05 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:05.909515 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afdc5f-5643-4953-bc42-f043f354e4e1 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:05.918672 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32b310-a1a7-486b-b137-fd58cfc85b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:05.918833 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afdc5f-5643-4953-bc42-f043f354e4e1 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:05.919952 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32b310-a1a7-486b-b137-fd58cfc85b35 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.920599 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32b310-a1a7-486b-b137-fd58cfc85b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.921183 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32b310-a1a7-486b-b137-fd58cfc85b35 admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.922289 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32b310-a1a7-486b-b137-fd58cfc85b35 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:05.923660 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28213ffb-87cf-41e3-afc8-639333f20507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:05.924404 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32b310-a1a7-486b-b137-fd58cfc85b35 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:05.924575 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28213ffb-87cf-41e3-afc8-639333f20507 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.924957 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28213ffb-87cf-41e3-afc8-639333f20507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.925393 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28213ffb-87cf-41e3-afc8-639333f20507 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.938119 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 339/674] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Oct 27 01:21:05 2021] GET /identity/v3/services => generated 772 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:05.938684 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32b310-a1a7-486b-b137-fd58cfc85b35 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:05.947038 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28213ffb-87cf-41e3-afc8-639333f20507 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:05.948965 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28213ffb-87cf-41e3-afc8-639333f20507 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:05.962136 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32b310-a1a7-486b-b137-fd58cfc85b35 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:05.973930 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c063381-b2e8-4ed4-b9ed-2db14d824465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:05.974787 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c063381-b2e8-4ed4-b9ed-2db14d824465 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.975071 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c063381-b2e8-4ed4-b9ed-2db14d824465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.975350 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c063381-b2e8-4ed4-b9ed-2db14d824465 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.989583 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-28213ffb-87cf-41e3-afc8-639333f20507 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:05.990873 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 336/675] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:06.000186 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c063381-b2e8-4ed4-b9ed-2db14d824465 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:06.002160 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c063381-b2e8-4ed4-b9ed-2db14d824465 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:06.004300 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28213ffb-87cf-41e3-afc8-639333f20507 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:06.022927 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28213ffb-87cf-41e3-afc8-639333f20507 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:06.029618 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f008f2-d533-4d67-a9ce-0c9291e7d786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:06.030297 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f008f2-d533-4d67-a9ce-0c9291e7d786 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:06.030585 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f008f2-d533-4d67-a9ce-0c9291e7d786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:06.030866 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f008f2-d533-4d67-a9ce-0c9291e7d786 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:06.031615 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f008f2-d533-4d67-a9ce-0c9291e7d786 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:06.031927 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f008f2-d533-4d67-a9ce-0c9291e7d786 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:06.033548 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f008f2-d533-4d67-a9ce-0c9291e7d786 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:06.036703 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-2c063381-b2e8-4ed4-b9ed-2db14d824465 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:06.038073 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 340/676] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:06.039465 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a5e19-d737-4634-8636-a1589464c1a3 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:06.039756 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a5e19-d737-4634-8636-a1589464c1a3 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:06.040069 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a5e19-d737-4634-8636-a1589464c1a3 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:06.042038 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 341/677] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:06.045916 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a5e19-d737-4634-8636-a1589464c1a3 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:06.051057 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 337/678] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:06.052452 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1d030-a9be-416d-8023-5329d355f616 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:06.052749 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1d030-a9be-416d-8023-5329d355f616 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:06.053027 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1d030-a9be-416d-8023-5329d355f616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:06.066906 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a5e19-d737-4634-8636-a1589464c1a3 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:06.072498 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e81094-d309-44ba-8c7d-2739e1f5b514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:06.072737 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-38b1d030-a9be-416d-8023-5329d355f616 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:06.073382 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e81094-d309-44ba-8c7d-2739e1f5b514 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:06.073882 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e81094-d309-44ba-8c7d-2739e1f5b514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:06.074030 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-38b1d030-a9be-416d-8023-5329d355f616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:06.074297 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e81094-d309-44ba-8c7d-2739e1f5b514 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:06.075145 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e81094-d309-44ba-8c7d-2739e1f5b514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:06.075555 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e81094-d309-44ba-8c7d-2739e1f5b514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:06.077301 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e81094-d309-44ba-8c7d-2739e1f5b514 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:06.082428 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 338/679] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:06 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:06.083340 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1d030-a9be-416d-8023-5329d355f616 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:06.091598 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 342/680] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:06.097879 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e81094-d309-44ba-8c7d-2739e1f5b514 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:06.108251 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e81094-d309-44ba-8c7d-2739e1f5b514 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:06.113569 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11331bcb-276d-4a29-bc94-09075a218e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:06.114756 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11331bcb-276d-4a29-bc94-09075a218e8b admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:06.115249 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11331bcb-276d-4a29-bc94-09075a218e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:06.115762 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11331bcb-276d-4a29-bc94-09075a218e8b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:06.116055 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1d030-a9be-416d-8023-5329d355f616 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:06.121251 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527edfe0-d875-49ad-af5e-e8235a27e52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:06.122117 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527edfe0-d875-49ad-af5e-e8235a27e52f admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:06.122404 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527edfe0-d875-49ad-af5e-e8235a27e52f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:06.122763 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527edfe0-d875-49ad-af5e-e8235a27e52f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:06.126970 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11331bcb-276d-4a29-bc94-09075a218e8b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:06.129387 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11331bcb-276d-4a29-bc94-09075a218e8b admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:06.130624 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527edfe0-d875-49ad-af5e-e8235a27e52f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:06.132600 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527edfe0-d875-49ad-af5e-e8235a27e52f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:06.145267 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-11331bcb-276d-4a29-bc94-09075a218e8b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:21:06.150135 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-527edfe0-d875-49ad-af5e-e8235a27e52f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:21:06.150135 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 339/682] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:21:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:06.150534 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527edfe0-d875-49ad-af5e-e8235a27e52f admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:06.150737 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 343/682] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:21:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:21:06.155217 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11331bcb-276d-4a29-bc94-09075a218e8b admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:06.165427 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11331bcb-276d-4a29-bc94-09075a218e8b admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:06.169572 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527edfe0-d875-49ad-af5e-e8235a27e52f admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:06.170412 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea2eab-5f72-48b7-b7f2-7efae02b9e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:06.171184 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea2eab-5f72-48b7-b7f2-7efae02b9e76 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:06.171519 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea2eab-5f72-48b7-b7f2-7efae02b9e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:06.171796 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea2eab-5f72-48b7-b7f2-7efae02b9e76 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:06.172795 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea2eab-5f72-48b7-b7f2-7efae02b9e76 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:06.173106 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea2eab-5f72-48b7-b7f2-7efae02b9e76 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:06.175308 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea2eab-5f72-48b7-b7f2-7efae02b9e76 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:06.176086 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736ac31-5c64-401d-b1cb-df9c72e77fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:06.177435 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736ac31-5c64-401d-b1cb-df9c72e77fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:06.177761 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736ac31-5c64-401d-b1cb-df9c72e77fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:06.178049 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736ac31-5c64-401d-b1cb-df9c72e77fd5 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:06.179218 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736ac31-5c64-401d-b1cb-df9c72e77fd5 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:06.181348 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736ac31-5c64-401d-b1cb-df9c72e77fd5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:06.191235 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 344/683] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:21:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:06.192385 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea2eab-5f72-48b7-b7f2-7efae02b9e76 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:06.194087 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-a736ac31-5c64-401d-b1cb-df9c72e77fd5 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 01:21:06.195561 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 340/684] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:21:06 2021] GET /identity/v3/services/network => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:06.196862 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736ac31-5c64-401d-b1cb-df9c72e77fd5 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:06.206038 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea2eab-5f72-48b7-b7f2-7efae02b9e76 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:06.210653 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eab087-d0b8-417e-8271-9bc43920ca36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:06.211339 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eab087-d0b8-417e-8271-9bc43920ca36 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:06.211627 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eab087-d0b8-417e-8271-9bc43920ca36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:06.211905 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eab087-d0b8-417e-8271-9bc43920ca36 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:06.212335 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736ac31-5c64-401d-b1cb-df9c72e77fd5 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:06.212696 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eab087-d0b8-417e-8271-9bc43920ca36 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:06.213000 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eab087-d0b8-417e-8271-9bc43920ca36 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:06.216053 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eab087-d0b8-417e-8271-9bc43920ca36 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:06.219020 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757edc8c-ed47-4be1-aa57-7e7448662121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:06.219459 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757edc8c-ed47-4be1-aa57-7e7448662121 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:06.219742 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757edc8c-ed47-4be1-aa57-7e7448662121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:06.220020 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757edc8c-ed47-4be1-aa57-7e7448662121 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:06.220857 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757edc8c-ed47-4be1-aa57-7e7448662121 admin admin] RBAC: Adding query filter params (role.id=df3a437e6ea14518a9c1b9a348e18c99, scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6, user.id=b2f8304b85b64dc4ac58523897306660) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:06.221169 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757edc8c-ed47-4be1-aa57-7e7448662121 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:06.223097 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757edc8c-ed47-4be1-aa57-7e7448662121 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:06.230343 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 345/685] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:21:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:06.231642 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eab087-d0b8-417e-8271-9bc43920ca36 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:06.235579 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 341/686] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:21:06 2021] GET /identity/v3/role_assignments?user.id=b2f8304b85b64dc4ac58523897306660&scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6&role.id=df3a437e6ea14518a9c1b9a348e18c99 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:06.236662 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757edc8c-ed47-4be1-aa57-7e7448662121 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:06.242223 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eab087-d0b8-417e-8271-9bc43920ca36 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:06.248472 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc25efd-b747-448c-9ae8-bd97acbe1784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:06.249652 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc25efd-b747-448c-9ae8-bd97acbe1784 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:06.250233 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc25efd-b747-448c-9ae8-bd97acbe1784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:06.250707 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc25efd-b747-448c-9ae8-bd97acbe1784 admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:06.251991 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc25efd-b747-448c-9ae8-bd97acbe1784 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:06.252103 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757edc8c-ed47-4be1-aa57-7e7448662121 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:06.252526 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc25efd-b747-448c-9ae8-bd97acbe1784 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:06.254647 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc25efd-b747-448c-9ae8-bd97acbe1784 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:06.259098 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33728275-43fe-4860-8f86-882b99084bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:06.259763 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33728275-43fe-4860-8f86-882b99084bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:06.260046 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33728275-43fe-4860-8f86-882b99084bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:06.260319 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33728275-43fe-4860-8f86-882b99084bb1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:06.261165 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33728275-43fe-4860-8f86-882b99084bb1 admin admin] RBAC: Adding query filter params (role.id=df3a437e6ea14518a9c1b9a348e18c99, scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6, user.id=f386f358fdb241f5a529a2cf3d839201) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:06.261527 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33728275-43fe-4860-8f86-882b99084bb1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:06.261881 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 346/687] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Oct 27 01:21:06 2021] GET /identity/v3/services?name=network => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:06.263504 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33728275-43fe-4860-8f86-882b99084bb1 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:06.267964 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc25efd-b747-448c-9ae8-bd97acbe1784 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:06.279083 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc25efd-b747-448c-9ae8-bd97acbe1784 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:06.282897 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 342/688] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:21:06 2021] GET /identity/v3/role_assignments?user.id=f386f358fdb241f5a529a2cf3d839201&scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6&role.id=df3a437e6ea14518a9c1b9a348e18c99 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:06.285129 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c646a-1499-4a3f-9f45-25a0fe80ce9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:06.286179 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c646a-1499-4a3f-9f45-25a0fe80ce9d admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:06.286693 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c646a-1499-4a3f-9f45-25a0fe80ce9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:06.287239 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c646a-1499-4a3f-9f45-25a0fe80ce9d admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:06.288300 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c646a-1499-4a3f-9f45-25a0fe80ce9d admin admin] RBAC: Adding query filter params (type=network) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:06.288853 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c646a-1499-4a3f-9f45-25a0fe80ce9d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:06.291027 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c646a-1499-4a3f-9f45-25a0fe80ce9d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:06.297610 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 347/689] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Oct 27 01:21:06 2021] GET /identity/v3/services?type=network => generated 350 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:06.304868 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33728275-43fe-4860-8f86-882b99084bb1 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:06.324407 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33728275-43fe-4860-8f86-882b99084bb1 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:06.339990 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388465b8-6f3c-458a-99f0-18a42e19065a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:06.340672 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388465b8-6f3c-458a-99f0-18a42e19065a admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:06.340962 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388465b8-6f3c-458a-99f0-18a42e19065a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:06.341241 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388465b8-6f3c-458a-99f0-18a42e19065a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:06.342116 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388465b8-6f3c-458a-99f0-18a42e19065a admin admin] RBAC: Adding query filter params (interface=public, service_id=58ef4d654a7742459ca85682db5486c7, region_id=RegionOne) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:06.342432 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388465b8-6f3c-458a-99f0-18a42e19065a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:06.344074 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388465b8-6f3c-458a-99f0-18a42e19065a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:06.354614 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 343/690] 10.222.0.25 () {56 vars in 1272 bytes} [Wed Oct 27 01:21:06 2021] GET /identity/v3/endpoints?service_id=58ef4d654a7742459ca85682db5486c7&interface=public®ion_id=RegionOne => generated 194 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:06.360469 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c646a-1499-4a3f-9f45-25a0fe80ce9d admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:06.378733 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c646a-1499-4a3f-9f45-25a0fe80ce9d admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:06.387646 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5f791-6803-4cb1-b779-163e769f6f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:06.388786 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5f791-6803-4cb1-b779-163e769f6f3e admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:06.389300 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5f791-6803-4cb1-b779-163e769f6f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:06.389865 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5f791-6803-4cb1-b779-163e769f6f3e admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:06.390777 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5f791-6803-4cb1-b779-163e769f6f3e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:06.392714 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5f791-6803-4cb1-b779-163e769f6f3e admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:06.402789 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 348/691] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Oct 27 01:21:06 2021] GET /identity/v3/services => generated 772 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:06.993547 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1c1fb-a7bf-468d-9940-53f8126238ca None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:06.993859 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1c1fb-a7bf-468d-9940-53f8126238ca None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:06.994117 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1c1fb-a7bf-468d-9940-53f8126238ca None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:06.996195 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 344/692] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:07.001813 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd6601-980c-4b76-825c-a3c5278101d0 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:07.002104 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd6601-980c-4b76-825c-a3c5278101d0 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:07.002382 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd6601-980c-4b76-825c-a3c5278101d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:07.026400 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-b0dd6601-980c-4b76-825c-a3c5278101d0 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:07.027586 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-b0dd6601-980c-4b76-825c-a3c5278101d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:07.035350 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 349/693] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:07 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:07.078173 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1c1fb-a7bf-468d-9940-53f8126238ca None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:07.090307 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1c1fb-a7bf-468d-9940-53f8126238ca None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:07.094736 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9f7d8-0d28-4b4e-ae87-08c73d4671d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:07.095515 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9f7d8-0d28-4b4e-ae87-08c73d4671d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:07.095799 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9f7d8-0d28-4b4e-ae87-08c73d4671d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:07.096078 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9f7d8-0d28-4b4e-ae87-08c73d4671d7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:07.114336 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9f7d8-0d28-4b4e-ae87-08c73d4671d7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:21:07.121869 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-b8a9f7d8-0d28-4b4e-ae87-08c73d4671d7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:21:07.123328 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 345/694] 10.222.0.25 () {56 vars in 1123 bytes} [Wed Oct 27 01:21:07 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:07.129643 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd6601-980c-4b76-825c-a3c5278101d0 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:07.142262 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd6601-980c-4b76-825c-a3c5278101d0 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:07.155064 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a89d8-da6a-4ee0-9f34-75c89c8839a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:07.155064 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a89d8-da6a-4ee0-9f34-75c89c8839a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:07.155064 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a89d8-da6a-4ee0-9f34-75c89c8839a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:07.155347 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a89d8-da6a-4ee0-9f34-75c89c8839a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:07.156051 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a89d8-da6a-4ee0-9f34-75c89c8839a7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:07.156360 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a89d8-da6a-4ee0-9f34-75c89c8839a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:07.158139 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a89d8-da6a-4ee0-9f34-75c89c8839a7 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:07.171761 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 350/695] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Oct 27 01:21:07 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:07.177711 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9f7d8-0d28-4b4e-ae87-08c73d4671d7 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:07.194471 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9f7d8-0d28-4b4e-ae87-08c73d4671d7 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:07.202174 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde49d2-f722-45cf-9a8b-99c91b6cba63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:07.202974 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde49d2-f722-45cf-9a8b-99c91b6cba63 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:07.203265 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde49d2-f722-45cf-9a8b-99c91b6cba63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:07.203544 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde49d2-f722-45cf-9a8b-99c91b6cba63 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:07.217074 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde49d2-f722-45cf-9a8b-99c91b6cba63 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:07.219050 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde49d2-f722-45cf-9a8b-99c91b6cba63 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:07.239846 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-cfde49d2-f722-45cf-9a8b-99c91b6cba63 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:07.241358 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 346/696] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:07.247702 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a89d8-da6a-4ee0-9f34-75c89c8839a7 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:07.263009 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a89d8-da6a-4ee0-9f34-75c89c8839a7 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:07.270628 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f693f2-2b93-4eeb-98c1-f8debc16b7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:07.271290 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f693f2-2b93-4eeb-98c1-f8debc16b7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:07.271576 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f693f2-2b93-4eeb-98c1-f8debc16b7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:07.271880 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f693f2-2b93-4eeb-98c1-f8debc16b7f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:07.272592 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f693f2-2b93-4eeb-98c1-f8debc16b7f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:07.272898 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f693f2-2b93-4eeb-98c1-f8debc16b7f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:07.274535 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f693f2-2b93-4eeb-98c1-f8debc16b7f0 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:07.292790 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 351/697] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:07.299126 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde49d2-f722-45cf-9a8b-99c91b6cba63 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:07.309748 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde49d2-f722-45cf-9a8b-99c91b6cba63 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:07.314354 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51fe1d-ea83-4dc7-ad4a-2754e1c61560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:07.315155 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51fe1d-ea83-4dc7-ad4a-2754e1c61560 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:07.315438 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51fe1d-ea83-4dc7-ad4a-2754e1c61560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:07.315712 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51fe1d-ea83-4dc7-ad4a-2754e1c61560 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:07.323463 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51fe1d-ea83-4dc7-ad4a-2754e1c61560 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:07.325509 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51fe1d-ea83-4dc7-ad4a-2754e1c61560 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:07.340090 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-fa51fe1d-ea83-4dc7-ad4a-2754e1c61560 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 01:21:07.341619 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 347/698] 10.222.0.25 () {56 vars in 1138 bytes} [Wed Oct 27 01:21:07 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:07.350064 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f693f2-2b93-4eeb-98c1-f8debc16b7f0 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:07.362113 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f693f2-2b93-4eeb-98c1-f8debc16b7f0 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:07.366825 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d02673-d113-4991-ac05-2d155b5fb996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:07.368151 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d02673-d113-4991-ac05-2d155b5fb996 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:07.368437 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d02673-d113-4991-ac05-2d155b5fb996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:07.368711 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d02673-d113-4991-ac05-2d155b5fb996 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:07.369650 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d02673-d113-4991-ac05-2d155b5fb996 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:07.369961 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d02673-d113-4991-ac05-2d155b5fb996 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:07.371896 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d02673-d113-4991-ac05-2d155b5fb996 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:07.394014 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 352/699] 10.222.0.25 () {56 vars in 1170 bytes} [Wed Oct 27 01:21:07 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:07.401767 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51fe1d-ea83-4dc7-ad4a-2754e1c61560 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:07.415019 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51fe1d-ea83-4dc7-ad4a-2754e1c61560 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:07.420111 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0c90a-3a6b-4d78-adf6-8ae604cb7650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:07.420980 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0c90a-3a6b-4d78-adf6-8ae604cb7650 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:07.421274 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0c90a-3a6b-4d78-adf6-8ae604cb7650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:07.421630 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0c90a-3a6b-4d78-adf6-8ae604cb7650 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:07.436521 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0c90a-3a6b-4d78-adf6-8ae604cb7650 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:07.438476 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0c90a-3a6b-4d78-adf6-8ae604cb7650 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:07.456203 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-b0d0c90a-3a6b-4d78-adf6-8ae604cb7650 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:07.457751 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 348/700] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:07.466615 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d02673-d113-4991-ac05-2d155b5fb996 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:07.479088 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d02673-d113-4991-ac05-2d155b5fb996 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:07.484822 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1549959-b1a3-4e43-8287-9705f84e92ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:07.485517 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1549959-b1a3-4e43-8287-9705f84e92ae admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:07.485872 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1549959-b1a3-4e43-8287-9705f84e92ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:07.486155 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1549959-b1a3-4e43-8287-9705f84e92ae admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:07.486937 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1549959-b1a3-4e43-8287-9705f84e92ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:07.487257 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1549959-b1a3-4e43-8287-9705f84e92ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:07.488929 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1549959-b1a3-4e43-8287-9705f84e92ae admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:07.502221 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 353/701] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:07.509795 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0c90a-3a6b-4d78-adf6-8ae604cb7650 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:07.531388 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0c90a-3a6b-4d78-adf6-8ae604cb7650 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:07.542423 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f6f98-dffb-48a5-bc1d-93471ea18fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:07.543572 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f6f98-dffb-48a5-bc1d-93471ea18fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:07.544052 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f6f98-dffb-48a5-bc1d-93471ea18fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:07.544444 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f6f98-dffb-48a5-bc1d-93471ea18fc0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:07.563097 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f6f98-dffb-48a5-bc1d-93471ea18fc0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:07.563097 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f6f98-dffb-48a5-bc1d-93471ea18fc0 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:07.581964 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-d63f6f98-dffb-48a5-bc1d-93471ea18fc0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:21:07.583491 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 349/702] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:21:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:21:07.591003 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1549959-b1a3-4e43-8287-9705f84e92ae admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:07.608010 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1549959-b1a3-4e43-8287-9705f84e92ae admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:07.616766 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ccf80a-d78f-4149-a22c-4f4b1956ddfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:07.617468 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccf80a-d78f-4149-a22c-4f4b1956ddfd admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:07.617831 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccf80a-d78f-4149-a22c-4f4b1956ddfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:07.618109 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccf80a-d78f-4149-a22c-4f4b1956ddfd admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:07.618957 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ccf80a-d78f-4149-a22c-4f4b1956ddfd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:07.619269 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ccf80a-d78f-4149-a22c-4f4b1956ddfd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:07.621179 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ccf80a-d78f-4149-a22c-4f4b1956ddfd admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:07.643025 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 354/703] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:21:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:07.649753 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f6f98-dffb-48a5-bc1d-93471ea18fc0 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:07.666620 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f6f98-dffb-48a5-bc1d-93471ea18fc0 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:07.671415 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeeb156-9c5b-4cd6-8216-e5c67fe5ba10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:07.672540 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeeb156-9c5b-4cd6-8216-e5c67fe5ba10 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:07.673026 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeeb156-9c5b-4cd6-8216-e5c67fe5ba10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:07.673674 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeeb156-9c5b-4cd6-8216-e5c67fe5ba10 admin admin] PATH_INFO: `/v3/projects/2b95c6a455e74d9487ae73f44a9ba0e6/users/56895529b11b4236bccb5956a8ccb5b2/roles/983c0291e0fa484ea053a791ead0e9c5` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:07.698028 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeeb156-9c5b-4cd6-8216-e5c67fe5ba10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b95c6a455e74d9487ae73f44a9ba0e6, user_id=56895529b11b4236bccb5956a8ccb5b2, role_id=983c0291e0fa484ea053a791ead0e9c5)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:07.700667 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeeb156-9c5b-4cd6-8216-e5c67fe5ba10 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:07.719381 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 350/704] 10.222.0.25 () {58 vars in 1460 bytes} [Wed Oct 27 01:21:07 2021] PUT /identity/v3/projects/2b95c6a455e74d9487ae73f44a9ba0e6/users/56895529b11b4236bccb5956a8ccb5b2/roles/983c0291e0fa484ea053a791ead0e9c5 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:09.001217 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8fa03-7596-409e-9bbb-182e212d01ee None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.002242 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8fa03-7596-409e-9bbb-182e212d01ee None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.002736 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8fa03-7596-409e-9bbb-182e212d01ee None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.005206 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 355/705] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:09.012921 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18925815-7063-421c-9ebb-8d29c41addce None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.013986 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18925815-7063-421c-9ebb-8d29c41addce None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.014474 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18925815-7063-421c-9ebb-8d29c41addce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.041705 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-18925815-7063-421c-9ebb-8d29c41addce None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:09.043250 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-18925815-7063-421c-9ebb-8d29c41addce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:09.126876 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 351/706] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:09 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:21:09.156527 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c460f-ee26-4b2a-824b-77af239232f9 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.157143 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c460f-ee26-4b2a-824b-77af239232f9 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.157650 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c460f-ee26-4b2a-824b-77af239232f9 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.159630 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 356/707] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:09.165840 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a41340-922c-46f2-9b3c-9b6298fdf798 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.166414 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a41340-922c-46f2-9b3c-9b6298fdf798 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.166896 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a41340-922c-46f2-9b3c-9b6298fdf798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.171508 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c460f-ee26-4b2a-824b-77af239232f9 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:09.189517 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c460f-ee26-4b2a-824b-77af239232f9 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:09.200315 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98ebe3-e25d-4208-aea4-3735dbb4bcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:09.201555 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98ebe3-e25d-4208-aea4-3735dbb4bcd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.202250 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98ebe3-e25d-4208-aea4-3735dbb4bcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.202524 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98ebe3-e25d-4208-aea4-3735dbb4bcd6 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.203204 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98ebe3-e25d-4208-aea4-3735dbb4bcd6 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:09.205650 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98ebe3-e25d-4208-aea4-3735dbb4bcd6 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:09.209855 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-a9a41340-922c-46f2-9b3c-9b6298fdf798 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:09.211326 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-a9a41340-922c-46f2-9b3c-9b6298fdf798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:09.218391 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-ad98ebe3-e25d-4208-aea4-3735dbb4bcd6 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 01:21:09.224753 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 357/708] 10.222.0.25 () {56 vars in 1150 bytes} [Wed Oct 27 01:21:09 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:09.224753 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d264227-b9d9-406c-85a5-19b433d53075 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.224753 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d264227-b9d9-406c-85a5-19b433d53075 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.224753 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d264227-b9d9-406c-85a5-19b433d53075 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.224753 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 358/709] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:09.225772 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 352/710] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:09 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:21:09.229178 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d264227-b9d9-406c-85a5-19b433d53075 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:09.230046 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26163982-c508-4773-84d5-945b43036432 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.230632 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26163982-c508-4773-84d5-945b43036432 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.231116 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26163982-c508-4773-84d5-945b43036432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.248053 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d264227-b9d9-406c-85a5-19b433d53075 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:09.250079 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-26163982-c508-4773-84d5-945b43036432 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:09.251617 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-26163982-c508-4773-84d5-945b43036432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:09.252703 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1394f2-c29f-40cd-af8b-80462acb6ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:09.253500 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1394f2-c29f-40cd-af8b-80462acb6ddb admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.253788 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1394f2-c29f-40cd-af8b-80462acb6ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.254077 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1394f2-c29f-40cd-af8b-80462acb6ddb admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.254902 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1394f2-c29f-40cd-af8b-80462acb6ddb admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:09.255207 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1394f2-c29f-40cd-af8b-80462acb6ddb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:09.256808 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1394f2-c29f-40cd-af8b-80462acb6ddb admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:09.260826 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 353/711] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:09 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:09.262145 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec73800-c187-4152-9d4f-273e6849b063 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.262431 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 359/712] 10.222.0.25 () {56 vars in 1145 bytes} [Wed Oct 27 01:21:09 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:09.262914 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec73800-c187-4152-9d4f-273e6849b063 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.263021 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec73800-c187-4152-9d4f-273e6849b063 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.263691 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1394f2-c29f-40cd-af8b-80462acb6ddb admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:09.264859 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 354/713] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:09.272693 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1394f2-c29f-40cd-af8b-80462acb6ddb admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:09.274031 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec73800-c187-4152-9d4f-273e6849b063 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:09.277624 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f11750-2733-49dd-a7d5-9c3e06450b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:09.278445 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f11750-2733-49dd-a7d5-9c3e06450b55 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.278731 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f11750-2733-49dd-a7d5-9c3e06450b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.279007 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f11750-2733-49dd-a7d5-9c3e06450b55 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.279662 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f11750-2733-49dd-a7d5-9c3e06450b55 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:09.281272 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f11750-2733-49dd-a7d5-9c3e06450b55 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:09.288545 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec73800-c187-4152-9d4f-273e6849b063 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:09.292535 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-87f11750-2733-49dd-a7d5-9c3e06450b55 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 01:21:09.293465 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38133d82-4809-475d-9f61-0f8c6099e0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:09.293718 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 360/714] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:21:09 2021] GET /identity/v3/services/network => generated 88 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:09.294601 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38133d82-4809-475d-9f61-0f8c6099e0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.294869 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54a332-e59f-48ad-a251-f42bef7e5dc3 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.295155 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54a332-e59f-48ad-a251-f42bef7e5dc3 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.295430 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54a332-e59f-48ad-a251-f42bef7e5dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.295782 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38133d82-4809-475d-9f61-0f8c6099e0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.296270 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38133d82-4809-475d-9f61-0f8c6099e0f8 admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.297186 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38133d82-4809-475d-9f61-0f8c6099e0f8 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:09.297768 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38133d82-4809-475d-9f61-0f8c6099e0f8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:09.299864 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38133d82-4809-475d-9f61-0f8c6099e0f8 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:09.311741 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 355/715] 10.222.0.25 () {56 vars in 1145 bytes} [Wed Oct 27 01:21:09 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:09.311741 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38133d82-4809-475d-9f61-0f8c6099e0f8 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:09.317431 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38133d82-4809-475d-9f61-0f8c6099e0f8 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:09.318144 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-7f54a332-e59f-48ad-a251-f42bef7e5dc3 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:09.319426 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-7f54a332-e59f-48ad-a251-f42bef7e5dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:09.322374 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94940873-153f-427d-99a0-c48b27c7f6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:09.323153 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94940873-153f-427d-99a0-c48b27c7f6cd admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.323438 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94940873-153f-427d-99a0-c48b27c7f6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.323714 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94940873-153f-427d-99a0-c48b27c7f6cd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.328325 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 361/716] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:09 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:09.333507 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54a332-e59f-48ad-a251-f42bef7e5dc3 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:09.339327 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94940873-153f-427d-99a0-c48b27c7f6cd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:21:09.342362 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54a332-e59f-48ad-a251-f42bef7e5dc3 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:09.346828 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-94940873-153f-427d-99a0-c48b27c7f6cd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:21:09.347034 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faacf77-86c7-443b-b5f4-730d3811a432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:09.347828 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faacf77-86c7-443b-b5f4-730d3811a432 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.348174 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faacf77-86c7-443b-b5f4-730d3811a432 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.348457 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faacf77-86c7-443b-b5f4-730d3811a432 admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.349234 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faacf77-86c7-443b-b5f4-730d3811a432 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:09.349571 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faacf77-86c7-443b-b5f4-730d3811a432 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:09.351332 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faacf77-86c7-443b-b5f4-730d3811a432 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:09.353928 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 356/717] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:21:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:09.354949 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94940873-153f-427d-99a0-c48b27c7f6cd admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:09.356799 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 362/718] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Oct 27 01:21:09 2021] GET /identity/v3/services?name=network => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:09.357578 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faacf77-86c7-443b-b5f4-730d3811a432 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:09.364810 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94940873-153f-427d-99a0-c48b27c7f6cd admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:09.368668 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faacf77-86c7-443b-b5f4-730d3811a432 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:09.370105 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d707daf-dd5c-4000-9de1-5284f33e12d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:09.370744 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d707daf-dd5c-4000-9de1-5284f33e12d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.371037 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d707daf-dd5c-4000-9de1-5284f33e12d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.371310 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d707daf-dd5c-4000-9de1-5284f33e12d0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.372063 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d707daf-dd5c-4000-9de1-5284f33e12d0 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:09.373060 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING py.warnings [None req-1d707daf-dd5c-4000-9de1-5284f33e12d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:21:09.373060 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: warnings.warn(msg) Oct 27 01:21:09.373060 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: Oct 27 01:21:09.373568 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778445e6-8459-4f74-b24f-192afcb274f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:09.373967 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d707daf-dd5c-4000-9de1-5284f33e12d0 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:09.374132 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778445e6-8459-4f74-b24f-192afcb274f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.374297 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778445e6-8459-4f74-b24f-192afcb274f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.374538 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778445e6-8459-4f74-b24f-192afcb274f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.375284 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778445e6-8459-4f74-b24f-192afcb274f1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:09.375756 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778445e6-8459-4f74-b24f-192afcb274f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:09.377408 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778445e6-8459-4f74-b24f-192afcb274f1 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:09.387391 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 363/719] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:21:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:09.388120 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778445e6-8459-4f74-b24f-192afcb274f1 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:09.397621 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778445e6-8459-4f74-b24f-192afcb274f1 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:09.397985 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 357/720] 10.222.0.25 () {60 vars in 1165 bytes} [Wed Oct 27 01:21:09 2021] POST /identity/v3/endpoints => generated 346 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:21:09.399301 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d707daf-dd5c-4000-9de1-5284f33e12d0 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:09.414722 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d707daf-dd5c-4000-9de1-5284f33e12d0 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:09.414921 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95e887-420f-432f-9656-d8e4d28aca8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:09.415738 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95e887-420f-432f-9656-d8e4d28aca8f admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.416090 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95e887-420f-432f-9656-d8e4d28aca8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.416363 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95e887-420f-432f-9656-d8e4d28aca8f admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.417050 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95e887-420f-432f-9656-d8e4d28aca8f admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:09.418930 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95e887-420f-432f-9656-d8e4d28aca8f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:09.421384 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fffe85-9f94-44ad-8e6e-6562bfd29e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:09.422780 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fffe85-9f94-44ad-8e6e-6562bfd29e0b admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.423573 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fffe85-9f94-44ad-8e6e-6562bfd29e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.424076 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fffe85-9f94-44ad-8e6e-6562bfd29e0b admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.425069 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fffe85-9f94-44ad-8e6e-6562bfd29e0b admin admin] RBAC: Adding query filter params (type=network) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:09.425661 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fffe85-9f94-44ad-8e6e-6562bfd29e0b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:09.427775 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fffe85-9f94-44ad-8e6e-6562bfd29e0b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:09.432958 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-cc95e887-420f-432f-9656-d8e4d28aca8f admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 01:21:09.439902 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 364/721] 10.222.0.25 () {56 vars in 1153 bytes} [Wed Oct 27 01:21:09 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:09.439902 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95e887-420f-432f-9656-d8e4d28aca8f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:09.440213 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 358/722] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Oct 27 01:21:09 2021] GET /identity/v3/services?type=network => generated 350 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:09.443778 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fffe85-9f94-44ad-8e6e-6562bfd29e0b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:09.455991 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95e887-420f-432f-9656-d8e4d28aca8f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:09.456886 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fffe85-9f94-44ad-8e6e-6562bfd29e0b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:09.462330 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a90af-3863-4d08-9d75-297eeafeadd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:09.468874 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb2c02-6545-4b20-833c-839ae2ed0df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:09.468874 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb2c02-6545-4b20-833c-839ae2ed0df1 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.468874 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb2c02-6545-4b20-833c-839ae2ed0df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.468874 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb2c02-6545-4b20-833c-839ae2ed0df1 admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.470018 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb2c02-6545-4b20-833c-839ae2ed0df1 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:09.470018 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb2c02-6545-4b20-833c-839ae2ed0df1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:09.470018 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb2c02-6545-4b20-833c-839ae2ed0df1 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:09.470592 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a90af-3863-4d08-9d75-297eeafeadd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.476124 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a90af-3863-4d08-9d75-297eeafeadd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.476124 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a90af-3863-4d08-9d75-297eeafeadd7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.484541 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 359/723] 10.222.0.25 () {56 vars in 1147 bytes} [Wed Oct 27 01:21:09 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:09.484541 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb2c02-6545-4b20-833c-839ae2ed0df1 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:09.497814 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb2c02-6545-4b20-833c-839ae2ed0df1 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:09.501941 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a90af-3863-4d08-9d75-297eeafeadd7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:09.502997 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be4303-4cb6-417f-add6-111abfac39d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:09.503798 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be4303-4cb6-417f-add6-111abfac39d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.504087 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be4303-4cb6-417f-add6-111abfac39d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.504407 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be4303-4cb6-417f-add6-111abfac39d1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.505161 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a90af-3863-4d08-9d75-297eeafeadd7 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:09.505291 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be4303-4cb6-417f-add6-111abfac39d1 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:09.506895 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be4303-4cb6-417f-add6-111abfac39d1 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:09.527594 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-808a90af-3863-4d08-9d75-297eeafeadd7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:09.529352 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 365/724] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:09.534465 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 360/725] 10.222.0.25 () {60 vars in 1165 bytes} [Wed Oct 27 01:21:09 2021] POST /identity/v3/endpoints => generated 327 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:21:09.534638 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a90af-3863-4d08-9d75-297eeafeadd7 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:09.536201 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be4303-4cb6-417f-add6-111abfac39d1 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:09.557181 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a90af-3863-4d08-9d75-297eeafeadd7 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:09.584651 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be4303-4cb6-417f-add6-111abfac39d1 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:09.592747 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b72f9-c525-4e4c-a28c-e615e8a8be15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:09.593921 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b72f9-c525-4e4c-a28c-e615e8a8be15 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.595320 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10265d69-fea4-4b9e-8869-7b5005c40656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:09.595836 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b72f9-c525-4e4c-a28c-e615e8a8be15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.596123 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b72f9-c525-4e4c-a28c-e615e8a8be15 admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.597165 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10265d69-fea4-4b9e-8869-7b5005c40656 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.597825 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10265d69-fea4-4b9e-8869-7b5005c40656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.598102 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10265d69-fea4-4b9e-8869-7b5005c40656 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.598266 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b72f9-c525-4e4c-a28c-e615e8a8be15 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:09.598589 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b72f9-c525-4e4c-a28c-e615e8a8be15 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:09.600221 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10265d69-fea4-4b9e-8869-7b5005c40656 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:09.600534 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10265d69-fea4-4b9e-8869-7b5005c40656 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:09.603866 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10265d69-fea4-4b9e-8869-7b5005c40656 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:09.604174 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b72f9-c525-4e4c-a28c-e615e8a8be15 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:09.612595 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 366/726] 10.222.0.25 () {56 vars in 1147 bytes} [Wed Oct 27 01:21:09 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:09.625059 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 361/727] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:09.634747 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b72f9-c525-4e4c-a28c-e615e8a8be15 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:09.645436 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b72f9-c525-4e4c-a28c-e615e8a8be15 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:09.655517 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc7759-854a-49e3-837e-cc746f9d3f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:09.656405 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc7759-854a-49e3-837e-cc746f9d3f87 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.656692 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc7759-854a-49e3-837e-cc746f9d3f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.656970 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc7759-854a-49e3-837e-cc746f9d3f87 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.671664 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc7759-854a-49e3-837e-cc746f9d3f87 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:09.673830 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc7759-854a-49e3-837e-cc746f9d3f87 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:09.691031 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-f0dc7759-854a-49e3-837e-cc746f9d3f87 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 01:21:09.692671 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 367/728] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:21:09 2021] GET /identity/v3/users/swift => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:09.699654 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10265d69-fea4-4b9e-8869-7b5005c40656 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:09.710904 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10265d69-fea4-4b9e-8869-7b5005c40656 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:09.716060 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ad56d-31ed-455b-a8da-95a4f4426651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:09.716758 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ad56d-31ed-455b-a8da-95a4f4426651 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.717099 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ad56d-31ed-455b-a8da-95a4f4426651 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.717386 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ad56d-31ed-455b-a8da-95a4f4426651 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.718372 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ad56d-31ed-455b-a8da-95a4f4426651 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:09.718690 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ad56d-31ed-455b-a8da-95a4f4426651 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:09.720721 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ad56d-31ed-455b-a8da-95a4f4426651 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:09.743580 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 362/729] 10.222.0.25 () {56 vars in 1156 bytes} [Wed Oct 27 01:21:09 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:09.749972 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc7759-854a-49e3-837e-cc746f9d3f87 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:09.760524 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc7759-854a-49e3-837e-cc746f9d3f87 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:09.765594 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d090cf8-1f8f-4bfc-9208-f4be1b9b1a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:09.766465 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d090cf8-1f8f-4bfc-9208-f4be1b9b1a96 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.766753 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d090cf8-1f8f-4bfc-9208-f4be1b9b1a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.767087 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d090cf8-1f8f-4bfc-9208-f4be1b9b1a96 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.781154 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d090cf8-1f8f-4bfc-9208-f4be1b9b1a96 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:09.783162 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d090cf8-1f8f-4bfc-9208-f4be1b9b1a96 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:09.801770 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-9d090cf8-1f8f-4bfc-9208-f4be1b9b1a96 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:09.803430 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 368/730] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:09.810811 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ad56d-31ed-455b-a8da-95a4f4426651 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:09.822668 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ad56d-31ed-455b-a8da-95a4f4426651 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:09.829845 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb4276-e6fb-444b-8fe9-6e351ac0cd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:09.830933 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb4276-e6fb-444b-8fe9-6e351ac0cd56 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.831307 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb4276-e6fb-444b-8fe9-6e351ac0cd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.831655 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb4276-e6fb-444b-8fe9-6e351ac0cd56 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.832475 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb4276-e6fb-444b-8fe9-6e351ac0cd56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:09.832858 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb4276-e6fb-444b-8fe9-6e351ac0cd56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:09.834632 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb4276-e6fb-444b-8fe9-6e351ac0cd56 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:09.850381 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 363/731] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:09.856813 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d090cf8-1f8f-4bfc-9208-f4be1b9b1a96 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:09.868594 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d090cf8-1f8f-4bfc-9208-f4be1b9b1a96 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:09.873377 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3321c4a-a9de-4035-81c7-63f9b8f3634e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:09.874193 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3321c4a-a9de-4035-81c7-63f9b8f3634e admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.874481 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3321c4a-a9de-4035-81c7-63f9b8f3634e admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.874765 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3321c4a-a9de-4035-81c7-63f9b8f3634e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.885638 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3321c4a-a9de-4035-81c7-63f9b8f3634e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:09.887656 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3321c4a-a9de-4035-81c7-63f9b8f3634e admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:09.902817 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-b3321c4a-a9de-4035-81c7-63f9b8f3634e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:21:09.904299 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 369/732] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:21:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:09.910349 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb4276-e6fb-444b-8fe9-6e351ac0cd56 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:09.924822 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb4276-e6fb-444b-8fe9-6e351ac0cd56 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:09.934742 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4deb290-22e7-4d06-ace4-0d0897678c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:09.935439 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4deb290-22e7-4d06-ace4-0d0897678c78 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.935729 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4deb290-22e7-4d06-ace4-0d0897678c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.936033 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4deb290-22e7-4d06-ace4-0d0897678c78 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.936867 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4deb290-22e7-4d06-ace4-0d0897678c78 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:09.937186 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4deb290-22e7-4d06-ace4-0d0897678c78 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:09.939061 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4deb290-22e7-4d06-ace4-0d0897678c78 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:09.955313 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 364/733] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:21:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:09.961470 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3321c4a-a9de-4035-81c7-63f9b8f3634e admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:09.980375 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3321c4a-a9de-4035-81c7-63f9b8f3634e admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:09.986724 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b01d58-478a-4f41-b456-7d8b79ed206c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:09.987900 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b01d58-478a-4f41-b456-7d8b79ed206c admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:09.988403 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b01d58-478a-4f41-b456-7d8b79ed206c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:09.988926 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b01d58-478a-4f41-b456-7d8b79ed206c admin admin] PATH_INFO: `/v3/projects/2b95c6a455e74d9487ae73f44a9ba0e6/users/f386f358fdb241f5a529a2cf3d839201/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:09.991215 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b01d58-478a-4f41-b456-7d8b79ed206c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b95c6a455e74d9487ae73f44a9ba0e6, user_id=f386f358fdb241f5a529a2cf3d839201, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:09.994735 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b01d58-478a-4f41-b456-7d8b79ed206c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:10.009069 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 370/734] 10.222.0.25 () {58 vars in 1460 bytes} [Wed Oct 27 01:21:09 2021] PUT /identity/v3/projects/2b95c6a455e74d9487ae73f44a9ba0e6/users/f386f358fdb241f5a529a2cf3d839201/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:10.548627 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb565831-3ca2-4f04-bba3-062fb7e59b6e None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:10.549142 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb565831-3ca2-4f04-bba3-062fb7e59b6e None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:10.549217 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb565831-3ca2-4f04-bba3-062fb7e59b6e None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:10.551497 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 365/735] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:10.557588 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6299cbc-4e87-4125-8489-f25ca67ed5a1 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:10.558138 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6299cbc-4e87-4125-8489-f25ca67ed5a1 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:10.558418 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6299cbc-4e87-4125-8489-f25ca67ed5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:10.576975 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-b6299cbc-4e87-4125-8489-f25ca67ed5a1 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:10.578182 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-b6299cbc-4e87-4125-8489-f25ca67ed5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:10.641593 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 371/736] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:10 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:21:10.659257 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb565831-3ca2-4f04-bba3-062fb7e59b6e None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:10.671537 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb565831-3ca2-4f04-bba3-062fb7e59b6e None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:10.675858 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367ec0d-074c-4ac5-a98d-1f608aeabe16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:10.676694 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367ec0d-074c-4ac5-a98d-1f608aeabe16 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:10.676983 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367ec0d-074c-4ac5-a98d-1f608aeabe16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:10.677261 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367ec0d-074c-4ac5-a98d-1f608aeabe16 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:10.688168 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367ec0d-074c-4ac5-a98d-1f608aeabe16 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:21:10.695228 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-1367ec0d-074c-4ac5-a98d-1f608aeabe16 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:21:10.701590 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 366/737] 10.222.0.25 () {56 vars in 1123 bytes} [Wed Oct 27 01:21:10 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:10.703744 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6299cbc-4e87-4125-8489-f25ca67ed5a1 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:10.713612 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6299cbc-4e87-4125-8489-f25ca67ed5a1 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:10.718218 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3582f5e-e3dc-408d-825c-8b69423f8f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:10.718882 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3582f5e-e3dc-408d-825c-8b69423f8f04 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:10.719165 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3582f5e-e3dc-408d-825c-8b69423f8f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:10.719506 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3582f5e-e3dc-408d-825c-8b69423f8f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:10.720266 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3582f5e-e3dc-408d-825c-8b69423f8f04 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:10.720572 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3582f5e-e3dc-408d-825c-8b69423f8f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:10.722189 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3582f5e-e3dc-408d-825c-8b69423f8f04 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:10.735923 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 372/738] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Oct 27 01:21:10 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:10.737356 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367ec0d-074c-4ac5-a98d-1f608aeabe16 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:10.747611 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367ec0d-074c-4ac5-a98d-1f608aeabe16 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:10.752598 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86689b-ae9f-4b22-bf8a-c42bf3369336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:10.753393 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86689b-ae9f-4b22-bf8a-c42bf3369336 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:10.753719 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86689b-ae9f-4b22-bf8a-c42bf3369336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:10.753999 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86689b-ae9f-4b22-bf8a-c42bf3369336 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:10.765956 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86689b-ae9f-4b22-bf8a-c42bf3369336 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:10.767844 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86689b-ae9f-4b22-bf8a-c42bf3369336 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:10.788909 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-5d86689b-ae9f-4b22-bf8a-c42bf3369336 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:10.790475 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 367/739] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:10.798904 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3582f5e-e3dc-408d-825c-8b69423f8f04 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:10.809706 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3582f5e-e3dc-408d-825c-8b69423f8f04 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:10.814331 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a4882-2eb9-462e-841b-b2e94b9e1a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:10.814994 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a4882-2eb9-462e-841b-b2e94b9e1a1e admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:10.815278 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a4882-2eb9-462e-841b-b2e94b9e1a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:10.815557 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a4882-2eb9-462e-841b-b2e94b9e1a1e admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:10.816285 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a4882-2eb9-462e-841b-b2e94b9e1a1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:10.816590 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a4882-2eb9-462e-841b-b2e94b9e1a1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:10.818202 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a4882-2eb9-462e-841b-b2e94b9e1a1e admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:10.836279 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 373/740] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:10.837899 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86689b-ae9f-4b22-bf8a-c42bf3369336 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:10.848238 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86689b-ae9f-4b22-bf8a-c42bf3369336 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:10.853051 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8d7d4-21b5-45cf-bbdb-44689e54add4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:10.853923 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8d7d4-21b5-45cf-bbdb-44689e54add4 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:10.854206 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8d7d4-21b5-45cf-bbdb-44689e54add4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:10.854480 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8d7d4-21b5-45cf-bbdb-44689e54add4 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:10.863364 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8d7d4-21b5-45cf-bbdb-44689e54add4 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:10.865675 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8d7d4-21b5-45cf-bbdb-44689e54add4 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:10.880933 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-f6a8d7d4-21b5-45cf-bbdb-44689e54add4 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 01:21:10.882547 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 368/741] 10.222.0.25 () {56 vars in 1138 bytes} [Wed Oct 27 01:21:10 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:21:10.889247 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a4882-2eb9-462e-841b-b2e94b9e1a1e admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:10.899598 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a4882-2eb9-462e-841b-b2e94b9e1a1e admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:10.904517 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e4ddf-872f-4086-a114-05474a3ade96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:10.905259 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e4ddf-872f-4086-a114-05474a3ade96 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:10.905590 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e4ddf-872f-4086-a114-05474a3ade96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:10.905919 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e4ddf-872f-4086-a114-05474a3ade96 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:10.906788 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e4ddf-872f-4086-a114-05474a3ade96 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:10.907152 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e4ddf-872f-4086-a114-05474a3ade96 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:10.909079 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e4ddf-872f-4086-a114-05474a3ade96 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:10.933681 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 374/742] 10.222.0.25 () {56 vars in 1170 bytes} [Wed Oct 27 01:21:10 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:10.935653 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8d7d4-21b5-45cf-bbdb-44689e54add4 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:10.948342 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8d7d4-21b5-45cf-bbdb-44689e54add4 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:10.957892 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db962a-81f7-4179-8816-e372c1a643bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:10.958663 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db962a-81f7-4179-8816-e372c1a643bc admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:10.958953 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db962a-81f7-4179-8816-e372c1a643bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:10.959234 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db962a-81f7-4179-8816-e372c1a643bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:10.968568 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db962a-81f7-4179-8816-e372c1a643bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:10.970450 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db962a-81f7-4179-8816-e372c1a643bc admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:10.980149 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 369/743] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:21:10 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:10.986399 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e4ddf-872f-4086-a114-05474a3ade96 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:10.996964 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e4ddf-872f-4086-a114-05474a3ade96 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:11.001957 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda9353-4d05-4b7e-bd3b-5fb5adb7b654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:11.003014 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda9353-4d05-4b7e-bd3b-5fb5adb7b654 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:11.003522 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda9353-4d05-4b7e-bd3b-5fb5adb7b654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:11.004045 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda9353-4d05-4b7e-bd3b-5fb5adb7b654 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:11.015508 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda9353-4d05-4b7e-bd3b-5fb5adb7b654 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:11.018106 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda9353-4d05-4b7e-bd3b-5fb5adb7b654 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:11.035325 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-8eda9353-4d05-4b7e-bd3b-5fb5adb7b654 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:11.041550 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 375/744] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:11.044309 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db962a-81f7-4179-8816-e372c1a643bc admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:11.053802 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db962a-81f7-4179-8816-e372c1a643bc admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:11.059521 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e659d32-d57c-4bb5-88c0-1ccd0fb19c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:11.060412 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e659d32-d57c-4bb5-88c0-1ccd0fb19c78 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:11.060910 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e659d32-d57c-4bb5-88c0-1ccd0fb19c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:11.061448 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e659d32-d57c-4bb5-88c0-1ccd0fb19c78 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:11.062425 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e659d32-d57c-4bb5-88c0-1ccd0fb19c78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:11.062947 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e659d32-d57c-4bb5-88c0-1ccd0fb19c78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:11.064790 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e659d32-d57c-4bb5-88c0-1ccd0fb19c78 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:11.081602 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 370/745] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:11.084742 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda9353-4d05-4b7e-bd3b-5fb5adb7b654 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:11.095094 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda9353-4d05-4b7e-bd3b-5fb5adb7b654 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:11.100119 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad021e3-ac58-4052-b61c-439ddac61544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:11.101185 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad021e3-ac58-4052-b61c-439ddac61544 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:11.102306 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad021e3-ac58-4052-b61c-439ddac61544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:11.102782 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad021e3-ac58-4052-b61c-439ddac61544 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:11.110450 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad021e3-ac58-4052-b61c-439ddac61544 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:11.112698 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad021e3-ac58-4052-b61c-439ddac61544 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:11.126583 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-5ad021e3-ac58-4052-b61c-439ddac61544 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:21:11.133589 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 376/746] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:21:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:11.135638 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e659d32-d57c-4bb5-88c0-1ccd0fb19c78 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:11.145786 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e659d32-d57c-4bb5-88c0-1ccd0fb19c78 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:11.151570 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35d78e-dcc1-450a-ab37-0437d5bd46e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:11.152451 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35d78e-dcc1-450a-ab37-0437d5bd46e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:11.152982 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35d78e-dcc1-450a-ab37-0437d5bd46e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:11.153472 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35d78e-dcc1-450a-ab37-0437d5bd46e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:11.154547 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35d78e-dcc1-450a-ab37-0437d5bd46e1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:11.155053 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35d78e-dcc1-450a-ab37-0437d5bd46e1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:11.157162 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35d78e-dcc1-450a-ab37-0437d5bd46e1 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:11.173601 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 371/747] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:21:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:11.176544 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad021e3-ac58-4052-b61c-439ddac61544 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:11.187734 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad021e3-ac58-4052-b61c-439ddac61544 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:11.192792 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172cfba-7f1a-4073-91d8-50c677445189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:11.193876 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172cfba-7f1a-4073-91d8-50c677445189 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:11.194471 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172cfba-7f1a-4073-91d8-50c677445189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:11.194949 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172cfba-7f1a-4073-91d8-50c677445189 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:11.196606 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172cfba-7f1a-4073-91d8-50c677445189 admin admin] RBAC: Adding query filter params (role.id=983c0291e0fa484ea053a791ead0e9c5, scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6, user.id=56895529b11b4236bccb5956a8ccb5b2) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:11.197135 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172cfba-7f1a-4073-91d8-50c677445189 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:11.199357 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172cfba-7f1a-4073-91d8-50c677445189 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:11.210144 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 377/748] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:21:11 2021] GET /identity/v3/role_assignments?user.id=56895529b11b4236bccb5956a8ccb5b2&scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6&role.id=983c0291e0fa484ea053a791ead0e9c5 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:12.020666 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240a9f2-1eff-4a0e-9140-774e8e4b6a29 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:12.021208 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240a9f2-1eff-4a0e-9140-774e8e4b6a29 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:12.021208 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240a9f2-1eff-4a0e-9140-774e8e4b6a29 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:12.023288 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 372/749] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:12.029930 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf22e46-22f7-484b-afd9-09c400909e74 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:12.030353 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf22e46-22f7-484b-afd9-09c400909e74 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:12.030529 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf22e46-22f7-484b-afd9-09c400909e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:12.048181 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-1cf22e46-22f7-484b-afd9-09c400909e74 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:12.049475 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-1cf22e46-22f7-484b-afd9-09c400909e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:12.054450 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e893101-650d-4103-881e-45b9c7148a7d None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:12.054775 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e893101-650d-4103-881e-45b9c7148a7d None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:12.055063 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e893101-650d-4103-881e-45b9c7148a7d None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:12.057184 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 373/750] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:21:12.057322 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 378/751] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:12 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:12.063031 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe581f26-61a5-450e-9fbb-0b1f3f106767 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:12.063321 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe581f26-61a5-450e-9fbb-0b1f3f106767 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:12.063604 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe581f26-61a5-450e-9fbb-0b1f3f106767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:12.081639 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf22e46-22f7-484b-afd9-09c400909e74 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:12.082456 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-fe581f26-61a5-450e-9fbb-0b1f3f106767 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:12.083680 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-fe581f26-61a5-450e-9fbb-0b1f3f106767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:12.091899 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf22e46-22f7-484b-afd9-09c400909e74 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:12.092383 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 374/752] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:12 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:12.097094 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f514f-5e37-4714-89d3-0d1151a69837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:12.097919 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f514f-5e37-4714-89d3-0d1151a69837 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:12.098204 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f514f-5e37-4714-89d3-0d1151a69837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:12.098480 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f514f-5e37-4714-89d3-0d1151a69837 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:12.099143 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f514f-5e37-4714-89d3-0d1151a69837 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:12.100718 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f514f-5e37-4714-89d3-0d1151a69837 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:12.112116 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-121f514f-5e37-4714-89d3-0d1151a69837 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 01:21:12.113583 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 379/753] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Oct 27 01:21:12 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:21:12.115844 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe581f26-61a5-450e-9fbb-0b1f3f106767 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:12.119946 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f514f-5e37-4714-89d3-0d1151a69837 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:12.125719 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe581f26-61a5-450e-9fbb-0b1f3f106767 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:12.129778 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f514f-5e37-4714-89d3-0d1151a69837 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:12.130487 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18256b7-6a6e-4dda-abf5-a08ed695da64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:12.131252 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18256b7-6a6e-4dda-abf5-a08ed695da64 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:12.131640 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18256b7-6a6e-4dda-abf5-a08ed695da64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:12.132033 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18256b7-6a6e-4dda-abf5-a08ed695da64 admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:12.133391 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18256b7-6a6e-4dda-abf5-a08ed695da64 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:12.134890 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226f749-2169-4e5c-9b43-1f73ed4b3270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:12.135252 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18256b7-6a6e-4dda-abf5-a08ed695da64 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:12.135533 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226f749-2169-4e5c-9b43-1f73ed4b3270 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:12.135819 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226f749-2169-4e5c-9b43-1f73ed4b3270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:12.136103 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226f749-2169-4e5c-9b43-1f73ed4b3270 admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:12.136819 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226f749-2169-4e5c-9b43-1f73ed4b3270 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:12.137129 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226f749-2169-4e5c-9b43-1f73ed4b3270 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:12.138766 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226f749-2169-4e5c-9b43-1f73ed4b3270 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:12.144858 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 380/754] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Oct 27 01:21:12 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:12.152121 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226f749-2169-4e5c-9b43-1f73ed4b3270 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:12.154347 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 375/755] 10.222.0.25 () {60 vars in 1162 bytes} [Wed Oct 27 01:21:12 2021] POST /identity/v3/services => generated 269 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:21:12.164622 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226f749-2169-4e5c-9b43-1f73ed4b3270 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:12.183208 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f502ce-15da-4aa8-ab0b-6ea83fde85c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:12.183888 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f502ce-15da-4aa8-ab0b-6ea83fde85c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:12.184173 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f502ce-15da-4aa8-ab0b-6ea83fde85c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:12.184450 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f502ce-15da-4aa8-ab0b-6ea83fde85c4 admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:12.185195 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f502ce-15da-4aa8-ab0b-6ea83fde85c4 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:12.188846 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f502ce-15da-4aa8-ab0b-6ea83fde85c4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:12.188846 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f502ce-15da-4aa8-ab0b-6ea83fde85c4 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:12.193712 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 381/756] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Oct 27 01:21:12 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:12.302606 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab4193-cef0-4471-a611-e768e6a3d09c None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:12.302808 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab4193-cef0-4471-a611-e768e6a3d09c None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:12.303082 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab4193-cef0-4471-a611-e768e6a3d09c None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:12.305853 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 376/757] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:12.312756 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea7808-a3b0-427e-912b-8956d488c54a None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:12.313053 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea7808-a3b0-427e-912b-8956d488c54a None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:12.313338 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea7808-a3b0-427e-912b-8956d488c54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:12.333433 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-64ea7808-a3b0-427e-912b-8956d488c54a None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:12.334723 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-64ea7808-a3b0-427e-912b-8956d488c54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:12.343314 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 382/758] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:12 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:12.369121 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab4193-cef0-4471-a611-e768e6a3d09c None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:12.382099 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab4193-cef0-4471-a611-e768e6a3d09c None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:12.392525 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507ab5d-fc17-4a67-aee0-5448aedc41e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:12.392525 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507ab5d-fc17-4a67-aee0-5448aedc41e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:12.392957 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507ab5d-fc17-4a67-aee0-5448aedc41e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:12.393227 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507ab5d-fc17-4a67-aee0-5448aedc41e0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:12.409207 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507ab5d-fc17-4a67-aee0-5448aedc41e0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:21:12.416773 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-a507ab5d-fc17-4a67-aee0-5448aedc41e0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:21:12.418465 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 377/759] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:21:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:21:12.425620 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea7808-a3b0-427e-912b-8956d488c54a None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:12.435957 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea7808-a3b0-427e-912b-8956d488c54a None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:12.440728 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae1785-a8da-40a7-8aad-43f193b3be4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:12.441397 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae1785-a8da-40a7-8aad-43f193b3be4b admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:12.441751 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae1785-a8da-40a7-8aad-43f193b3be4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:12.442029 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae1785-a8da-40a7-8aad-43f193b3be4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:12.442795 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae1785-a8da-40a7-8aad-43f193b3be4b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:12.443094 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae1785-a8da-40a7-8aad-43f193b3be4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:12.444709 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae1785-a8da-40a7-8aad-43f193b3be4b admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:12.455113 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 383/760] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:21:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:12.461039 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507ab5d-fc17-4a67-aee0-5448aedc41e0 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:12.471699 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507ab5d-fc17-4a67-aee0-5448aedc41e0 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:12.478474 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83251f35-2ba1-4c6a-9dc4-081a1d426926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:12.479567 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83251f35-2ba1-4c6a-9dc4-081a1d426926 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:12.480107 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83251f35-2ba1-4c6a-9dc4-081a1d426926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:12.480624 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83251f35-2ba1-4c6a-9dc4-081a1d426926 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:12.493468 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83251f35-2ba1-4c6a-9dc4-081a1d426926 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:12.495813 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83251f35-2ba1-4c6a-9dc4-081a1d426926 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:12.516082 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-83251f35-2ba1-4c6a-9dc4-081a1d426926 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:12.517919 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 378/761] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:12.524557 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae1785-a8da-40a7-8aad-43f193b3be4b admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:12.534886 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae1785-a8da-40a7-8aad-43f193b3be4b admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:12.540344 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762bfe1-6cb0-434c-95ff-a6d3d82d75d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:12.541299 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762bfe1-6cb0-434c-95ff-a6d3d82d75d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:12.541806 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762bfe1-6cb0-434c-95ff-a6d3d82d75d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:12.542361 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762bfe1-6cb0-434c-95ff-a6d3d82d75d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:12.543296 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762bfe1-6cb0-434c-95ff-a6d3d82d75d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:12.543839 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762bfe1-6cb0-434c-95ff-a6d3d82d75d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:12.545743 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762bfe1-6cb0-434c-95ff-a6d3d82d75d6 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:12.560037 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 384/762] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:12.566580 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83251f35-2ba1-4c6a-9dc4-081a1d426926 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:12.577262 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83251f35-2ba1-4c6a-9dc4-081a1d426926 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:12.582193 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6791240-0bb7-45a7-8473-c9f4122ab5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:12.583301 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6791240-0bb7-45a7-8473-c9f4122ab5fd admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:12.583790 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6791240-0bb7-45a7-8473-c9f4122ab5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:12.584329 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6791240-0bb7-45a7-8473-c9f4122ab5fd admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:12.592501 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6791240-0bb7-45a7-8473-c9f4122ab5fd admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:12.594825 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6791240-0bb7-45a7-8473-c9f4122ab5fd admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:12.609909 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-d6791240-0bb7-45a7-8473-c9f4122ab5fd admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 01:21:12.611684 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 379/763] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:21:12 2021] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:12.618231 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762bfe1-6cb0-434c-95ff-a6d3d82d75d6 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:12.628368 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762bfe1-6cb0-434c-95ff-a6d3d82d75d6 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:12.633054 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8980e5-ee7d-4291-bf1a-3e50533c4b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:12.633785 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8980e5-ee7d-4291-bf1a-3e50533c4b41 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:12.634073 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8980e5-ee7d-4291-bf1a-3e50533c4b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:12.634355 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8980e5-ee7d-4291-bf1a-3e50533c4b41 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:12.635284 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8980e5-ee7d-4291-bf1a-3e50533c4b41 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:12.635597 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8980e5-ee7d-4291-bf1a-3e50533c4b41 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:12.637514 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8980e5-ee7d-4291-bf1a-3e50533c4b41 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:12.661753 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 385/764] 10.222.0.25 () {56 vars in 1156 bytes} [Wed Oct 27 01:21:12 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:12.665210 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6791240-0bb7-45a7-8473-c9f4122ab5fd admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:12.676533 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6791240-0bb7-45a7-8473-c9f4122ab5fd admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:12.681939 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c007b9-c8f4-4035-a02c-43e95c4fd49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:12.682648 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c007b9-c8f4-4035-a02c-43e95c4fd49c admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:12.683211 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c007b9-c8f4-4035-a02c-43e95c4fd49c admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:12.683511 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c007b9-c8f4-4035-a02c-43e95c4fd49c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:12.691804 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c007b9-c8f4-4035-a02c-43e95c4fd49c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:12.693713 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c007b9-c8f4-4035-a02c-43e95c4fd49c admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:12.703115 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 380/765] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:21:12 2021] GET /identity/v3/auth/tokens => generated 1715 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:12.710174 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8980e5-ee7d-4291-bf1a-3e50533c4b41 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:12.720494 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8980e5-ee7d-4291-bf1a-3e50533c4b41 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:12.725364 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a158570-5eda-4b34-abd5-85c9f1780181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:12.726261 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a158570-5eda-4b34-abd5-85c9f1780181 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:12.727090 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a158570-5eda-4b34-abd5-85c9f1780181 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:12.727447 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a158570-5eda-4b34-abd5-85c9f1780181 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:12.738553 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a158570-5eda-4b34-abd5-85c9f1780181 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:12.740463 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a158570-5eda-4b34-abd5-85c9f1780181 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:12.758724 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-1a158570-5eda-4b34-abd5-85c9f1780181 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:12.759945 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 386/766] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:12.766266 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c007b9-c8f4-4035-a02c-43e95c4fd49c admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:12.775303 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c007b9-c8f4-4035-a02c-43e95c4fd49c admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:12.779937 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380baaa-df62-4d2e-a4ce-b7a37265c18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:12.780582 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380baaa-df62-4d2e-a4ce-b7a37265c18d admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:12.780866 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380baaa-df62-4d2e-a4ce-b7a37265c18d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:12.781145 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380baaa-df62-4d2e-a4ce-b7a37265c18d admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:12.781955 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380baaa-df62-4d2e-a4ce-b7a37265c18d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:12.782267 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380baaa-df62-4d2e-a4ce-b7a37265c18d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:12.783884 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380baaa-df62-4d2e-a4ce-b7a37265c18d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:12.795963 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 381/767] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:12.802636 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a158570-5eda-4b34-abd5-85c9f1780181 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:12.813548 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a158570-5eda-4b34-abd5-85c9f1780181 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:12.818205 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055583d-0d32-46d0-9266-63f535846106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:12.819092 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055583d-0d32-46d0-9266-63f535846106 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:12.819380 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055583d-0d32-46d0-9266-63f535846106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:12.819660 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055583d-0d32-46d0-9266-63f535846106 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:12.826854 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055583d-0d32-46d0-9266-63f535846106 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:12.828845 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055583d-0d32-46d0-9266-63f535846106 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:12.842311 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-d055583d-0d32-46d0-9266-63f535846106 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:21:12.843696 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 387/768] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:21:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:21:12.849971 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380baaa-df62-4d2e-a4ce-b7a37265c18d admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:12.860467 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380baaa-df62-4d2e-a4ce-b7a37265c18d admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:12.865200 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa520e-e190-4ffb-b3af-40146c9d0681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:12.865935 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa520e-e190-4ffb-b3af-40146c9d0681 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:12.866222 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa520e-e190-4ffb-b3af-40146c9d0681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:12.866504 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa520e-e190-4ffb-b3af-40146c9d0681 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:12.867922 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa520e-e190-4ffb-b3af-40146c9d0681 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:12.868238 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa520e-e190-4ffb-b3af-40146c9d0681 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:12.870202 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa520e-e190-4ffb-b3af-40146c9d0681 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:12.882833 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 382/769] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:21:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:12.889576 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055583d-0d32-46d0-9266-63f535846106 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:12.900940 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055583d-0d32-46d0-9266-63f535846106 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:12.905798 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76f689-6ab0-47bf-a91b-0d63dcddaace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:12.906491 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76f689-6ab0-47bf-a91b-0d63dcddaace admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:12.906779 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76f689-6ab0-47bf-a91b-0d63dcddaace admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:12.907058 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76f689-6ab0-47bf-a91b-0d63dcddaace admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:12.907952 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76f689-6ab0-47bf-a91b-0d63dcddaace admin admin] RBAC: Adding query filter params (role.id=df3a437e6ea14518a9c1b9a348e18c99, scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6, user.id=f386f358fdb241f5a529a2cf3d839201) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:12.908265 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76f689-6ab0-47bf-a91b-0d63dcddaace admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:12.910284 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76f689-6ab0-47bf-a91b-0d63dcddaace admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:12.917098 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 388/770] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:21:12 2021] GET /identity/v3/role_assignments?user.id=f386f358fdb241f5a529a2cf3d839201&scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6&role.id=df3a437e6ea14518a9c1b9a348e18c99 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:13.590387 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc2636-f82b-4c10-825c-b06ea5b8a5ef None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:13.591087 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc2636-f82b-4c10-825c-b06ea5b8a5ef None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:13.591087 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc2636-f82b-4c10-825c-b06ea5b8a5ef None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:13.592933 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 383/771] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:13.598964 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d842c-781f-44cf-a290-2aa794395965 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:13.599460 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d842c-781f-44cf-a290-2aa794395965 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:13.599619 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d842c-781f-44cf-a290-2aa794395965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:13.616996 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-7b5d842c-781f-44cf-a290-2aa794395965 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:13.618262 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-7b5d842c-781f-44cf-a290-2aa794395965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:13.626263 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 389/772] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:13 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:13.651433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc2636-f82b-4c10-825c-b06ea5b8a5ef None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:13.663852 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc2636-f82b-4c10-825c-b06ea5b8a5ef None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:13.668517 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296549c6-87d8-4a59-ad53-a10a3f182332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:13.669312 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296549c6-87d8-4a59-ad53-a10a3f182332 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:13.669623 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296549c6-87d8-4a59-ad53-a10a3f182332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:13.669898 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296549c6-87d8-4a59-ad53-a10a3f182332 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:13.680906 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296549c6-87d8-4a59-ad53-a10a3f182332 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:21:13.688506 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-296549c6-87d8-4a59-ad53-a10a3f182332 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 01:21:13.689992 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 384/773] 10.222.0.25 () {56 vars in 1141 bytes} [Wed Oct 27 01:21:13 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:13.696995 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d842c-781f-44cf-a290-2aa794395965 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:13.706364 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d842c-781f-44cf-a290-2aa794395965 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:13.711845 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc6c76-0282-4a19-9e4b-fa44a41cf11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:13.712508 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc6c76-0282-4a19-9e4b-fa44a41cf11a admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:13.712790 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc6c76-0282-4a19-9e4b-fa44a41cf11a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:13.713065 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc6c76-0282-4a19-9e4b-fa44a41cf11a admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:13.713856 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc6c76-0282-4a19-9e4b-fa44a41cf11a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:13.714165 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc6c76-0282-4a19-9e4b-fa44a41cf11a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:13.715756 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc6c76-0282-4a19-9e4b-fa44a41cf11a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:13.724100 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 390/774] 10.222.0.25 () {56 vars in 1136 bytes} [Wed Oct 27 01:21:13 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:13.730171 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296549c6-87d8-4a59-ad53-a10a3f182332 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:13.739798 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296549c6-87d8-4a59-ad53-a10a3f182332 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:13.744839 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98636f4-61d6-44cb-b358-2785063a3859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:13.745661 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98636f4-61d6-44cb-b358-2785063a3859 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:13.745948 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98636f4-61d6-44cb-b358-2785063a3859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:13.746226 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98636f4-61d6-44cb-b358-2785063a3859 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:13.756983 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98636f4-61d6-44cb-b358-2785063a3859 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:13.758870 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98636f4-61d6-44cb-b358-2785063a3859 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:13.775680 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-d98636f4-61d6-44cb-b358-2785063a3859 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:13.777120 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 385/775] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:13.783246 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc6c76-0282-4a19-9e4b-fa44a41cf11a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:13.792912 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc6c76-0282-4a19-9e4b-fa44a41cf11a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:13.797454 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a315b-8ab2-4048-bbe6-f35c9d764f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:13.798151 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a315b-8ab2-4048-bbe6-f35c9d764f4d admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:13.798432 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a315b-8ab2-4048-bbe6-f35c9d764f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:13.798708 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a315b-8ab2-4048-bbe6-f35c9d764f4d admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:13.799472 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a315b-8ab2-4048-bbe6-f35c9d764f4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:13.799779 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a315b-8ab2-4048-bbe6-f35c9d764f4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:13.801365 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a315b-8ab2-4048-bbe6-f35c9d764f4d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:13.814503 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 391/776] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:13.821134 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98636f4-61d6-44cb-b358-2785063a3859 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:13.830868 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98636f4-61d6-44cb-b358-2785063a3859 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:13.842280 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb2c78-f2a1-4c69-bacc-8f1cd039f7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:13.842280 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb2c78-f2a1-4c69-bacc-8f1cd039f7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:13.842280 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb2c78-f2a1-4c69-bacc-8f1cd039f7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:13.842280 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb2c78-f2a1-4c69-bacc-8f1cd039f7f0 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:13.849066 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb2c78-f2a1-4c69-bacc-8f1cd039f7f0 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:13.851358 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb2c78-f2a1-4c69-bacc-8f1cd039f7f0 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:13.865691 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-71eb2c78-f2a1-4c69-bacc-8f1cd039f7f0 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 01:21:13.868019 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 386/777] 10.222.0.25 () {56 vars in 1138 bytes} [Wed Oct 27 01:21:13 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:13.874175 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a315b-8ab2-4048-bbe6-f35c9d764f4d admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:13.884752 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a315b-8ab2-4048-bbe6-f35c9d764f4d admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:13.889472 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c854b6-029d-4af8-ad87-d249fcb97542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:13.890216 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c854b6-029d-4af8-ad87-d249fcb97542 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:13.890498 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c854b6-029d-4af8-ad87-d249fcb97542 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:13.890774 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c854b6-029d-4af8-ad87-d249fcb97542 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:13.891721 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c854b6-029d-4af8-ad87-d249fcb97542 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:13.892095 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c854b6-029d-4af8-ad87-d249fcb97542 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:13.894009 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c854b6-029d-4af8-ad87-d249fcb97542 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:13.911883 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 392/778] 10.222.0.25 () {56 vars in 1170 bytes} [Wed Oct 27 01:21:13 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:13.918187 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb2c78-f2a1-4c69-bacc-8f1cd039f7f0 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:13.928282 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb2c78-f2a1-4c69-bacc-8f1cd039f7f0 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:13.933784 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9991b-2196-404d-ba86-5f113f7e7eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:13.934469 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9991b-2196-404d-ba86-5f113f7e7eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:13.934763 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9991b-2196-404d-ba86-5f113f7e7eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:13.935045 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9991b-2196-404d-ba86-5f113f7e7eb9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:13.943386 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9991b-2196-404d-ba86-5f113f7e7eb9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:13.945198 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9991b-2196-404d-ba86-5f113f7e7eb9 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:13.956733 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 387/779] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:21:13 2021] GET /identity/v3/auth/tokens => generated 1715 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:13.963270 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c854b6-029d-4af8-ad87-d249fcb97542 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:13.974909 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c854b6-029d-4af8-ad87-d249fcb97542 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:13.979803 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7076803-5e1b-4467-be59-a10b8273595a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:13.980596 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7076803-5e1b-4467-be59-a10b8273595a admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:13.980931 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7076803-5e1b-4467-be59-a10b8273595a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:13.981211 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7076803-5e1b-4467-be59-a10b8273595a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:13.992690 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7076803-5e1b-4467-be59-a10b8273595a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:13.994588 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7076803-5e1b-4467-be59-a10b8273595a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:14.012318 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-f7076803-5e1b-4467-be59-a10b8273595a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:14.013889 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 393/780] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:14.020154 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9991b-2196-404d-ba86-5f113f7e7eb9 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:14.029327 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9991b-2196-404d-ba86-5f113f7e7eb9 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:14.034045 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3346ce6-58d9-4ea3-b8a5-f634e4554a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:14.034694 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3346ce6-58d9-4ea3-b8a5-f634e4554a6e admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:14.034978 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3346ce6-58d9-4ea3-b8a5-f634e4554a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:14.035260 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3346ce6-58d9-4ea3-b8a5-f634e4554a6e admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:14.036044 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3346ce6-58d9-4ea3-b8a5-f634e4554a6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:14.036354 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3346ce6-58d9-4ea3-b8a5-f634e4554a6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:14.038019 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3346ce6-58d9-4ea3-b8a5-f634e4554a6e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:14.051730 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 388/781] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:14.059070 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7076803-5e1b-4467-be59-a10b8273595a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:14.069371 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7076803-5e1b-4467-be59-a10b8273595a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:14.074167 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebf85d-f30b-4caf-a238-e19731122fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:14.074998 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebf85d-f30b-4caf-a238-e19731122fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:14.075319 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebf85d-f30b-4caf-a238-e19731122fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:14.075603 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebf85d-f30b-4caf-a238-e19731122fa1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:14.082980 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebf85d-f30b-4caf-a238-e19731122fa1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:14.084992 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebf85d-f30b-4caf-a238-e19731122fa1 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:14.098932 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-c0ebf85d-f30b-4caf-a238-e19731122fa1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:21:14.100367 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 394/782] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:21:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:14.107285 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3346ce6-58d9-4ea3-b8a5-f634e4554a6e admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:14.117958 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3346ce6-58d9-4ea3-b8a5-f634e4554a6e admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:14.122712 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe708271-b569-481f-911f-4fdf815fe98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:14.123361 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe708271-b569-481f-911f-4fdf815fe98d admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:14.123701 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe708271-b569-481f-911f-4fdf815fe98d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:14.123983 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe708271-b569-481f-911f-4fdf815fe98d admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:14.124830 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe708271-b569-481f-911f-4fdf815fe98d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:14.125147 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe708271-b569-481f-911f-4fdf815fe98d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:14.127086 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe708271-b569-481f-911f-4fdf815fe98d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:14.139889 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 389/783] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:21:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:14.146457 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebf85d-f30b-4caf-a238-e19731122fa1 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:14.157426 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebf85d-f30b-4caf-a238-e19731122fa1 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:14.162268 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47cf78-d1f3-4981-82b0-3d68195cc4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:14.162974 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47cf78-d1f3-4981-82b0-3d68195cc4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:14.163257 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47cf78-d1f3-4981-82b0-3d68195cc4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:14.163595 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47cf78-d1f3-4981-82b0-3d68195cc4a7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:14.165063 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47cf78-d1f3-4981-82b0-3d68195cc4a7 admin admin] RBAC: Adding query filter params (role.id=41046f7a7b794737b3147350ce888a3b, scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6, user.id=56895529b11b4236bccb5956a8ccb5b2) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:14.165384 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47cf78-d1f3-4981-82b0-3d68195cc4a7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:14.167384 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47cf78-d1f3-4981-82b0-3d68195cc4a7 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:14.174579 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 395/784] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:21:14 2021] GET /identity/v3/role_assignments?user.id=56895529b11b4236bccb5956a8ccb5b2&scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6&role.id=41046f7a7b794737b3147350ce888a3b => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:14.579069 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5180b-da20-4703-b5a0-23c9f46472ff None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:14.579440 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5180b-da20-4703-b5a0-23c9f46472ff None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:14.579647 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5180b-da20-4703-b5a0-23c9f46472ff None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:14.581773 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 390/785] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:14.588384 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35369b63-249e-4ec6-adef-9c8f90a58175 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:14.588677 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35369b63-249e-4ec6-adef-9c8f90a58175 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:14.588958 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35369b63-249e-4ec6-adef-9c8f90a58175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:14.607100 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-35369b63-249e-4ec6-adef-9c8f90a58175 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:14.608303 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-35369b63-249e-4ec6-adef-9c8f90a58175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:14.616501 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 396/786] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:14 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:14.634446 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e29d5-0d0a-4cab-8d88-3eac72fcb996 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:14.635012 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e29d5-0d0a-4cab-8d88-3eac72fcb996 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:14.635012 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e29d5-0d0a-4cab-8d88-3eac72fcb996 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:14.637009 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 391/787] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:14.642308 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35369b63-249e-4ec6-adef-9c8f90a58175 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:14.644621 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42925744-f0f5-49c7-903c-500cd7de04f1 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:14.648881 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42925744-f0f5-49c7-903c-500cd7de04f1 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:14.648881 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42925744-f0f5-49c7-903c-500cd7de04f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:14.654962 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35369b63-249e-4ec6-adef-9c8f90a58175 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:14.660458 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36548ad-c7fa-4ca1-a1da-04107cd68ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:14.661127 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36548ad-c7fa-4ca1-a1da-04107cd68ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:14.661414 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36548ad-c7fa-4ca1-a1da-04107cd68ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:14.661729 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36548ad-c7fa-4ca1-a1da-04107cd68ad8 admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:14.662476 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36548ad-c7fa-4ca1-a1da-04107cd68ad8 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:14.664628 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36548ad-c7fa-4ca1-a1da-04107cd68ad8 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:14.668103 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-42925744-f0f5-49c7-903c-500cd7de04f1 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:14.669728 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-42925744-f0f5-49c7-903c-500cd7de04f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:14.678134 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 392/788] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:14 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:14.680406 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 397/789] 10.222.0.25 () {60 vars in 1162 bytes} [Wed Oct 27 01:21:14 2021] POST /identity/v3/services => generated 251 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:21:14.702629 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42925744-f0f5-49c7-903c-500cd7de04f1 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:14.712995 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42925744-f0f5-49c7-903c-500cd7de04f1 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:14.728381 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ba7bf-ff45-4369-b2ed-388070d353dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:14.729299 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ba7bf-ff45-4369-b2ed-388070d353dd admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:14.729720 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ba7bf-ff45-4369-b2ed-388070d353dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:14.730013 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ba7bf-ff45-4369-b2ed-388070d353dd admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:14.730686 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ba7bf-ff45-4369-b2ed-388070d353dd admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:14.732279 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ba7bf-ff45-4369-b2ed-388070d353dd admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:14.744526 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-621ba7bf-ff45-4369-b2ed-388070d353dd admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 01:21:14.746155 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 393/790] 10.222.0.25 () {56 vars in 1153 bytes} [Wed Oct 27 01:21:14 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:14.752987 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36548ad-c7fa-4ca1-a1da-04107cd68ad8 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:14.764331 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36548ad-c7fa-4ca1-a1da-04107cd68ad8 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:14.769527 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a44102-82a6-4431-a5f7-f60e99fbc50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:14.770636 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a44102-82a6-4431-a5f7-f60e99fbc50f admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:14.771135 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a44102-82a6-4431-a5f7-f60e99fbc50f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:14.771675 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a44102-82a6-4431-a5f7-f60e99fbc50f admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:14.772684 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a44102-82a6-4431-a5f7-f60e99fbc50f admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:14.773200 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a44102-82a6-4431-a5f7-f60e99fbc50f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:14.775648 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a44102-82a6-4431-a5f7-f60e99fbc50f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:14.781882 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 398/791] 10.222.0.25 () {56 vars in 1147 bytes} [Wed Oct 27 01:21:14 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:14.789683 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ba7bf-ff45-4369-b2ed-388070d353dd admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:14.799798 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ba7bf-ff45-4369-b2ed-388070d353dd admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:14.804896 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a168c11-bb0f-4ae0-bff7-fff3f8bc0816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:14.805875 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a168c11-bb0f-4ae0-bff7-fff3f8bc0816 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:14.806397 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a168c11-bb0f-4ae0-bff7-fff3f8bc0816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:14.806852 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a168c11-bb0f-4ae0-bff7-fff3f8bc0816 admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:14.808040 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a168c11-bb0f-4ae0-bff7-fff3f8bc0816 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:14.808511 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a168c11-bb0f-4ae0-bff7-fff3f8bc0816 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:14.810437 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a168c11-bb0f-4ae0-bff7-fff3f8bc0816 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:14.816844 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 394/792] 10.222.0.25 () {56 vars in 1147 bytes} [Wed Oct 27 01:21:14 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:14.824380 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a44102-82a6-4431-a5f7-f60e99fbc50f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:14.835194 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a44102-82a6-4431-a5f7-f60e99fbc50f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:14.840953 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00495abe-a427-40f0-aa7c-ac519ac8bd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:14.841856 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00495abe-a427-40f0-aa7c-ac519ac8bd81 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:14.842322 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00495abe-a427-40f0-aa7c-ac519ac8bd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:14.842772 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00495abe-a427-40f0-aa7c-ac519ac8bd81 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:14.843794 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00495abe-a427-40f0-aa7c-ac519ac8bd81 admin admin] RBAC: Adding query filter params (interface=public, service_id=00f1a3a9bd3b4b558de3e3b6b00a591b, region_id=RegionOne) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:14.844259 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00495abe-a427-40f0-aa7c-ac519ac8bd81 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:14.845551 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING py.warnings [None req-00495abe-a427-40f0-aa7c-ac519ac8bd81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:21:14.845551 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: warnings.warn(msg) Oct 27 01:21:14.845551 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: Oct 27 01:21:14.846815 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00495abe-a427-40f0-aa7c-ac519ac8bd81 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:14.856143 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 399/793] 10.222.0.25 () {56 vars in 1272 bytes} [Wed Oct 27 01:21:14 2021] GET /identity/v3/endpoints?service_id=00f1a3a9bd3b4b558de3e3b6b00a591b&interface=public®ion_id=RegionOne => generated 194 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:14.862590 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a168c11-bb0f-4ae0-bff7-fff3f8bc0816 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:14.873410 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a168c11-bb0f-4ae0-bff7-fff3f8bc0816 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:14.878711 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8412c-47e5-440b-9301-a77cf9fa4809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:14.879702 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8412c-47e5-440b-9301-a77cf9fa4809 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:14.880142 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8412c-47e5-440b-9301-a77cf9fa4809 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:14.880628 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8412c-47e5-440b-9301-a77cf9fa4809 admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:14.881505 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8412c-47e5-440b-9301-a77cf9fa4809 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:14.883955 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8412c-47e5-440b-9301-a77cf9fa4809 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:14.890792 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 395/794] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Oct 27 01:21:14 2021] GET /identity/v3/services => generated 1268 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:21:15.276843 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83fe9e-c321-443d-916c-80ce04875d7c None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:15.277135 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83fe9e-c321-443d-916c-80ce04875d7c None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:15.277419 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83fe9e-c321-443d-916c-80ce04875d7c None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:15.279471 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 400/795] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:15.285851 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763323f-56f7-46ed-9ff7-b1e094cc64cd None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:15.286149 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763323f-56f7-46ed-9ff7-b1e094cc64cd None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:15.286433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763323f-56f7-46ed-9ff7-b1e094cc64cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:15.304212 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-d763323f-56f7-46ed-9ff7-b1e094cc64cd None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:15.305957 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-d763323f-56f7-46ed-9ff7-b1e094cc64cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:15.317585 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 396/796] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:15 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:21:15.337211 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83fe9e-c321-443d-916c-80ce04875d7c None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:15.349445 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83fe9e-c321-443d-916c-80ce04875d7c None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:15.353903 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca82f97-54b3-4496-929a-ef652cfcc60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:15.354693 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca82f97-54b3-4496-929a-ef652cfcc60b admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:15.354977 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca82f97-54b3-4496-929a-ef652cfcc60b admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:15.355256 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca82f97-54b3-4496-929a-ef652cfcc60b admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:15.355914 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca82f97-54b3-4496-929a-ef652cfcc60b admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:15.357505 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca82f97-54b3-4496-929a-ef652cfcc60b admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:15.369523 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-aca82f97-54b3-4496-929a-ef652cfcc60b admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 01:21:15.376711 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 401/797] 10.222.0.25 () {56 vars in 1147 bytes} [Wed Oct 27 01:21:15 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:15.378176 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763323f-56f7-46ed-9ff7-b1e094cc64cd None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:15.388327 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763323f-56f7-46ed-9ff7-b1e094cc64cd None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:15.392966 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c0730-ffca-4bab-8f43-89c6f644e9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:15.393716 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c0730-ffca-4bab-8f43-89c6f644e9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:15.394002 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c0730-ffca-4bab-8f43-89c6f644e9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:15.394327 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c0730-ffca-4bab-8f43-89c6f644e9c6 admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:15.395047 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c0730-ffca-4bab-8f43-89c6f644e9c6 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:15.395352 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c0730-ffca-4bab-8f43-89c6f644e9c6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:15.396920 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c0730-ffca-4bab-8f43-89c6f644e9c6 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:15.405592 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 397/798] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Oct 27 01:21:15 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:15.408549 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca82f97-54b3-4496-929a-ef652cfcc60b admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:15.418766 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca82f97-54b3-4496-929a-ef652cfcc60b admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:15.423335 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13ed45-27a6-49fc-bac5-2553ea78aaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:15.423973 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13ed45-27a6-49fc-bac5-2553ea78aaa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:15.424254 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13ed45-27a6-49fc-bac5-2553ea78aaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:15.424535 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13ed45-27a6-49fc-bac5-2553ea78aaa7 admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:15.425300 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13ed45-27a6-49fc-bac5-2553ea78aaa7 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:15.425633 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13ed45-27a6-49fc-bac5-2553ea78aaa7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:15.427255 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13ed45-27a6-49fc-bac5-2553ea78aaa7 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:15.437649 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 402/799] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Oct 27 01:21:15 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:16.467584 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec308ccf-d264-47ef-9ca1-9229233931d5 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:16.468308 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec308ccf-d264-47ef-9ca1-9229233931d5 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:16.468308 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec308ccf-d264-47ef-9ca1-9229233931d5 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:16.470153 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 398/800] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:16.476304 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58bc81-f6d5-41b9-8d38-54621e8cc726 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:16.476851 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58bc81-f6d5-41b9-8d38-54621e8cc726 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:16.477006 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58bc81-f6d5-41b9-8d38-54621e8cc726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:16.494852 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-2e58bc81-f6d5-41b9-8d38-54621e8cc726 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:16.496043 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-2e58bc81-f6d5-41b9-8d38-54621e8cc726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:16.504092 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 403/801] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:16 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:16.528806 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec308ccf-d264-47ef-9ca1-9229233931d5 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:16.541230 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec308ccf-d264-47ef-9ca1-9229233931d5 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:16.545786 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069f65c-06a9-49e8-8d8b-7162505e515f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:16.546580 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069f65c-06a9-49e8-8d8b-7162505e515f admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:16.546865 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069f65c-06a9-49e8-8d8b-7162505e515f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:16.547140 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069f65c-06a9-49e8-8d8b-7162505e515f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:16.558111 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069f65c-06a9-49e8-8d8b-7162505e515f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:21:16.565475 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-8069f65c-06a9-49e8-8d8b-7162505e515f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 01:21:16.567000 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 399/802] 10.222.0.25 () {56 vars in 1141 bytes} [Wed Oct 27 01:21:16 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:16.574012 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58bc81-f6d5-41b9-8d38-54621e8cc726 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:16.583793 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58bc81-f6d5-41b9-8d38-54621e8cc726 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:16.589096 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb39e05-5687-4f0a-acc8-e3e42c3f39f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:16.589799 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb39e05-5687-4f0a-acc8-e3e42c3f39f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:16.590084 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb39e05-5687-4f0a-acc8-e3e42c3f39f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:16.590361 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb39e05-5687-4f0a-acc8-e3e42c3f39f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:16.591123 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb39e05-5687-4f0a-acc8-e3e42c3f39f5 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:16.591434 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb39e05-5687-4f0a-acc8-e3e42c3f39f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:16.593009 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb39e05-5687-4f0a-acc8-e3e42c3f39f5 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:16.602103 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 404/803] 10.222.0.25 () {56 vars in 1136 bytes} [Wed Oct 27 01:21:16 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:16.608527 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069f65c-06a9-49e8-8d8b-7162505e515f admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:16.619524 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069f65c-06a9-49e8-8d8b-7162505e515f admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:16.624325 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c49a3-2da9-4f01-a1b1-c09d1485c94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:16.625136 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c49a3-2da9-4f01-a1b1-c09d1485c94a admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:16.625419 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c49a3-2da9-4f01-a1b1-c09d1485c94a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:16.625734 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c49a3-2da9-4f01-a1b1-c09d1485c94a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:16.637186 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c49a3-2da9-4f01-a1b1-c09d1485c94a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:16.639060 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c49a3-2da9-4f01-a1b1-c09d1485c94a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:16.656701 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-062c49a3-2da9-4f01-a1b1-c09d1485c94a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:16.658211 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 400/804] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:16.664563 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb39e05-5687-4f0a-acc8-e3e42c3f39f5 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:16.674455 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb39e05-5687-4f0a-acc8-e3e42c3f39f5 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:16.679232 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083d36b-5ce2-4219-bc1f-5dd7f934587f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:16.680404 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083d36b-5ce2-4219-bc1f-5dd7f934587f admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:16.680686 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083d36b-5ce2-4219-bc1f-5dd7f934587f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:16.680965 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083d36b-5ce2-4219-bc1f-5dd7f934587f admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:16.681727 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083d36b-5ce2-4219-bc1f-5dd7f934587f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:16.682033 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083d36b-5ce2-4219-bc1f-5dd7f934587f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:16.683897 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083d36b-5ce2-4219-bc1f-5dd7f934587f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:16.698047 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 405/805] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:16.704276 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c49a3-2da9-4f01-a1b1-c09d1485c94a admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:16.715246 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c49a3-2da9-4f01-a1b1-c09d1485c94a admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:16.719967 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceceebe-8ec9-4180-9730-553b9eb6c5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:16.720713 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceceebe-8ec9-4180-9730-553b9eb6c5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:16.720997 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceceebe-8ec9-4180-9730-553b9eb6c5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:16.721272 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceceebe-8ec9-4180-9730-553b9eb6c5a5 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:16.729172 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceceebe-8ec9-4180-9730-553b9eb6c5a5 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:16.731228 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceceebe-8ec9-4180-9730-553b9eb6c5a5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:16.746247 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-7ceceebe-8ec9-4180-9730-553b9eb6c5a5 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 01:21:16.747685 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 401/806] 10.222.0.25 () {56 vars in 1138 bytes} [Wed Oct 27 01:21:16 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:16.754066 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083d36b-5ce2-4219-bc1f-5dd7f934587f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:16.764522 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083d36b-5ce2-4219-bc1f-5dd7f934587f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:16.769223 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61038ceb-906b-41a0-8d19-5856459a8966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:16.769940 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61038ceb-906b-41a0-8d19-5856459a8966 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:16.770225 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61038ceb-906b-41a0-8d19-5856459a8966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:16.770505 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61038ceb-906b-41a0-8d19-5856459a8966 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:16.771352 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61038ceb-906b-41a0-8d19-5856459a8966 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:16.771657 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61038ceb-906b-41a0-8d19-5856459a8966 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:16.773526 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61038ceb-906b-41a0-8d19-5856459a8966 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:16.791700 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 406/807] 10.222.0.25 () {56 vars in 1170 bytes} [Wed Oct 27 01:21:16 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:16.798185 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceceebe-8ec9-4180-9730-553b9eb6c5a5 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:16.808826 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceceebe-8ec9-4180-9730-553b9eb6c5a5 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:16.813398 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef13ad-1917-45e7-a3d7-e8d41bfaa195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:16.814208 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef13ad-1917-45e7-a3d7-e8d41bfaa195 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:16.814491 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef13ad-1917-45e7-a3d7-e8d41bfaa195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:16.814873 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef13ad-1917-45e7-a3d7-e8d41bfaa195 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:16.825929 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef13ad-1917-45e7-a3d7-e8d41bfaa195 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:16.827770 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef13ad-1917-45e7-a3d7-e8d41bfaa195 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:16.844837 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-59ef13ad-1917-45e7-a3d7-e8d41bfaa195 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:16.846316 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 402/808] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:16.852602 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61038ceb-906b-41a0-8d19-5856459a8966 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:16.862529 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61038ceb-906b-41a0-8d19-5856459a8966 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:16.867746 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503fd36-2579-4251-8d03-c3ab0ec37e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:16.868402 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503fd36-2579-4251-8d03-c3ab0ec37e57 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:16.868752 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503fd36-2579-4251-8d03-c3ab0ec37e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:16.869153 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503fd36-2579-4251-8d03-c3ab0ec37e57 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:16.872175 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503fd36-2579-4251-8d03-c3ab0ec37e57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:16.872175 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503fd36-2579-4251-8d03-c3ab0ec37e57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:16.872175 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503fd36-2579-4251-8d03-c3ab0ec37e57 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:16.885165 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 407/809] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:16.891447 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef13ad-1917-45e7-a3d7-e8d41bfaa195 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:16.902920 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef13ad-1917-45e7-a3d7-e8d41bfaa195 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:16.908008 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e03d6c-a17f-4fdb-958d-568df2f96ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:16.908892 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e03d6c-a17f-4fdb-958d-568df2f96ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:16.909177 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e03d6c-a17f-4fdb-958d-568df2f96ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:16.909528 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e03d6c-a17f-4fdb-958d-568df2f96ab5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:16.918747 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e03d6c-a17f-4fdb-958d-568df2f96ab5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:16.920829 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e03d6c-a17f-4fdb-958d-568df2f96ab5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:16.935932 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-73e03d6c-a17f-4fdb-958d-568df2f96ab5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:21:16.941603 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 403/810] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:21:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:16.944021 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503fd36-2579-4251-8d03-c3ab0ec37e57 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:16.955678 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503fd36-2579-4251-8d03-c3ab0ec37e57 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:16.960492 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e320e9-6aab-4d5f-9a4d-5b21bdf5f7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:16.961748 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e320e9-6aab-4d5f-9a4d-5b21bdf5f7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:16.962031 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e320e9-6aab-4d5f-9a4d-5b21bdf5f7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:16.962307 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e320e9-6aab-4d5f-9a4d-5b21bdf5f7a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:16.963157 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e320e9-6aab-4d5f-9a4d-5b21bdf5f7a1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:16.963465 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e320e9-6aab-4d5f-9a4d-5b21bdf5f7a1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:16.965453 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e320e9-6aab-4d5f-9a4d-5b21bdf5f7a1 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:16.979653 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 408/811] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:21:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:16.986327 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e03d6c-a17f-4fdb-958d-568df2f96ab5 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:17.000072 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e03d6c-a17f-4fdb-958d-568df2f96ab5 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:17.004909 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09327cb8-12bc-4c77-aaf1-03fd594c28a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:17.005865 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09327cb8-12bc-4c77-aaf1-03fd594c28a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:17.006152 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09327cb8-12bc-4c77-aaf1-03fd594c28a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:17.006489 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09327cb8-12bc-4c77-aaf1-03fd594c28a8 admin admin] PATH_INFO: `/v3/projects/2b95c6a455e74d9487ae73f44a9ba0e6/users/56895529b11b4236bccb5956a8ccb5b2/roles/41046f7a7b794737b3147350ce888a3b` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:17.008795 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09327cb8-12bc-4c77-aaf1-03fd594c28a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b95c6a455e74d9487ae73f44a9ba0e6, user_id=56895529b11b4236bccb5956a8ccb5b2, role_id=41046f7a7b794737b3147350ce888a3b)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:17.011612 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09327cb8-12bc-4c77-aaf1-03fd594c28a8 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:17.026614 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 404/812] 10.222.0.25 () {58 vars in 1460 bytes} [Wed Oct 27 01:21:16 2021] PUT /identity/v3/projects/2b95c6a455e74d9487ae73f44a9ba0e6/users/56895529b11b4236bccb5956a8ccb5b2/roles/41046f7a7b794737b3147350ce888a3b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:17.069852 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de56ab-d59c-4558-8f6a-3aada59961f6 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:17.070697 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de56ab-d59c-4558-8f6a-3aada59961f6 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:17.070985 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de56ab-d59c-4558-8f6a-3aada59961f6 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:17.073199 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 409/813] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:17.080239 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a79770-3c14-41f8-979e-006f27f4ceab None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:17.080533 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a79770-3c14-41f8-979e-006f27f4ceab None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:17.080897 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a79770-3c14-41f8-979e-006f27f4ceab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:17.102009 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-16a79770-3c14-41f8-979e-006f27f4ceab None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:17.103319 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-16a79770-3c14-41f8-979e-006f27f4ceab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:17.171508 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 405/814] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:17 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:17.197201 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de56ab-d59c-4558-8f6a-3aada59961f6 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:17.210987 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de56ab-d59c-4558-8f6a-3aada59961f6 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:17.216081 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1f30b-054d-43f0-a800-e625e9187cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:17.217256 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1f30b-054d-43f0-a800-e625e9187cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:17.217807 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1f30b-054d-43f0-a800-e625e9187cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:17.218331 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1f30b-054d-43f0-a800-e625e9187cf7 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:17.219265 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1f30b-054d-43f0-a800-e625e9187cf7 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:17.221180 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1f30b-054d-43f0-a800-e625e9187cf7 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:17.234503 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-04a1f30b-054d-43f0-a800-e625e9187cf7 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 01:21:17.236574 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 410/815] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Oct 27 01:21:17 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:17.245821 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a79770-3c14-41f8-979e-006f27f4ceab None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:17.255249 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a79770-3c14-41f8-979e-006f27f4ceab None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:17.260429 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb5a14-39b4-478c-a87e-ffb698b2df64 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:17.260720 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb5a14-39b4-478c-a87e-ffb698b2df64 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:17.261005 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb5a14-39b4-478c-a87e-ffb698b2df64 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:17.262704 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ea977-9143-43c9-bc22-6e1d33c46830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:17.263432 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 411/816] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:21:17.263543 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ea977-9143-43c9-bc22-6e1d33c46830 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:17.263732 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ea977-9143-43c9-bc22-6e1d33c46830 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:17.264668 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ea977-9143-43c9-bc22-6e1d33c46830 admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:17.264839 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ea977-9143-43c9-bc22-6e1d33c46830 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:17.265123 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ea977-9143-43c9-bc22-6e1d33c46830 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:17.266835 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ea977-9143-43c9-bc22-6e1d33c46830 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:17.271904 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6edcd-4e00-4429-9e8a-b0bfda81488a None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:17.271904 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6edcd-4e00-4429-9e8a-b0bfda81488a None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:17.271904 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6edcd-4e00-4429-9e8a-b0bfda81488a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:17.273685 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 406/817] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Oct 27 01:21:17 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:17.280222 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ea977-9143-43c9-bc22-6e1d33c46830 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:17.290654 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-ebd6edcd-4e00-4429-9e8a-b0bfda81488a None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:17.291984 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ea977-9143-43c9-bc22-6e1d33c46830 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:17.292329 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-ebd6edcd-4e00-4429-9e8a-b0bfda81488a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:17.297261 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd41ec4-6d51-404d-ba7d-1d33e222baa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:17.298005 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd41ec4-6d51-404d-ba7d-1d33e222baa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:17.298426 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd41ec4-6d51-404d-ba7d-1d33e222baa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:17.298800 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd41ec4-6d51-404d-ba7d-1d33e222baa6 admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:17.299723 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd41ec4-6d51-404d-ba7d-1d33e222baa6 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:17.300086 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd41ec4-6d51-404d-ba7d-1d33e222baa6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:17.300652 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 412/818] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:17 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:17.301925 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd41ec4-6d51-404d-ba7d-1d33e222baa6 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:17.311504 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 407/819] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Oct 27 01:21:17 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:17.318229 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6edcd-4e00-4429-9e8a-b0bfda81488a None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:17.327008 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd41ec4-6d51-404d-ba7d-1d33e222baa6 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:17.328024 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6edcd-4e00-4429-9e8a-b0bfda81488a None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:17.332906 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbe4d8-c3c8-471b-a668-e931aa47304a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:17.334133 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbe4d8-c3c8-471b-a668-e931aa47304a admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:17.334432 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbe4d8-c3c8-471b-a668-e931aa47304a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:17.334719 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbe4d8-c3c8-471b-a668-e931aa47304a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:17.335845 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fbe4d8-c3c8-471b-a668-e931aa47304a admin admin] RBAC: Adding query filter params (interface=public, service_id=c3cae66c1ff04401a0e58b33602f5a81, region_id=RegionOne) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:17.336171 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fbe4d8-c3c8-471b-a668-e931aa47304a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:17.337804 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fbe4d8-c3c8-471b-a668-e931aa47304a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:17.338247 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd41ec4-6d51-404d-ba7d-1d33e222baa6 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:17.343132 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62898c5b-bfcd-436d-8fb1-68cce85fd7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:17.343659 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 413/820] 10.222.0.25 () {56 vars in 1272 bytes} [Wed Oct 27 01:21:17 2021] GET /identity/v3/endpoints?service_id=c3cae66c1ff04401a0e58b33602f5a81&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:17.344291 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62898c5b-bfcd-436d-8fb1-68cce85fd7aa admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:17.344725 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62898c5b-bfcd-436d-8fb1-68cce85fd7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:17.345151 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62898c5b-bfcd-436d-8fb1-68cce85fd7aa admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:17.346006 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62898c5b-bfcd-436d-8fb1-68cce85fd7aa admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:17.347740 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62898c5b-bfcd-436d-8fb1-68cce85fd7aa admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:17.349797 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbe4d8-c3c8-471b-a668-e931aa47304a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:17.360611 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbe4d8-c3c8-471b-a668-e931aa47304a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:17.361276 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-62898c5b-bfcd-436d-8fb1-68cce85fd7aa admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 01:21:17.362946 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 408/821] 10.222.0.25 () {56 vars in 1153 bytes} [Wed Oct 27 01:21:17 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:21:17.369025 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e99bb-5851-486f-9436-dbc59324504d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:17.369025 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e99bb-5851-486f-9436-dbc59324504d admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:17.369025 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e99bb-5851-486f-9436-dbc59324504d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:17.369025 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e99bb-5851-486f-9436-dbc59324504d admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:17.369371 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e99bb-5851-486f-9436-dbc59324504d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:17.369371 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e99bb-5851-486f-9436-dbc59324504d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:17.370521 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62898c5b-bfcd-436d-8fb1-68cce85fd7aa admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:17.375936 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 414/822] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Oct 27 01:21:17 2021] GET /identity/v3/services => generated 1268 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:21:17.381806 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62898c5b-bfcd-436d-8fb1-68cce85fd7aa admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:17.387128 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180d2a1-8ca2-47cb-a44f-cfb1ca6c1052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:17.388109 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180d2a1-8ca2-47cb-a44f-cfb1ca6c1052 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:17.388577 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180d2a1-8ca2-47cb-a44f-cfb1ca6c1052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:17.389017 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180d2a1-8ca2-47cb-a44f-cfb1ca6c1052 admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:17.390001 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180d2a1-8ca2-47cb-a44f-cfb1ca6c1052 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:17.390486 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180d2a1-8ca2-47cb-a44f-cfb1ca6c1052 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:17.392310 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180d2a1-8ca2-47cb-a44f-cfb1ca6c1052 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:17.398093 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 409/823] 10.222.0.25 () {56 vars in 1147 bytes} [Wed Oct 27 01:21:17 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:17.405649 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e99bb-5851-486f-9436-dbc59324504d admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:17.417027 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e99bb-5851-486f-9436-dbc59324504d admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:17.422567 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e019d-37dd-40a5-b176-6ee669b7920c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:17.423610 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e019d-37dd-40a5-b176-6ee669b7920c admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:17.424098 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e019d-37dd-40a5-b176-6ee669b7920c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:17.424593 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e019d-37dd-40a5-b176-6ee669b7920c admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:17.425561 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e019d-37dd-40a5-b176-6ee669b7920c admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:17.426067 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e019d-37dd-40a5-b176-6ee669b7920c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:17.427981 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e019d-37dd-40a5-b176-6ee669b7920c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:17.434592 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 415/824] 10.222.0.25 () {56 vars in 1147 bytes} [Wed Oct 27 01:21:17 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:17.441626 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180d2a1-8ca2-47cb-a44f-cfb1ca6c1052 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:17.452944 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180d2a1-8ca2-47cb-a44f-cfb1ca6c1052 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:17.458442 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573aca8-99c7-4370-8475-0fbac08d0377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:17.459464 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573aca8-99c7-4370-8475-0fbac08d0377 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:17.459936 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573aca8-99c7-4370-8475-0fbac08d0377 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:17.460405 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573aca8-99c7-4370-8475-0fbac08d0377 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:17.462054 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573aca8-99c7-4370-8475-0fbac08d0377 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:17.464005 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573aca8-99c7-4370-8475-0fbac08d0377 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:17.490245 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 410/825] 10.222.0.25 () {60 vars in 1165 bytes} [Wed Oct 27 01:21:17 2021] POST /identity/v3/endpoints => generated 347 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:21:17.752479 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60399227-f78a-4873-88a9-34ba1f45dce1 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:17.753567 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60399227-f78a-4873-88a9-34ba1f45dce1 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:17.753859 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60399227-f78a-4873-88a9-34ba1f45dce1 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:17.755974 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 416/826] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:17.762262 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba678a-1bd6-4111-8430-560ace9be51f None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:17.762558 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba678a-1bd6-4111-8430-560ace9be51f None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:17.762843 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba678a-1bd6-4111-8430-560ace9be51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:17.782790 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-96ba678a-1bd6-4111-8430-560ace9be51f None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:17.784014 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-96ba678a-1bd6-4111-8430-560ace9be51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:17.809195 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 411/827] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:17 2021] POST /identity/v3/auth/tokens => generated 2003 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:17.826877 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60399227-f78a-4873-88a9-34ba1f45dce1 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:17.839984 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60399227-f78a-4873-88a9-34ba1f45dce1 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:17.844584 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a557b-6781-431c-9ff3-02a74f223cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:17.845231 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a557b-6781-431c-9ff3-02a74f223cef admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:17.845539 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a557b-6781-431c-9ff3-02a74f223cef admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:17.845819 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a557b-6781-431c-9ff3-02a74f223cef admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:17.846622 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a557b-6781-431c-9ff3-02a74f223cef admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:17.848253 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a557b-6781-431c-9ff3-02a74f223cef admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:17.869709 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 417/828] 10.222.0.25 () {60 vars in 1162 bytes} [Wed Oct 27 01:21:17 2021] POST /identity/v3/services => generated 241 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:21:19.421104 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b1b61-9cf1-44cc-8229-3c72d15d148f None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:19.421655 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b1b61-9cf1-44cc-8229-3c72d15d148f None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:19.421937 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b1b61-9cf1-44cc-8229-3c72d15d148f None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:19.423832 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 412/829] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:19.430205 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c90f1-25a8-48ac-9684-a6f510037868 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:19.430644 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c90f1-25a8-48ac-9684-a6f510037868 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:19.430825 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c90f1-25a8-48ac-9684-a6f510037868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:19.449510 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-6b2c90f1-25a8-48ac-9684-a6f510037868 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:19.450693 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-6b2c90f1-25a8-48ac-9684-a6f510037868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:19.468178 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 418/830] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:19 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:19.493022 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b1b61-9cf1-44cc-8229-3c72d15d148f None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:19.505448 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b1b61-9cf1-44cc-8229-3c72d15d148f None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:19.510462 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe66b70-fa2f-45c2-b6c6-ec134890726c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:19.511261 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe66b70-fa2f-45c2-b6c6-ec134890726c admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:19.511540 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe66b70-fa2f-45c2-b6c6-ec134890726c admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:19.511815 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe66b70-fa2f-45c2-b6c6-ec134890726c admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:19.524319 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe66b70-fa2f-45c2-b6c6-ec134890726c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:21:19.532871 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-3fe66b70-fa2f-45c2-b6c6-ec134890726c admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 01:21:19.534495 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 413/831] 10.222.0.25 () {56 vars in 1141 bytes} [Wed Oct 27 01:21:19 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:19.541125 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c90f1-25a8-48ac-9684-a6f510037868 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:19.550578 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c90f1-25a8-48ac-9684-a6f510037868 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:19.555505 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97c1a1-c2e4-4567-8291-2753d948f893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:19.556199 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97c1a1-c2e4-4567-8291-2753d948f893 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:19.556483 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97c1a1-c2e4-4567-8291-2753d948f893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:19.556762 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97c1a1-c2e4-4567-8291-2753d948f893 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:19.557574 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97c1a1-c2e4-4567-8291-2753d948f893 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:19.558148 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97c1a1-c2e4-4567-8291-2753d948f893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:19.559863 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97c1a1-c2e4-4567-8291-2753d948f893 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:19.572861 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 419/832] 10.222.0.25 () {56 vars in 1136 bytes} [Wed Oct 27 01:21:19 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:19.579299 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe66b70-fa2f-45c2-b6c6-ec134890726c admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:19.592085 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe66b70-fa2f-45c2-b6c6-ec134890726c admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:19.597033 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3f731-7d98-4208-adcc-be9eb278b6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:19.597866 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3f731-7d98-4208-adcc-be9eb278b6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:19.598150 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3f731-7d98-4208-adcc-be9eb278b6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:19.598427 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3f731-7d98-4208-adcc-be9eb278b6f4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:19.609733 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3f731-7d98-4208-adcc-be9eb278b6f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:19.611687 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3f731-7d98-4208-adcc-be9eb278b6f4 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:19.629090 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-f1f3f731-7d98-4208-adcc-be9eb278b6f4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:19.630667 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 414/833] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:19.637291 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97c1a1-c2e4-4567-8291-2753d948f893 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:19.647430 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97c1a1-c2e4-4567-8291-2753d948f893 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:19.653070 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0bf01f-e11a-4117-80ce-b55399dc58c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:19.653976 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bf01f-e11a-4117-80ce-b55399dc58c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:19.654445 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bf01f-e11a-4117-80ce-b55399dc58c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:19.654931 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bf01f-e11a-4117-80ce-b55399dc58c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:19.655845 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0bf01f-e11a-4117-80ce-b55399dc58c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:19.656336 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0bf01f-e11a-4117-80ce-b55399dc58c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:19.658147 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0bf01f-e11a-4117-80ce-b55399dc58c6 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:19.671041 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 420/834] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:19.677539 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3f731-7d98-4208-adcc-be9eb278b6f4 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:19.689872 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3f731-7d98-4208-adcc-be9eb278b6f4 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:19.694771 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c027e9e-6e51-4931-923b-8b293a973374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:19.696355 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c027e9e-6e51-4931-923b-8b293a973374 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:19.696822 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c027e9e-6e51-4931-923b-8b293a973374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:19.697296 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c027e9e-6e51-4931-923b-8b293a973374 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:19.705140 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c027e9e-6e51-4931-923b-8b293a973374 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:19.707748 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c027e9e-6e51-4931-923b-8b293a973374 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:19.714922 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e25674-9b45-4f34-848b-f98f5ee8375c None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:19.715469 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e25674-9b45-4f34-848b-f98f5ee8375c None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:19.715985 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e25674-9b45-4f34-848b-f98f5ee8375c None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:19.718235 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 421/835] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:19.726199 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-7c027e9e-6e51-4931-923b-8b293a973374 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 01:21:19.727348 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 415/836] 10.222.0.25 () {56 vars in 1138 bytes} [Wed Oct 27 01:21:19 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:19.728238 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b0100-b627-4adc-9a9e-f686f88cc1f8 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:19.728771 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b0100-b627-4adc-9a9e-f686f88cc1f8 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:19.729258 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b0100-b627-4adc-9a9e-f686f88cc1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:19.734077 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c027e9e-6e51-4931-923b-8b293a973374 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:19.744870 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c027e9e-6e51-4931-923b-8b293a973374 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:19.750051 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-d13b0100-b627-4adc-9a9e-f686f88cc1f8 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:19.750439 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30a621-c0d8-42a8-b1ff-4279e2592a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:19.751293 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-d13b0100-b627-4adc-9a9e-f686f88cc1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:19.751577 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30a621-c0d8-42a8-b1ff-4279e2592a58 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:19.752061 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30a621-c0d8-42a8-b1ff-4279e2592a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:19.752546 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30a621-c0d8-42a8-b1ff-4279e2592a58 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:19.753703 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30a621-c0d8-42a8-b1ff-4279e2592a58 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:19.754249 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30a621-c0d8-42a8-b1ff-4279e2592a58 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:19.756336 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30a621-c0d8-42a8-b1ff-4279e2592a58 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:19.765513 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 422/837] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:19 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:19.777094 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 416/838] 10.222.0.25 () {56 vars in 1170 bytes} [Wed Oct 27 01:21:19 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:19.783439 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b0100-b627-4adc-9a9e-f686f88cc1f8 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:19.786455 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30a621-c0d8-42a8-b1ff-4279e2592a58 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:19.793280 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b0100-b627-4adc-9a9e-f686f88cc1f8 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:19.796553 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30a621-c0d8-42a8-b1ff-4279e2592a58 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:19.798534 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12438a7e-4964-4a4e-822b-8bc5bc17d1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:19.799242 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12438a7e-4964-4a4e-822b-8bc5bc17d1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:19.799530 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12438a7e-4964-4a4e-822b-8bc5bc17d1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:19.799817 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12438a7e-4964-4a4e-822b-8bc5bc17d1f6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:19.802494 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a8d1a-e716-4514-9f7d-51f516ec61a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:19.803545 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a8d1a-e716-4514-9f7d-51f516ec61a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:19.804035 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a8d1a-e716-4514-9f7d-51f516ec61a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:19.805042 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a8d1a-e716-4514-9f7d-51f516ec61a9 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:19.806001 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a8d1a-e716-4514-9f7d-51f516ec61a9 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:19.808109 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a8d1a-e716-4514-9f7d-51f516ec61a9 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:19.809466 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12438a7e-4964-4a4e-822b-8bc5bc17d1f6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:19.811278 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12438a7e-4964-4a4e-822b-8bc5bc17d1f6 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:19.820111 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-561a8d1a-e716-4514-9f7d-51f516ec61a9 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 01:21:19.821739 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 423/839] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:21:19 2021] GET /identity/v3/auth/tokens => generated 2105 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:19.822290 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 417/840] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Oct 27 01:21:19 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:19.829899 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12438a7e-4964-4a4e-822b-8bc5bc17d1f6 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:19.830138 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a8d1a-e716-4514-9f7d-51f516ec61a9 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:19.839690 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a8d1a-e716-4514-9f7d-51f516ec61a9 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:19.839845 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12438a7e-4964-4a4e-822b-8bc5bc17d1f6 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:19.845035 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f70a0-4011-447a-8745-1fbcab826a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:19.845221 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713dba4-5aeb-4407-a652-f5d9d4a7e924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:19.845771 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f70a0-4011-447a-8745-1fbcab826a1a admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:19.846058 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f70a0-4011-447a-8745-1fbcab826a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:19.846338 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f70a0-4011-447a-8745-1fbcab826a1a admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:19.846668 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713dba4-5aeb-4407-a652-f5d9d4a7e924 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:19.847104 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713dba4-5aeb-4407-a652-f5d9d4a7e924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:19.847220 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f70a0-4011-447a-8745-1fbcab826a1a admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:19.847415 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f70a0-4011-447a-8745-1fbcab826a1a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:19.847756 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713dba4-5aeb-4407-a652-f5d9d4a7e924 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:19.849069 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f70a0-4011-447a-8745-1fbcab826a1a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:19.857591 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 424/841] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Oct 27 01:21:19 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:19.861852 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f70a0-4011-447a-8745-1fbcab826a1a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:19.865561 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713dba4-5aeb-4407-a652-f5d9d4a7e924 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:19.868066 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713dba4-5aeb-4407-a652-f5d9d4a7e924 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:19.872709 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f70a0-4011-447a-8745-1fbcab826a1a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:19.877675 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208d5d7-a47a-4850-96fb-a4e05a5fe668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:19.878656 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208d5d7-a47a-4850-96fb-a4e05a5fe668 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:19.879120 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208d5d7-a47a-4850-96fb-a4e05a5fe668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:19.879592 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208d5d7-a47a-4850-96fb-a4e05a5fe668 admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:19.880481 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208d5d7-a47a-4850-96fb-a4e05a5fe668 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:19.880974 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208d5d7-a47a-4850-96fb-a4e05a5fe668 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:19.883298 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208d5d7-a47a-4850-96fb-a4e05a5fe668 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:19.886657 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-1713dba4-5aeb-4407-a652-f5d9d4a7e924 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:19.888097 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 418/842] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:19.893149 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 425/843] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Oct 27 01:21:19 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:19.894983 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713dba4-5aeb-4407-a652-f5d9d4a7e924 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:19.896396 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208d5d7-a47a-4850-96fb-a4e05a5fe668 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:19.905185 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713dba4-5aeb-4407-a652-f5d9d4a7e924 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:19.906268 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208d5d7-a47a-4850-96fb-a4e05a5fe668 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:19.909699 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe08b6-bacc-4e5f-8315-fd043b3f307d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:19.910351 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe08b6-bacc-4e5f-8315-fd043b3f307d admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:19.910644 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe08b6-bacc-4e5f-8315-fd043b3f307d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:19.910752 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77869e-23f6-4719-9f8b-48aa53fd2ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:19.910940 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe08b6-bacc-4e5f-8315-fd043b3f307d admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:19.911300 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77869e-23f6-4719-9f8b-48aa53fd2ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:19.911586 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77869e-23f6-4719-9f8b-48aa53fd2ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:19.911681 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe08b6-bacc-4e5f-8315-fd043b3f307d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:19.911868 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77869e-23f6-4719-9f8b-48aa53fd2ec5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:19.911963 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe08b6-bacc-4e5f-8315-fd043b3f307d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:19.912611 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77869e-23f6-4719-9f8b-48aa53fd2ec5 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:19.913532 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe08b6-bacc-4e5f-8315-fd043b3f307d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:19.913631 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING py.warnings [None req-bf77869e-23f6-4719-9f8b-48aa53fd2ec5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:21:19.913631 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: warnings.warn(msg) Oct 27 01:21:19.913631 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: Oct 27 01:21:19.914541 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77869e-23f6-4719-9f8b-48aa53fd2ec5 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:19.925582 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 419/844] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:19.932548 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa110cf-9ab6-4127-b2f0-1348b56424f9 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:19.933051 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa110cf-9ab6-4127-b2f0-1348b56424f9 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:19.933331 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa110cf-9ab6-4127-b2f0-1348b56424f9 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:19.940278 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 426/845] 10.222.0.25 () {60 vars in 1165 bytes} [Wed Oct 27 01:21:19 2021] POST /identity/v3/endpoints => generated 346 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:21:19.940471 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 420/846] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:19.940471 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa110cf-9ab6-4127-b2f0-1348b56424f9 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:19.941766 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591db4b-0ffd-474e-9bc4-c9d480560199 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:19.942064 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591db4b-0ffd-474e-9bc4-c9d480560199 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:19.942345 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591db4b-0ffd-474e-9bc4-c9d480560199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:19.964579 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-6591db4b-0ffd-474e-9bc4-c9d480560199 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:19.965885 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-6591db4b-0ffd-474e-9bc4-c9d480560199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:19.972046 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa110cf-9ab6-4127-b2f0-1348b56424f9 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:19.977538 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 427/847] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:19 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:21:19.984469 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456953f4-a734-464d-995c-bf605e17261a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:19.985567 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456953f4-a734-464d-995c-bf605e17261a admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:19.986037 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456953f4-a734-464d-995c-bf605e17261a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:19.986463 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456953f4-a734-464d-995c-bf605e17261a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:19.998709 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456953f4-a734-464d-995c-bf605e17261a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:20.000958 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456953f4-a734-464d-995c-bf605e17261a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:20.002226 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591db4b-0ffd-474e-9bc4-c9d480560199 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:20.012377 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591db4b-0ffd-474e-9bc4-c9d480560199 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:20.017460 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d68697-fc0d-47e5-b451-1ff815e177aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:20.018687 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d68697-fc0d-47e5-b451-1ff815e177aa admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:20.019159 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d68697-fc0d-47e5-b451-1ff815e177aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:20.019642 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d68697-fc0d-47e5-b451-1ff815e177aa admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:20.020242 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-456953f4-a734-464d-995c-bf605e17261a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:21:20.020703 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d68697-fc0d-47e5-b451-1ff815e177aa admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:20.021689 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 421/848] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:21:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:20.022753 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d68697-fc0d-47e5-b451-1ff815e177aa admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:20.029102 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456953f4-a734-464d-995c-bf605e17261a admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:20.038286 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-a4d68697-fc0d-47e5-b451-1ff815e177aa admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 01:21:20.040108 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456953f4-a734-464d-995c-bf605e17261a admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:20.041092 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 428/849] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:21:20 2021] GET /identity/v3/services/compute => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:20.048030 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d68697-fc0d-47e5-b451-1ff815e177aa admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:20.057954 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbcb9e-1a3b-412b-8a2f-384982c101f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:20.059142 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbcb9e-1a3b-412b-8a2f-384982c101f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:20.059552 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbcb9e-1a3b-412b-8a2f-384982c101f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:20.059944 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbcb9e-1a3b-412b-8a2f-384982c101f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:20.061035 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbcb9e-1a3b-412b-8a2f-384982c101f5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:20.061464 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbcb9e-1a3b-412b-8a2f-384982c101f5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:20.062304 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d68697-fc0d-47e5-b451-1ff815e177aa admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:20.064152 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbcb9e-1a3b-412b-8a2f-384982c101f5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:20.067699 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd9f65-a310-483e-9d6b-25584c42a18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:20.068652 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd9f65-a310-483e-9d6b-25584c42a18c admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:20.069135 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd9f65-a310-483e-9d6b-25584c42a18c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:20.069612 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd9f65-a310-483e-9d6b-25584c42a18c admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:20.070583 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd9f65-a310-483e-9d6b-25584c42a18c admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:20.071054 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd9f65-a310-483e-9d6b-25584c42a18c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:20.072902 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd9f65-a310-483e-9d6b-25584c42a18c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:20.078821 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 429/850] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Oct 27 01:21:20 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:20.083156 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 422/851] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:21:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:20.089930 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd9f65-a310-483e-9d6b-25584c42a18c admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:20.091668 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbcb9e-1a3b-412b-8a2f-384982c101f5 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:20.102961 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd9f65-a310-483e-9d6b-25584c42a18c admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:20.105984 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbcb9e-1a3b-412b-8a2f-384982c101f5 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:20.107940 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1546e39-bc2f-431f-9d56-639efb9ad234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:20.108733 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1546e39-bc2f-431f-9d56-639efb9ad234 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:20.109093 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1546e39-bc2f-431f-9d56-639efb9ad234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:20.109512 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1546e39-bc2f-431f-9d56-639efb9ad234 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:20.110449 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1546e39-bc2f-431f-9d56-639efb9ad234 admin admin] RBAC: Adding query filter params (role.id=41046f7a7b794737b3147350ce888a3b, scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6, user.id=56895529b11b4236bccb5956a8ccb5b2) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:20.110904 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1546e39-bc2f-431f-9d56-639efb9ad234 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:20.112447 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1b30b-82f1-4296-af26-f0a715726d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:20.113011 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1546e39-bc2f-431f-9d56-639efb9ad234 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:20.113528 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1b30b-82f1-4296-af26-f0a715726d26 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:20.114017 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1b30b-82f1-4296-af26-f0a715726d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:20.114474 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1b30b-82f1-4296-af26-f0a715726d26 admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:20.115668 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1b30b-82f1-4296-af26-f0a715726d26 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:20.116205 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1b30b-82f1-4296-af26-f0a715726d26 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:20.119553 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1b30b-82f1-4296-af26-f0a715726d26 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:20.125657 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 430/852] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:21:20 2021] GET /identity/v3/role_assignments?user.id=56895529b11b4236bccb5956a8ccb5b2&scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6&role.id=41046f7a7b794737b3147350ce888a3b => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:20.126022 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 423/853] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Oct 27 01:21:20 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:20.204035 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222f202-c163-4e82-ab42-a1a005fd877b None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:20.204255 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222f202-c163-4e82-ab42-a1a005fd877b None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:20.204532 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222f202-c163-4e82-ab42-a1a005fd877b None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:20.206689 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 431/854] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:20.214225 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8465a2-91ab-47df-bd9d-070e482707db None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:20.214533 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8465a2-91ab-47df-bd9d-070e482707db None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:20.214789 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8465a2-91ab-47df-bd9d-070e482707db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:20.236862 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-bd8465a2-91ab-47df-bd9d-070e482707db None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:20.238657 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-bd8465a2-91ab-47df-bd9d-070e482707db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:20.248004 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 424/855] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:20 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:20.273011 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222f202-c163-4e82-ab42-a1a005fd877b None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:20.288369 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222f202-c163-4e82-ab42-a1a005fd877b None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:20.294179 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d6637-f977-427a-9415-10ad58f17d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:20.295440 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d6637-f977-427a-9415-10ad58f17d31 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:20.295968 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d6637-f977-427a-9415-10ad58f17d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:20.296504 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d6637-f977-427a-9415-10ad58f17d31 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:20.297503 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d6637-f977-427a-9415-10ad58f17d31 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:20.299453 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d6637-f977-427a-9415-10ad58f17d31 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:20.313411 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-3d7d6637-f977-427a-9415-10ad58f17d31 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 01:21:20.315468 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 432/856] 10.222.0.25 () {56 vars in 1147 bytes} [Wed Oct 27 01:21:20 2021] GET /identity/v3/services/object-store => generated 93 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:20.322704 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8465a2-91ab-47df-bd9d-070e482707db None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:20.332881 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8465a2-91ab-47df-bd9d-070e482707db None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:20.338316 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2001d-570b-4ec0-8de2-422364a1f122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:20.339393 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2001d-570b-4ec0-8de2-422364a1f122 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:20.339972 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2001d-570b-4ec0-8de2-422364a1f122 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:20.340456 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2001d-570b-4ec0-8de2-422364a1f122 admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:20.341447 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2001d-570b-4ec0-8de2-422364a1f122 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:20.342001 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2001d-570b-4ec0-8de2-422364a1f122 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:20.344016 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2001d-570b-4ec0-8de2-422364a1f122 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:20.350365 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 425/857] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Oct 27 01:21:20 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:20.358122 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d6637-f977-427a-9415-10ad58f17d31 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:20.370825 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d6637-f977-427a-9415-10ad58f17d31 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:20.375791 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35543cd5-ed11-42d5-9069-1a22f241691c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:20.376638 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35543cd5-ed11-42d5-9069-1a22f241691c admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:20.377070 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35543cd5-ed11-42d5-9069-1a22f241691c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:20.377545 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35543cd5-ed11-42d5-9069-1a22f241691c admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:20.378400 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35543cd5-ed11-42d5-9069-1a22f241691c admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:20.378850 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35543cd5-ed11-42d5-9069-1a22f241691c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:20.380670 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35543cd5-ed11-42d5-9069-1a22f241691c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:20.386378 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 433/858] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Oct 27 01:21:20 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:20.393095 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2001d-570b-4ec0-8de2-422364a1f122 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:20.403723 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2001d-570b-4ec0-8de2-422364a1f122 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:20.408631 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ecbd4-20bf-43c2-b40a-e7f3b48251f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:20.409518 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ecbd4-20bf-43c2-b40a-e7f3b48251f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:20.409966 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ecbd4-20bf-43c2-b40a-e7f3b48251f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:20.410376 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ecbd4-20bf-43c2-b40a-e7f3b48251f8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:20.411324 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ecbd4-20bf-43c2-b40a-e7f3b48251f8 admin admin] RBAC: Adding query filter params (interface=public, service_id=6d87c10140ae488fa635a70a7f967e2d, region_id=RegionOne) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:20.411782 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ecbd4-20bf-43c2-b40a-e7f3b48251f8 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:20.413536 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ecbd4-20bf-43c2-b40a-e7f3b48251f8 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:20.419808 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 426/859] 10.222.0.25 () {56 vars in 1272 bytes} [Wed Oct 27 01:21:20 2021] GET /identity/v3/endpoints?service_id=6d87c10140ae488fa635a70a7f967e2d&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:20.426197 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35543cd5-ed11-42d5-9069-1a22f241691c admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:20.436539 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35543cd5-ed11-42d5-9069-1a22f241691c admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:20.441706 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf7c4b-1e21-4fdc-9697-79efb524c7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:20.442545 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf7c4b-1e21-4fdc-9697-79efb524c7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:20.442973 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf7c4b-1e21-4fdc-9697-79efb524c7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:20.443392 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf7c4b-1e21-4fdc-9697-79efb524c7e2 admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:20.444218 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf7c4b-1e21-4fdc-9697-79efb524c7e2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:20.445994 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf7c4b-1e21-4fdc-9697-79efb524c7e2 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:20.452578 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 434/860] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Oct 27 01:21:20 2021] GET /identity/v3/services => generated 1497 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:21:22.281084 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675e9f0-6068-4223-9313-d6a55d1ddc15 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:22.281772 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675e9f0-6068-4223-9313-d6a55d1ddc15 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:22.281772 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675e9f0-6068-4223-9313-d6a55d1ddc15 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:22.283592 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 427/861] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:22.290435 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c52a89-866f-4653-9e1d-ab5eabddfcfe None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:22.290900 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c52a89-866f-4653-9e1d-ab5eabddfcfe None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:22.290983 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c52a89-866f-4653-9e1d-ab5eabddfcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:22.308893 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-a3c52a89-866f-4653-9e1d-ab5eabddfcfe None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:22.310105 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-a3c52a89-866f-4653-9e1d-ab5eabddfcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:22.318098 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 435/862] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:22 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:22.343207 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675e9f0-6068-4223-9313-d6a55d1ddc15 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:22.355647 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675e9f0-6068-4223-9313-d6a55d1ddc15 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:22.360100 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096a25f-1169-4fd0-a6e2-ca6762fc5a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:22.360774 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096a25f-1169-4fd0-a6e2-ca6762fc5a37 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:22.361061 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096a25f-1169-4fd0-a6e2-ca6762fc5a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:22.361343 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096a25f-1169-4fd0-a6e2-ca6762fc5a37 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:22.362196 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096a25f-1169-4fd0-a6e2-ca6762fc5a37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:22.364100 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096a25f-1169-4fd0-a6e2-ca6762fc5a37 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:22.365633 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.common [None req-f096a25f-1169-4fd0-a6e2-ca6762fc5a37 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 27 01:21:22.385837 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.sql.core [None req-f096a25f-1169-4fd0-a6e2-ca6762fc5a37 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 27 01:21:22.385837 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 01:21:22.385837 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [parameters: {'id': 'ba076ae63b3e4c78b5909ecf63998220', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 27 01:21:22.385837 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79472) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 01:21:22.402395 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-f096a25f-1169-4fd0-a6e2-ca6762fc5a37 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ba076ae63b3e4c78b5909ecf63998220.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ba076ae63b3e4c78b5909ecf63998220. Oct 27 01:21:22.404173 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 428/863] 10.222.0.25 () {60 vars in 1161 bytes} [Wed Oct 27 01:21:22 2021] POST /identity/v3/projects => generated 262 bytes in 61 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:22.410902 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c52a89-866f-4653-9e1d-ab5eabddfcfe None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:22.420691 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c52a89-866f-4653-9e1d-ab5eabddfcfe None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:22.425520 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c136eb5-93c8-4279-8fd7-0ba8e844332c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:22.426415 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c136eb5-93c8-4279-8fd7-0ba8e844332c admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:22.426702 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c136eb5-93c8-4279-8fd7-0ba8e844332c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:22.426979 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c136eb5-93c8-4279-8fd7-0ba8e844332c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:22.435320 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c136eb5-93c8-4279-8fd7-0ba8e844332c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:22.437321 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c136eb5-93c8-4279-8fd7-0ba8e844332c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:22.452119 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-4c136eb5-93c8-4279-8fd7-0ba8e844332c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:21:22.453633 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 436/864] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:21:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:22.460226 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096a25f-1169-4fd0-a6e2-ca6762fc5a37 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:22.472363 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096a25f-1169-4fd0-a6e2-ca6762fc5a37 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:22.476939 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c391f-2fc1-4e58-b97c-e41af0035c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:22.477615 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c391f-2fc1-4e58-b97c-e41af0035c94 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:22.477902 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c391f-2fc1-4e58-b97c-e41af0035c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:22.478182 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c391f-2fc1-4e58-b97c-e41af0035c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:22.478950 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c391f-2fc1-4e58-b97c-e41af0035c94 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:22.479268 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c391f-2fc1-4e58-b97c-e41af0035c94 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:22.481328 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c391f-2fc1-4e58-b97c-e41af0035c94 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:22.503311 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 429/865] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Oct 27 01:21:22 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:22.518483 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606394bd-e83c-4718-bd21-9693016acd8d None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:22.518857 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606394bd-e83c-4718-bd21-9693016acd8d None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:22.519030 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606394bd-e83c-4718-bd21-9693016acd8d None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:22.521223 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 437/866] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:22.528674 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5fdfd-828f-4f43-8652-270490ea81d0 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:22.529002 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5fdfd-828f-4f43-8652-270490ea81d0 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:22.529243 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5fdfd-828f-4f43-8652-270490ea81d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:22.548994 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-6fd5fdfd-828f-4f43-8652-270490ea81d0 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:22.550619 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-6fd5fdfd-828f-4f43-8652-270490ea81d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:22.559375 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 430/867] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:22 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:22.582894 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fbb92-e930-4446-b1e6-79c242df9331 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:22.583280 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fbb92-e930-4446-b1e6-79c242df9331 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:22.583442 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fbb92-e930-4446-b1e6-79c242df9331 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:22.585646 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 438/868] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:22.588880 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5fdfd-828f-4f43-8652-270490ea81d0 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:22.595091 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18e961-0a6e-40b4-9a00-3db501c0da8f None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:22.595735 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18e961-0a6e-40b4-9a00-3db501c0da8f None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:22.596224 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18e961-0a6e-40b4-9a00-3db501c0da8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:22.599479 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5fdfd-828f-4f43-8652-270490ea81d0 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:22.604623 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516068e-2f0a-4563-a470-436456adb798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:22.605648 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516068e-2f0a-4563-a470-436456adb798 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:22.605938 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516068e-2f0a-4563-a470-436456adb798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:22.606217 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516068e-2f0a-4563-a470-436456adb798 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:22.607069 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516068e-2f0a-4563-a470-436456adb798 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:22.608800 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516068e-2f0a-4563-a470-436456adb798 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:22.616828 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-6e18e961-0a6e-40b4-9a00-3db501c0da8f None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:22.618396 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-6e18e961-0a6e-40b4-9a00-3db501c0da8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:22.621751 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-5516068e-2f0a-4563-a470-436456adb798 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 01:21:22.625556 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 431/869] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Oct 27 01:21:22 2021] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:22.630517 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516068e-2f0a-4563-a470-436456adb798 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:22.632894 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 439/870] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:22 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:21:22.643101 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516068e-2f0a-4563-a470-436456adb798 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:22.648962 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b73f2-015f-4fc3-a8aa-57fb1db8cb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:22.650011 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b73f2-015f-4fc3-a8aa-57fb1db8cb7d admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:22.650452 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b73f2-015f-4fc3-a8aa-57fb1db8cb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:22.650873 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b73f2-015f-4fc3-a8aa-57fb1db8cb7d admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:22.651762 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b73f2-015f-4fc3-a8aa-57fb1db8cb7d admin admin] RBAC: Adding query filter params (name=image) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:22.652212 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b73f2-015f-4fc3-a8aa-57fb1db8cb7d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:22.653990 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b73f2-015f-4fc3-a8aa-57fb1db8cb7d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:22.663116 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18e961-0a6e-40b4-9a00-3db501c0da8f None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:22.670595 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 432/871] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:22 2021] GET /identity/v3/services?name=image => generated 122 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:22.675950 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18e961-0a6e-40b4-9a00-3db501c0da8f None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:22.677213 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b73f2-015f-4fc3-a8aa-57fb1db8cb7d admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:22.683531 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb090e5-ba9e-47fb-84a9-8d60f6a3b594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:22.684555 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb090e5-ba9e-47fb-84a9-8d60f6a3b594 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:22.685064 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb090e5-ba9e-47fb-84a9-8d60f6a3b594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:22.685595 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb090e5-ba9e-47fb-84a9-8d60f6a3b594 admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:22.686671 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb090e5-ba9e-47fb-84a9-8d60f6a3b594 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:22.688674 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb090e5-ba9e-47fb-84a9-8d60f6a3b594 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:22.688883 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b73f2-015f-4fc3-a8aa-57fb1db8cb7d admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:22.694159 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c328b6-6f75-4862-b513-45cb274ec4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:22.694972 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c328b6-6f75-4862-b513-45cb274ec4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:22.695960 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c328b6-6f75-4862-b513-45cb274ec4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:22.696213 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c328b6-6f75-4862-b513-45cb274ec4c7 admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:22.697176 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c328b6-6f75-4862-b513-45cb274ec4c7 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:22.697562 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c328b6-6f75-4862-b513-45cb274ec4c7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:22.699753 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c328b6-6f75-4862-b513-45cb274ec4c7 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:22.709920 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 433/872] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:22 2021] GET /identity/v3/services?type=image => generated 122 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:22.713525 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 440/873] 10.222.0.25 () {60 vars in 1162 bytes} [Wed Oct 27 01:21:22 2021] POST /identity/v3/services => generated 242 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:21:22.722319 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dc963-e74b-4bc6-a85f-8c39cc1b27cd None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:22.722669 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dc963-e74b-4bc6-a85f-8c39cc1b27cd None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:22.722892 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dc963-e74b-4bc6-a85f-8c39cc1b27cd None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:22.725034 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 434/874] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:21:22.732291 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05629cb-7626-45b7-9078-31ebf87c67b3 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:22.732621 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05629cb-7626-45b7-9078-31ebf87c67b3 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:22.732852 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05629cb-7626-45b7-9078-31ebf87c67b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:22.753956 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-a05629cb-7626-45b7-9078-31ebf87c67b3 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:22.755237 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-a05629cb-7626-45b7-9078-31ebf87c67b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:22.776162 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 441/875] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:22 2021] POST /identity/v3/auth/tokens => generated 2387 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:22.801349 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dc963-e74b-4bc6-a85f-8c39cc1b27cd None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:22.815582 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dc963-e74b-4bc6-a85f-8c39cc1b27cd None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:22.821243 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2041f-1592-4128-b0f7-50e12aed2781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:22.822153 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2041f-1592-4128-b0f7-50e12aed2781 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:22.822469 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2041f-1592-4128-b0f7-50e12aed2781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:22.822750 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2041f-1592-4128-b0f7-50e12aed2781 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:22.823489 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2041f-1592-4128-b0f7-50e12aed2781 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:22.825220 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2041f-1592-4128-b0f7-50e12aed2781 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:22.837908 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-23e2041f-1592-4128-b0f7-50e12aed2781 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 01:21:22.839437 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 435/876] 10.222.0.25 () {56 vars in 1147 bytes} [Wed Oct 27 01:21:22 2021] GET /identity/v3/services/object-store => generated 93 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:22.846870 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05629cb-7626-45b7-9078-31ebf87c67b3 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:22.857113 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05629cb-7626-45b7-9078-31ebf87c67b3 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:22.862364 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca657e2-1643-4319-a45e-dc34d4aeb07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:22.863114 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca657e2-1643-4319-a45e-dc34d4aeb07f admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:22.863403 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca657e2-1643-4319-a45e-dc34d4aeb07f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:22.863680 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca657e2-1643-4319-a45e-dc34d4aeb07f admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:22.864421 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca657e2-1643-4319-a45e-dc34d4aeb07f admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:22.864726 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca657e2-1643-4319-a45e-dc34d4aeb07f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:22.866384 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca657e2-1643-4319-a45e-dc34d4aeb07f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:22.877674 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 442/877] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Oct 27 01:21:22 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:22.880052 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2041f-1592-4128-b0f7-50e12aed2781 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:22.892209 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2041f-1592-4128-b0f7-50e12aed2781 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:22.897398 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fad2ad-4d98-41e4-8b88-99f9af859471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:22.898194 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fad2ad-4d98-41e4-8b88-99f9af859471 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:22.898482 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fad2ad-4d98-41e4-8b88-99f9af859471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:22.898764 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fad2ad-4d98-41e4-8b88-99f9af859471 admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:22.899552 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fad2ad-4d98-41e4-8b88-99f9af859471 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:22.899860 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fad2ad-4d98-41e4-8b88-99f9af859471 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:22.901593 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fad2ad-4d98-41e4-8b88-99f9af859471 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:22.913391 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 436/878] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Oct 27 01:21:22 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:22.914977 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca657e2-1643-4319-a45e-dc34d4aeb07f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:22.927944 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca657e2-1643-4319-a45e-dc34d4aeb07f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:22.934139 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a082c2e-749e-46e9-a2db-8bdb78effb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:22.935217 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a082c2e-749e-46e9-a2db-8bdb78effb8a admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:22.935766 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a082c2e-749e-46e9-a2db-8bdb78effb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:22.936224 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a082c2e-749e-46e9-a2db-8bdb78effb8a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:22.937245 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a082c2e-749e-46e9-a2db-8bdb78effb8a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:22.939185 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a082c2e-749e-46e9-a2db-8bdb78effb8a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:22.965634 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 443/879] 10.222.0.25 () {60 vars in 1165 bytes} [Wed Oct 27 01:21:22 2021] POST /identity/v3/endpoints => generated 349 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:21:24.897238 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bad695-19df-45d5-91d3-617bc0f12bd3 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:24.898102 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bad695-19df-45d5-91d3-617bc0f12bd3 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:24.898102 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bad695-19df-45d5-91d3-617bc0f12bd3 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:24.900249 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 437/880] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:24.907087 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992462b-f3b7-4ad9-b436-28abc4a79166 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:24.907636 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992462b-f3b7-4ad9-b436-28abc4a79166 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:24.907636 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992462b-f3b7-4ad9-b436-28abc4a79166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:24.927698 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-7992462b-f3b7-4ad9-b436-28abc4a79166 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:24.928917 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-7992462b-f3b7-4ad9-b436-28abc4a79166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:24.947866 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 444/881] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:24 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:24.975105 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bad695-19df-45d5-91d3-617bc0f12bd3 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:24.988224 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bad695-19df-45d5-91d3-617bc0f12bd3 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:24.993264 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c821d-1fb7-476b-8f71-0939ef565fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:24.993975 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c821d-1fb7-476b-8f71-0939ef565fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:24.994263 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c821d-1fb7-476b-8f71-0939ef565fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:24.994542 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c821d-1fb7-476b-8f71-0939ef565fc6 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:24.995273 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c821d-1fb7-476b-8f71-0939ef565fc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:24.997093 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c821d-1fb7-476b-8f71-0939ef565fc6 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:25.014593 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.sql.core [None req-069c821d-1fb7-476b-8f71-0939ef565fc6 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 27 01:21:25.014593 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 27 01:21:25.014593 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [parameters: {'user_id': 'a727630035b2442386a394c8de1b7f18', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 27 01:21:25.014593 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79472) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 01:21:25.020737 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-069c821d-1fb7-476b-8f71-0939ef565fc6 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 27 01:21:25.022031 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 438/882] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:21:24 2021] POST /identity/v3/users => generated 160 bytes in 47 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:21:25.028816 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992462b-f3b7-4ad9-b436-28abc4a79166 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:25.038016 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992462b-f3b7-4ad9-b436-28abc4a79166 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:25.042746 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee920911-dca1-495a-a0b8-0a48a6c5edec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:25.043534 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee920911-dca1-495a-a0b8-0a48a6c5edec admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:25.043815 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee920911-dca1-495a-a0b8-0a48a6c5edec admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:25.044141 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee920911-dca1-495a-a0b8-0a48a6c5edec admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:25.051593 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee920911-dca1-495a-a0b8-0a48a6c5edec admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:25.053771 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee920911-dca1-495a-a0b8-0a48a6c5edec admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:25.064185 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e951635-d435-4d40-8c90-6399d307fc59 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:25.064480 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e951635-d435-4d40-8c90-6399d307fc59 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:25.064765 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e951635-d435-4d40-8c90-6399d307fc59 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:25.068788 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-ee920911-dca1-495a-a0b8-0a48a6c5edec admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 01:21:25.069705 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 439/883] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:25 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:25.070917 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 445/884] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:21:25 2021] GET /identity/v3/users/cinder => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:21:25.076154 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4430c-0eba-4dc1-9c1b-8706f2d45cf3 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:25.076649 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4430c-0eba-4dc1-9c1b-8706f2d45cf3 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:25.076936 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4430c-0eba-4dc1-9c1b-8706f2d45cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:25.077211 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee920911-dca1-495a-a0b8-0a48a6c5edec admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:25.088315 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee920911-dca1-495a-a0b8-0a48a6c5edec admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:25.094308 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcf83f-ee60-46e8-9b2a-4a922ce3a426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:25.095004 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcf83f-ee60-46e8-9b2a-4a922ce3a426 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:25.095286 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcf83f-ee60-46e8-9b2a-4a922ce3a426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:25.095565 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcf83f-ee60-46e8-9b2a-4a922ce3a426 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:25.096406 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcf83f-ee60-46e8-9b2a-4a922ce3a426 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:25.096612 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-aff4430c-0eba-4dc1-9c1b-8706f2d45cf3 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:25.096740 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcf83f-ee60-46e8-9b2a-4a922ce3a426 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:25.098528 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-aff4430c-0eba-4dc1-9c1b-8706f2d45cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:25.098683 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcf83f-ee60-46e8-9b2a-4a922ce3a426 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:25.113512 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 440/885] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:25 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:21:25.133579 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4430c-0eba-4dc1-9c1b-8706f2d45cf3 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:25.143093 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 446/886] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Oct 27 01:21:25 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:25.143681 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4430c-0eba-4dc1-9c1b-8706f2d45cf3 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:25.149900 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09ffc5-6846-4f93-a072-efafbe6a0732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:25.150999 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09ffc5-6846-4f93-a072-efafbe6a0732 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:25.151499 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09ffc5-6846-4f93-a072-efafbe6a0732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:25.152012 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09ffc5-6846-4f93-a072-efafbe6a0732 admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:25.153052 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09ffc5-6846-4f93-a072-efafbe6a0732 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:25.155229 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09ffc5-6846-4f93-a072-efafbe6a0732 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:25.170942 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 441/887] 10.222.0.25 () {60 vars in 1162 bytes} [Wed Oct 27 01:21:25 2021] POST /identity/v3/services => generated 242 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:21:25.255412 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313c0f8-7839-41dc-9135-e93ec048b609 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:25.255717 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313c0f8-7839-41dc-9135-e93ec048b609 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:25.255985 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313c0f8-7839-41dc-9135-e93ec048b609 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:25.258714 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 447/888] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:25.265391 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e205bb-f6f7-4d23-b466-5fcc013885d1 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:25.266075 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e205bb-f6f7-4d23-b466-5fcc013885d1 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:25.266590 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e205bb-f6f7-4d23-b466-5fcc013885d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:25.282192 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68ffdb-46b5-4cfb-8f6d-3e21b6f501fa None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:25.282540 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68ffdb-46b5-4cfb-8f6d-3e21b6f501fa None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:25.282753 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68ffdb-46b5-4cfb-8f6d-3e21b6f501fa None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:25.284930 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 448/889] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:21:25.287497 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-60e205bb-f6f7-4d23-b466-5fcc013885d1 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:25.289675 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-60e205bb-f6f7-4d23-b466-5fcc013885d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:25.292536 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3e00f-cb62-480f-82a4-38c976f88c0a None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:25.292845 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3e00f-cb62-480f-82a4-38c976f88c0a None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:25.293107 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3e00f-cb62-480f-82a4-38c976f88c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:25.311239 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 442/890] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:25 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:21:25.317586 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-21a3e00f-cb62-480f-82a4-38c976f88c0a None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:25.317586 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-21a3e00f-cb62-480f-82a4-38c976f88c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:25.329704 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 449/891] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:25 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:21:25.338354 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e205bb-f6f7-4d23-b466-5fcc013885d1 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:25.348520 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e205bb-f6f7-4d23-b466-5fcc013885d1 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:25.352736 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3e00f-cb62-480f-82a4-38c976f88c0a None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:25.355063 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977733b0-ed64-45b7-a315-cb3a8a47ecc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:25.356214 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977733b0-ed64-45b7-a315-cb3a8a47ecc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:25.356748 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977733b0-ed64-45b7-a315-cb3a8a47ecc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:25.357251 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977733b0-ed64-45b7-a315-cb3a8a47ecc8 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:25.358546 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977733b0-ed64-45b7-a315-cb3a8a47ecc8 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:25.361525 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977733b0-ed64-45b7-a315-cb3a8a47ecc8 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:25.363873 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3e00f-cb62-480f-82a4-38c976f88c0a None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:25.369457 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96b736-cb0c-401c-83ed-c7743aa92732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:25.370364 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96b736-cb0c-401c-83ed-c7743aa92732 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:25.370698 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96b736-cb0c-401c-83ed-c7743aa92732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:25.370976 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96b736-cb0c-401c-83ed-c7743aa92732 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:25.371717 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96b736-cb0c-401c-83ed-c7743aa92732 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:25.373466 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96b736-cb0c-401c-83ed-c7743aa92732 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:25.377349 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-977733b0-ed64-45b7-a315-cb3a8a47ecc8 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 01:21:25.379260 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 443/892] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:21:25 2021] GET /identity/v3/services/compute => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:25.386621 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-9e96b736-cb0c-401c-83ed-c7743aa92732 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 01:21:25.387348 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977733b0-ed64-45b7-a315-cb3a8a47ecc8 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:25.392517 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 450/893] 10.222.0.25 () {56 vars in 1147 bytes} [Wed Oct 27 01:21:25 2021] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:21:25.395425 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96b736-cb0c-401c-83ed-c7743aa92732 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:25.399369 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977733b0-ed64-45b7-a315-cb3a8a47ecc8 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:25.406902 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96b736-cb0c-401c-83ed-c7743aa92732 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:25.408815 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d767e6e-4e89-4406-a27d-8bd590e239e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:25.409020 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d767e6e-4e89-4406-a27d-8bd590e239e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:25.409536 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d767e6e-4e89-4406-a27d-8bd590e239e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:25.409656 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d767e6e-4e89-4406-a27d-8bd590e239e9 admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:25.410302 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d767e6e-4e89-4406-a27d-8bd590e239e9 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:25.410609 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d767e6e-4e89-4406-a27d-8bd590e239e9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:25.411670 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021f10d-044c-4b15-9744-9596925cf29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:25.412242 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d767e6e-4e89-4406-a27d-8bd590e239e9 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:25.412353 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021f10d-044c-4b15-9744-9596925cf29c admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:25.412587 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021f10d-044c-4b15-9744-9596925cf29c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:25.412869 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021f10d-044c-4b15-9744-9596925cf29c admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:25.414144 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021f10d-044c-4b15-9744-9596925cf29c admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:25.414460 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021f10d-044c-4b15-9744-9596925cf29c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:25.416066 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021f10d-044c-4b15-9744-9596925cf29c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:25.419365 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 444/894] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Oct 27 01:21:25 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:25.421303 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 451/895] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Oct 27 01:21:25 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:25.426682 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d767e6e-4e89-4406-a27d-8bd590e239e9 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:25.427688 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021f10d-044c-4b15-9744-9596925cf29c admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:25.438617 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d767e6e-4e89-4406-a27d-8bd590e239e9 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:25.438777 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021f10d-044c-4b15-9744-9596925cf29c admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:25.443872 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc14e52-528a-45b6-a5aa-6407ca7c18ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:25.444563 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc14e52-528a-45b6-a5aa-6407ca7c18ea admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:25.444843 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc14e52-528a-45b6-a5aa-6407ca7c18ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:25.445128 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc14e52-528a-45b6-a5aa-6407ca7c18ea admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:25.445528 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b4acf-ac41-4e6b-9329-5e916f505fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:25.445953 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc14e52-528a-45b6-a5aa-6407ca7c18ea admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:25.446241 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b4acf-ac41-4e6b-9329-5e916f505fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:25.446402 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc14e52-528a-45b6-a5aa-6407ca7c18ea admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:25.446530 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b4acf-ac41-4e6b-9329-5e916f505fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:25.446773 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b4acf-ac41-4e6b-9329-5e916f505fe7 admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:25.447459 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b4acf-ac41-4e6b-9329-5e916f505fe7 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:25.447833 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b4acf-ac41-4e6b-9329-5e916f505fe7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:25.447953 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc14e52-528a-45b6-a5aa-6407ca7c18ea admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:25.450299 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b4acf-ac41-4e6b-9329-5e916f505fe7 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:25.453149 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 452/896] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Oct 27 01:21:25 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:25.455651 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 445/897] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Oct 27 01:21:25 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:25.459868 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc14e52-528a-45b6-a5aa-6407ca7c18ea admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:25.463810 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b4acf-ac41-4e6b-9329-5e916f505fe7 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:25.472991 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc14e52-528a-45b6-a5aa-6407ca7c18ea admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:25.474441 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b4acf-ac41-4e6b-9329-5e916f505fe7 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:25.479527 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd972bf2-97d4-4c59-a998-5323c4de4b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:25.480178 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd972bf2-97d4-4c59-a998-5323c4de4b2b admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:25.480304 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf12a5-9430-4852-a5d3-f012b41b31ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:25.480492 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd972bf2-97d4-4c59-a998-5323c4de4b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:25.480733 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd972bf2-97d4-4c59-a998-5323c4de4b2b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:25.480918 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf12a5-9430-4852-a5d3-f012b41b31ab admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:25.481166 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf12a5-9430-4852-a5d3-f012b41b31ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:25.481447 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf12a5-9430-4852-a5d3-f012b41b31ab admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:25.481644 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd972bf2-97d4-4c59-a998-5323c4de4b2b admin admin] RBAC: Adding query filter params (interface=public, service_id=da7a106adf7849ad8627b08152421e8c, region_id=RegionOne) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:25.481957 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd972bf2-97d4-4c59-a998-5323c4de4b2b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:25.482273 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf12a5-9430-4852-a5d3-f012b41b31ab admin admin] RBAC: Adding query filter params (interface=admin, service_id=6d87c10140ae488fa635a70a7f967e2d, region_id=RegionOne) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:25.482586 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf12a5-9430-4852-a5d3-f012b41b31ab admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:25.483527 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd972bf2-97d4-4c59-a998-5323c4de4b2b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:25.484156 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf12a5-9430-4852-a5d3-f012b41b31ab admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:25.490050 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 446/899] 10.222.0.25 () {56 vars in 1272 bytes} [Wed Oct 27 01:21:25 2021] GET /identity/v3/endpoints?service_id=da7a106adf7849ad8627b08152421e8c&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:25.490207 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 453/899] 10.222.0.25 () {56 vars in 1270 bytes} [Wed Oct 27 01:21:25 2021] GET /identity/v3/endpoints?service_id=6d87c10140ae488fa635a70a7f967e2d&interface=admin®ion_id=RegionOne => generated 193 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:25.496800 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd972bf2-97d4-4c59-a998-5323c4de4b2b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:25.498538 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf12a5-9430-4852-a5d3-f012b41b31ab admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:25.508025 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd972bf2-97d4-4c59-a998-5323c4de4b2b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:25.511347 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf12a5-9430-4852-a5d3-f012b41b31ab admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:25.513518 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5b849-8a83-49fb-b9ac-49ba458e24b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:25.514172 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5b849-8a83-49fb-b9ac-49ba458e24b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:25.514453 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5b849-8a83-49fb-b9ac-49ba458e24b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:25.514731 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5b849-8a83-49fb-b9ac-49ba458e24b8 admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:25.515427 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5b849-8a83-49fb-b9ac-49ba458e24b8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:25.516996 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5b849-8a83-49fb-b9ac-49ba458e24b8 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:25.518991 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f80967-f767-4ade-9990-fa530dcd5384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:25.519960 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f80967-f767-4ade-9990-fa530dcd5384 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:25.520553 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f80967-f767-4ade-9990-fa530dcd5384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:25.521137 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f80967-f767-4ade-9990-fa530dcd5384 admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:25.522160 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f80967-f767-4ade-9990-fa530dcd5384 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:25.523972 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 447/900] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Oct 27 01:21:25 2021] GET /identity/v3/services => generated 1957 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:21:25.524771 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f80967-f767-4ade-9990-fa530dcd5384 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:25.532738 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 454/901] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Oct 27 01:21:25 2021] GET /identity/v3/services => generated 1957 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:21:27.518650 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25b498-39bc-41d5-badb-fe1f7845fa70 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:27.519211 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25b498-39bc-41d5-badb-fe1f7845fa70 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:27.519211 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25b498-39bc-41d5-badb-fe1f7845fa70 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:27.521141 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 448/902] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:27.526927 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa39268-31ef-428b-bafa-1457126d9e9e None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:27.527348 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa39268-31ef-428b-bafa-1457126d9e9e None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:27.527550 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa39268-31ef-428b-bafa-1457126d9e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:27.545155 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-afa39268-31ef-428b-bafa-1457126d9e9e None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:27.546343 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-afa39268-31ef-428b-bafa-1457126d9e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:27.556456 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 455/903] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:27 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:21:27.579576 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25b498-39bc-41d5-badb-fe1f7845fa70 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:27.591402 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25b498-39bc-41d5-badb-fe1f7845fa70 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:27.595637 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b764f-700c-42be-964b-dac87e8dd166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:27.596408 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b764f-700c-42be-964b-dac87e8dd166 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:27.596688 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b764f-700c-42be-964b-dac87e8dd166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:27.596963 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b764f-700c-42be-964b-dac87e8dd166 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:27.597648 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b764f-700c-42be-964b-dac87e8dd166 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:27.599248 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b764f-700c-42be-964b-dac87e8dd166 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:27.610444 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-a47b764f-700c-42be-964b-dac87e8dd166 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 01:21:27.611760 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 449/904] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Oct 27 01:21:27 2021] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:27.618686 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa39268-31ef-428b-bafa-1457126d9e9e None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:27.627490 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa39268-31ef-428b-bafa-1457126d9e9e None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:27.631885 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a06c71-45d8-46f2-929f-bab636273d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:27.632560 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a06c71-45d8-46f2-929f-bab636273d20 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:27.632839 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a06c71-45d8-46f2-929f-bab636273d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:27.633114 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a06c71-45d8-46f2-929f-bab636273d20 admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:27.633848 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a06c71-45d8-46f2-929f-bab636273d20 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:27.634153 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a06c71-45d8-46f2-929f-bab636273d20 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:27.635722 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a06c71-45d8-46f2-929f-bab636273d20 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:27.640525 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 456/905] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:27 2021] GET /identity/v3/services?name=image => generated 122 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:27.646441 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b764f-700c-42be-964b-dac87e8dd166 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:27.656897 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b764f-700c-42be-964b-dac87e8dd166 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:27.661570 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ade2c6-21f6-4301-b4a9-fdce0fb87b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:27.662268 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ade2c6-21f6-4301-b4a9-fdce0fb87b10 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:27.662551 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ade2c6-21f6-4301-b4a9-fdce0fb87b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:27.662828 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ade2c6-21f6-4301-b4a9-fdce0fb87b10 admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:27.664101 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ade2c6-21f6-4301-b4a9-fdce0fb87b10 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:27.664408 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ade2c6-21f6-4301-b4a9-fdce0fb87b10 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:27.666053 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ade2c6-21f6-4301-b4a9-fdce0fb87b10 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:27.671789 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 450/906] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:27 2021] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:27.678332 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a06c71-45d8-46f2-929f-bab636273d20 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:27.689059 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a06c71-45d8-46f2-929f-bab636273d20 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:27.693537 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568f4e3-06d6-484f-bad4-a72845f0b05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:27.694193 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568f4e3-06d6-484f-bad4-a72845f0b05c admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:27.694474 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568f4e3-06d6-484f-bad4-a72845f0b05c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:27.694794 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568f4e3-06d6-484f-bad4-a72845f0b05c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:27.695587 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568f4e3-06d6-484f-bad4-a72845f0b05c admin admin] RBAC: Adding query filter params (interface=public, service_id=c7951d790c76424b847983955cd13d56, region_id=RegionOne) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:27.695896 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568f4e3-06d6-484f-bad4-a72845f0b05c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:27.697453 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568f4e3-06d6-484f-bad4-a72845f0b05c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:27.702864 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 457/907] 10.222.0.25 () {56 vars in 1272 bytes} [Wed Oct 27 01:21:27 2021] GET /identity/v3/endpoints?service_id=c7951d790c76424b847983955cd13d56&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:27.708851 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ade2c6-21f6-4301-b4a9-fdce0fb87b10 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:27.719540 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ade2c6-21f6-4301-b4a9-fdce0fb87b10 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:27.727989 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6eeba-b113-4d8d-81e4-66477ce5335a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:27.728648 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6eeba-b113-4d8d-81e4-66477ce5335a admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:27.728928 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6eeba-b113-4d8d-81e4-66477ce5335a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:27.729202 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6eeba-b113-4d8d-81e4-66477ce5335a admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:27.729927 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6eeba-b113-4d8d-81e4-66477ce5335a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:27.731522 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6eeba-b113-4d8d-81e4-66477ce5335a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:27.745885 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 451/908] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Oct 27 01:21:27 2021] GET /identity/v3/services => generated 1957 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:21:27.809040 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a8fbc-b7e9-4eaa-a2dc-18bcd35076cd None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:27.809415 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a8fbc-b7e9-4eaa-a2dc-18bcd35076cd None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:27.809797 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a8fbc-b7e9-4eaa-a2dc-18bcd35076cd None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:27.811697 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 458/909] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:27.818265 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3212b0f-4c33-4055-8774-fc801d183a8c None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:27.818558 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3212b0f-4c33-4055-8774-fc801d183a8c None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:27.818833 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3212b0f-4c33-4055-8774-fc801d183a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:27.837275 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-e3212b0f-4c33-4055-8774-fc801d183a8c None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:27.838538 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-e3212b0f-4c33-4055-8774-fc801d183a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:27.846544 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 452/910] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:27 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:27.871568 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a8fbc-b7e9-4eaa-a2dc-18bcd35076cd None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:27.884265 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a8fbc-b7e9-4eaa-a2dc-18bcd35076cd None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:27.888834 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffca28a-7b19-4b08-899d-9b97b67af6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:27.889721 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffca28a-7b19-4b08-899d-9b97b67af6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:27.889993 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffca28a-7b19-4b08-899d-9b97b67af6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:27.890275 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffca28a-7b19-4b08-899d-9b97b67af6f2 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:27.890958 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffca28a-7b19-4b08-899d-9b97b67af6f2 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:27.892580 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffca28a-7b19-4b08-899d-9b97b67af6f2 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:27.894908 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a598f-7659-4e13-b85f-980b26880782 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:27.895386 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a598f-7659-4e13-b85f-980b26880782 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:27.895674 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a598f-7659-4e13-b85f-980b26880782 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:27.897557 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 453/911] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:21:27.904540 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b761c43-ce74-4368-88a7-541426863b4a None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:27.904908 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b761c43-ce74-4368-88a7-541426863b4a None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:27.905195 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b761c43-ce74-4368-88a7-541426863b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:27.906745 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-cffca28a-7b19-4b08-899d-9b97b67af6f2 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 01:21:27.914290 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 459/912] 10.222.0.25 () {56 vars in 1147 bytes} [Wed Oct 27 01:21:27 2021] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:27.915543 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffca28a-7b19-4b08-899d-9b97b67af6f2 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:27.924417 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-2b761c43-ce74-4368-88a7-541426863b4a None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:27.925514 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffca28a-7b19-4b08-899d-9b97b67af6f2 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:27.925700 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-2b761c43-ce74-4368-88a7-541426863b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:27.930228 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d79b06-1d9d-4928-bcb4-e9f3d59dbb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:27.930900 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d79b06-1d9d-4928-bcb4-e9f3d59dbb49 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:27.931185 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d79b06-1d9d-4928-bcb4-e9f3d59dbb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:27.931467 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d79b06-1d9d-4928-bcb4-e9f3d59dbb49 admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:27.932182 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d79b06-1d9d-4928-bcb4-e9f3d59dbb49 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:27.932493 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d79b06-1d9d-4928-bcb4-e9f3d59dbb49 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:27.933804 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 454/913] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:27 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:21:27.934560 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d79b06-1d9d-4928-bcb4-e9f3d59dbb49 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:27.940293 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 460/914] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Oct 27 01:21:27 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:27.947029 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b761c43-ce74-4368-88a7-541426863b4a None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:27.957261 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b761c43-ce74-4368-88a7-541426863b4a None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:27.957451 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d79b06-1d9d-4928-bcb4-e9f3d59dbb49 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:27.962435 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8dc69-a8bc-44b4-8da8-b39663f67225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:27.963195 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8dc69-a8bc-44b4-8da8-b39663f67225 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:27.963375 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8dc69-a8bc-44b4-8da8-b39663f67225 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:27.966087 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8dc69-a8bc-44b4-8da8-b39663f67225 admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:27.966087 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8dc69-a8bc-44b4-8da8-b39663f67225 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:27.966087 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8dc69-a8bc-44b4-8da8-b39663f67225 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:27.967042 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8dc69-a8bc-44b4-8da8-b39663f67225 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:27.968564 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d79b06-1d9d-4928-bcb4-e9f3d59dbb49 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:27.972495 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 455/915] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Oct 27 01:21:27 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:27.975664 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e9e32-578c-49fa-9a5d-1f144ede21e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:27.977016 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e9e32-578c-49fa-9a5d-1f144ede21e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:27.977299 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e9e32-578c-49fa-9a5d-1f144ede21e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:27.977606 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e9e32-578c-49fa-9a5d-1f144ede21e6 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:27.979081 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e9e32-578c-49fa-9a5d-1f144ede21e6 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:27.980133 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e9e32-578c-49fa-9a5d-1f144ede21e6 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:27.980493 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8dc69-a8bc-44b4-8da8-b39663f67225 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:27.990273 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8dc69-a8bc-44b4-8da8-b39663f67225 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:27.992341 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-d03e9e32-578c-49fa-9a5d-1f144ede21e6 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 01:21:27.993765 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 461/916] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:21:27 2021] GET /identity/v3/services/compute => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:21:27.995402 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd9144-4fc3-42b6-adf4-a4c8647448da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:27.996046 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd9144-4fc3-42b6-adf4-a4c8647448da admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:27.996332 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd9144-4fc3-42b6-adf4-a4c8647448da admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:27.996610 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd9144-4fc3-42b6-adf4-a4c8647448da admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:27.997364 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd9144-4fc3-42b6-adf4-a4c8647448da admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:27.998967 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd9144-4fc3-42b6-adf4-a4c8647448da admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:28.000215 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e9e32-578c-49fa-9a5d-1f144ede21e6 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:28.010908 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e9e32-578c-49fa-9a5d-1f144ede21e6 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:28.015595 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 456/917] 10.222.0.25 () {60 vars in 1165 bytes} [Wed Oct 27 01:21:27 2021] POST /identity/v3/endpoints => generated 325 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:21:28.026334 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc4528-acf7-447a-b669-63d720e138ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:28.027010 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc4528-acf7-447a-b669-63d720e138ae admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:28.027293 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc4528-acf7-447a-b669-63d720e138ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:28.027593 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc4528-acf7-447a-b669-63d720e138ae admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:28.028318 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc4528-acf7-447a-b669-63d720e138ae admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:28.028626 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc4528-acf7-447a-b669-63d720e138ae admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:28.030306 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc4528-acf7-447a-b669-63d720e138ae admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:28.036248 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 462/918] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Oct 27 01:21:27 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:28.043656 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd9144-4fc3-42b6-adf4-a4c8647448da admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:28.054420 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd9144-4fc3-42b6-adf4-a4c8647448da admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:28.059836 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e7ebf-4c8e-41ed-9599-169e515d90a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:28.060545 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e7ebf-4c8e-41ed-9599-169e515d90a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:28.060939 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e7ebf-4c8e-41ed-9599-169e515d90a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:28.061325 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e7ebf-4c8e-41ed-9599-169e515d90a3 admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:28.062203 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e7ebf-4c8e-41ed-9599-169e515d90a3 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:28.062589 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e7ebf-4c8e-41ed-9599-169e515d90a3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:28.064404 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e7ebf-4c8e-41ed-9599-169e515d90a3 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:28.070525 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 457/919] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Oct 27 01:21:28 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:28.077217 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc4528-acf7-447a-b669-63d720e138ae admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:28.088110 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc4528-acf7-447a-b669-63d720e138ae admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:28.092963 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a0d4e-f7ce-49c3-983e-4e054dda7823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:28.093787 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a0d4e-f7ce-49c3-983e-4e054dda7823 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:28.094138 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a0d4e-f7ce-49c3-983e-4e054dda7823 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:28.094481 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a0d4e-f7ce-49c3-983e-4e054dda7823 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:28.095322 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a0d4e-f7ce-49c3-983e-4e054dda7823 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:28.097000 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a0d4e-f7ce-49c3-983e-4e054dda7823 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:28.124911 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 463/920] 10.222.0.25 () {60 vars in 1165 bytes} [Wed Oct 27 01:21:28 2021] POST /identity/v3/endpoints => generated 334 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:21:30.015934 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653b4f7-a35c-486b-8d7f-f5d740f7ec8f None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:30.016460 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653b4f7-a35c-486b-8d7f-f5d740f7ec8f None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:30.016545 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653b4f7-a35c-486b-8d7f-f5d740f7ec8f None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:30.018555 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 458/921] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:30.024167 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2aa8c-c233-4040-ad12-8a72a800337c None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:30.024572 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2aa8c-c233-4040-ad12-8a72a800337c None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:30.024716 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2aa8c-c233-4040-ad12-8a72a800337c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:30.042556 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-5dc2aa8c-c233-4040-ad12-8a72a800337c None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:30.043725 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-5dc2aa8c-c233-4040-ad12-8a72a800337c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:30.062045 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 464/922] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:30 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:30.085001 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653b4f7-a35c-486b-8d7f-f5d740f7ec8f None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:30.096814 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653b4f7-a35c-486b-8d7f-f5d740f7ec8f None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:30.101621 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0d4ad-4e66-4188-aa10-e68e340f54f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:30.102439 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0d4ad-4e66-4188-aa10-e68e340f54f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:30.102717 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0d4ad-4e66-4188-aa10-e68e340f54f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:30.102984 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0d4ad-4e66-4188-aa10-e68e340f54f5 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:30.103633 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0d4ad-4e66-4188-aa10-e68e340f54f5 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:30.105183 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0d4ad-4e66-4188-aa10-e68e340f54f5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:30.115728 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-79d0d4ad-4e66-4188-aa10-e68e340f54f5 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 01:21:30.117663 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 459/923] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Oct 27 01:21:30 2021] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:30.123903 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2aa8c-c233-4040-ad12-8a72a800337c None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:30.132650 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2aa8c-c233-4040-ad12-8a72a800337c None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:30.137092 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30a988-8dc5-4fd8-aaa8-ff9dabe7d6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:30.137766 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30a988-8dc5-4fd8-aaa8-ff9dabe7d6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:30.138048 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30a988-8dc5-4fd8-aaa8-ff9dabe7d6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:30.138322 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30a988-8dc5-4fd8-aaa8-ff9dabe7d6e8 admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:30.139033 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30a988-8dc5-4fd8-aaa8-ff9dabe7d6e8 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:30.139335 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30a988-8dc5-4fd8-aaa8-ff9dabe7d6e8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:30.140909 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30a988-8dc5-4fd8-aaa8-ff9dabe7d6e8 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:30.145906 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 465/924] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:30 2021] GET /identity/v3/services?name=image => generated 122 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:30.152769 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0d4ad-4e66-4188-aa10-e68e340f54f5 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:30.162930 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0d4ad-4e66-4188-aa10-e68e340f54f5 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:30.168269 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b53fd3-6076-4740-b49a-61eddd38d023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:30.168950 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b53fd3-6076-4740-b49a-61eddd38d023 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:30.169236 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b53fd3-6076-4740-b49a-61eddd38d023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:30.169536 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b53fd3-6076-4740-b49a-61eddd38d023 admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:30.170284 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b53fd3-6076-4740-b49a-61eddd38d023 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:30.170590 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b53fd3-6076-4740-b49a-61eddd38d023 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:30.172216 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b53fd3-6076-4740-b49a-61eddd38d023 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:30.178086 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 460/925] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:30 2021] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:30.184710 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30a988-8dc5-4fd8-aaa8-ff9dabe7d6e8 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:30.194348 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30a988-8dc5-4fd8-aaa8-ff9dabe7d6e8 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:30.198841 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6361b1-eba9-4b68-9ff8-c5ee8353f1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:30.199481 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6361b1-eba9-4b68-9ff8-c5ee8353f1da admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:30.199763 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6361b1-eba9-4b68-9ff8-c5ee8353f1da admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:30.200059 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6361b1-eba9-4b68-9ff8-c5ee8353f1da admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:30.200814 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6361b1-eba9-4b68-9ff8-c5ee8353f1da admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:30.202416 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6361b1-eba9-4b68-9ff8-c5ee8353f1da admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:30.220434 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 466/926] 10.222.0.25 () {60 vars in 1165 bytes} [Wed Oct 27 01:21:30 2021] POST /identity/v3/endpoints => generated 327 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:21:30.304939 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875b892-254b-41ed-87d9-f3340f235b2d None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:30.305232 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875b892-254b-41ed-87d9-f3340f235b2d None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:30.305545 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875b892-254b-41ed-87d9-f3340f235b2d None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:30.307354 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 461/927] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:30.314736 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bddc3-283c-4ab8-9a71-0583fa938030 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:30.315050 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bddc3-283c-4ab8-9a71-0583fa938030 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:30.315311 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bddc3-283c-4ab8-9a71-0583fa938030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:30.333908 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-a17bddc3-283c-4ab8-9a71-0583fa938030 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:30.335163 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-a17bddc3-283c-4ab8-9a71-0583fa938030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:30.354884 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 467/928] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:30 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:30.379944 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875b892-254b-41ed-87d9-f3340f235b2d None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:30.392885 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875b892-254b-41ed-87d9-f3340f235b2d None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:30.397430 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17b06a-a84d-4e70-836f-e9b2e36d9918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:30.398784 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17b06a-a84d-4e70-836f-e9b2e36d9918 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:30.399075 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17b06a-a84d-4e70-836f-e9b2e36d9918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:30.399399 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17b06a-a84d-4e70-836f-e9b2e36d9918 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:30.400708 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17b06a-a84d-4e70-836f-e9b2e36d9918 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:30.402443 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17b06a-a84d-4e70-836f-e9b2e36d9918 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:30.404541 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 462/929] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:30 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:30.410978 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bddc3-283c-4ab8-9a71-0583fa938030 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:30.427474 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bddc3-283c-4ab8-9a71-0583fa938030 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:30.432286 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe78cdc-08ef-4a0e-a9aa-daecad9ce940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:30.433272 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe78cdc-08ef-4a0e-a9aa-daecad9ce940 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:30.433606 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe78cdc-08ef-4a0e-a9aa-daecad9ce940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:30.433889 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe78cdc-08ef-4a0e-a9aa-daecad9ce940 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:30.434640 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe78cdc-08ef-4a0e-a9aa-daecad9ce940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:30.436542 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe78cdc-08ef-4a0e-a9aa-daecad9ce940 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:30.465583 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 468/930] 10.222.0.25 () {60 vars in 1162 bytes} [Wed Oct 27 01:21:30 2021] POST /identity/v3/projects => generated 311 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:21:30.516685 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4e84b-2c27-4214-b9b4-0659cb46cf9a None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:30.517227 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4e84b-2c27-4214-b9b4-0659cb46cf9a None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:30.517541 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4e84b-2c27-4214-b9b4-0659cb46cf9a None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:30.519882 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 463/931] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:30.526956 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78864e3e-3313-4594-920d-59bbd01362f8 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:30.527294 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78864e3e-3313-4594-920d-59bbd01362f8 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:30.527532 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78864e3e-3313-4594-920d-59bbd01362f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:30.546866 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-78864e3e-3313-4594-920d-59bbd01362f8 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:30.548231 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-78864e3e-3313-4594-920d-59bbd01362f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:30.608884 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 469/932] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:30 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:21:30.634516 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4e84b-2c27-4214-b9b4-0659cb46cf9a None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:30.647043 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4e84b-2c27-4214-b9b4-0659cb46cf9a None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:30.652428 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d28f5-15f6-498e-8619-dacbbe52b045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:30.653283 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d28f5-15f6-498e-8619-dacbbe52b045 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:30.653596 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d28f5-15f6-498e-8619-dacbbe52b045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:30.653877 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d28f5-15f6-498e-8619-dacbbe52b045 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:30.665666 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d28f5-15f6-498e-8619-dacbbe52b045 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:21:30.673100 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-fc6d28f5-15f6-498e-8619-dacbbe52b045 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 01:21:30.674335 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 464/933] 10.222.0.25 () {56 vars in 1141 bytes} [Wed Oct 27 01:21:30 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:21:30.680889 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78864e3e-3313-4594-920d-59bbd01362f8 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:30.690566 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78864e3e-3313-4594-920d-59bbd01362f8 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:30.695862 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad31f5-b2df-45df-b448-0e1859afa545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:30.696550 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad31f5-b2df-45df-b448-0e1859afa545 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:30.696840 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad31f5-b2df-45df-b448-0e1859afa545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:30.697123 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad31f5-b2df-45df-b448-0e1859afa545 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:30.697943 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad31f5-b2df-45df-b448-0e1859afa545 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:30.698254 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad31f5-b2df-45df-b448-0e1859afa545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:30.699830 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad31f5-b2df-45df-b448-0e1859afa545 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:30.708366 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 470/934] 10.222.0.25 () {56 vars in 1136 bytes} [Wed Oct 27 01:21:30 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:30.715176 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d28f5-15f6-498e-8619-dacbbe52b045 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:30.725116 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d28f5-15f6-498e-8619-dacbbe52b045 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:30.730312 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c25827-d2fb-4673-bce0-c7a491f6b797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:30.731095 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c25827-d2fb-4673-bce0-c7a491f6b797 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:30.731380 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c25827-d2fb-4673-bce0-c7a491f6b797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:30.731660 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c25827-d2fb-4673-bce0-c7a491f6b797 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:30.742983 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c25827-d2fb-4673-bce0-c7a491f6b797 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:30.744792 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c25827-d2fb-4673-bce0-c7a491f6b797 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:30.761304 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-f1c25827-d2fb-4673-bce0-c7a491f6b797 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:30.762696 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 465/935] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:21:30.768914 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad31f5-b2df-45df-b448-0e1859afa545 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:30.779036 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad31f5-b2df-45df-b448-0e1859afa545 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:30.783710 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d85037-dd12-437b-94f7-5ae990486b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:30.784376 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d85037-dd12-437b-94f7-5ae990486b28 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:30.784664 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d85037-dd12-437b-94f7-5ae990486b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:30.784945 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d85037-dd12-437b-94f7-5ae990486b28 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:30.785720 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d85037-dd12-437b-94f7-5ae990486b28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:30.786032 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d85037-dd12-437b-94f7-5ae990486b28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:30.787618 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d85037-dd12-437b-94f7-5ae990486b28 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:30.800294 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 471/936] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:30.807390 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c25827-d2fb-4673-bce0-c7a491f6b797 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:30.817315 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c25827-d2fb-4673-bce0-c7a491f6b797 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:30.821904 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef640e-146f-4074-b681-a52ba93d57f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:30.822670 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef640e-146f-4074-b681-a52ba93d57f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:30.822954 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef640e-146f-4074-b681-a52ba93d57f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:30.823227 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef640e-146f-4074-b681-a52ba93d57f5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:30.830937 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef640e-146f-4074-b681-a52ba93d57f5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:30.832916 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef640e-146f-4074-b681-a52ba93d57f5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:30.845877 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-94ef640e-146f-4074-b681-a52ba93d57f5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:21:30.852712 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 466/937] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Oct 27 01:21:30 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:21:30.854319 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d85037-dd12-437b-94f7-5ae990486b28 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:30.863978 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d85037-dd12-437b-94f7-5ae990486b28 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:30.869182 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3253173-7515-4300-a90d-ca505c0485be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:30.869951 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3253173-7515-4300-a90d-ca505c0485be admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:30.870319 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3253173-7515-4300-a90d-ca505c0485be admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:30.870669 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3253173-7515-4300-a90d-ca505c0485be admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:30.871583 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3253173-7515-4300-a90d-ca505c0485be admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:30.871961 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3253173-7515-4300-a90d-ca505c0485be admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:30.873918 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3253173-7515-4300-a90d-ca505c0485be admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:30.891815 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 472/938] 10.222.0.25 () {56 vars in 1154 bytes} [Wed Oct 27 01:21:30 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:30.898641 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef640e-146f-4074-b681-a52ba93d57f5 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:30.908179 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef640e-146f-4074-b681-a52ba93d57f5 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:30.912606 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42029173-70b7-433e-8703-3feafd69f6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:30.913233 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42029173-70b7-433e-8703-3feafd69f6ea admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:30.914156 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42029173-70b7-433e-8703-3feafd69f6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:30.914443 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42029173-70b7-433e-8703-3feafd69f6ea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:30.922281 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42029173-70b7-433e-8703-3feafd69f6ea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:30.924083 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42029173-70b7-433e-8703-3feafd69f6ea admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:30.933434 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 467/939] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:21:30 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:30.940101 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3253173-7515-4300-a90d-ca505c0485be admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:30.949719 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3253173-7515-4300-a90d-ca505c0485be admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:30.954372 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d4eca-1b3b-442f-bc7f-22726f02c7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:30.955280 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d4eca-1b3b-442f-bc7f-22726f02c7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:30.955628 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d4eca-1b3b-442f-bc7f-22726f02c7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:30.956008 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d4eca-1b3b-442f-bc7f-22726f02c7e3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:30.968540 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d4eca-1b3b-442f-bc7f-22726f02c7e3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:30.970646 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d4eca-1b3b-442f-bc7f-22726f02c7e3 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:30.987837 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-1a3d4eca-1b3b-442f-bc7f-22726f02c7e3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:30.994473 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 473/940] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:30.995440 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42029173-70b7-433e-8703-3feafd69f6ea admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:31.004278 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42029173-70b7-433e-8703-3feafd69f6ea admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:31.008843 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076dc6c-d8ed-4f97-b556-65e6652a3923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:31.009495 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076dc6c-d8ed-4f97-b556-65e6652a3923 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:31.009788 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076dc6c-d8ed-4f97-b556-65e6652a3923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:31.010063 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076dc6c-d8ed-4f97-b556-65e6652a3923 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:31.010775 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076dc6c-d8ed-4f97-b556-65e6652a3923 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:31.011079 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076dc6c-d8ed-4f97-b556-65e6652a3923 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:31.012622 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076dc6c-d8ed-4f97-b556-65e6652a3923 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:31.025587 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 468/941] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:31.031520 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d4eca-1b3b-442f-bc7f-22726f02c7e3 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:31.041440 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d4eca-1b3b-442f-bc7f-22726f02c7e3 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:31.045916 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036088ff-7c4a-4ae7-ae05-20851f7c8d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:31.046682 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036088ff-7c4a-4ae7-ae05-20851f7c8d32 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:31.046965 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036088ff-7c4a-4ae7-ae05-20851f7c8d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:31.047239 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036088ff-7c4a-4ae7-ae05-20851f7c8d32 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:31.053798 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036088ff-7c4a-4ae7-ae05-20851f7c8d32 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:31.055775 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036088ff-7c4a-4ae7-ae05-20851f7c8d32 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:31.068504 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-036088ff-7c4a-4ae7-ae05-20851f7c8d32 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:21:31.069969 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 474/942] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:21:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:31.076377 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076dc6c-d8ed-4f97-b556-65e6652a3923 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:31.087289 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076dc6c-d8ed-4f97-b556-65e6652a3923 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:31.091805 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889aac3-23aa-4bc1-bd8d-694321a36105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:31.092456 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889aac3-23aa-4bc1-bd8d-694321a36105 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:31.092738 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889aac3-23aa-4bc1-bd8d-694321a36105 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:31.093014 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889aac3-23aa-4bc1-bd8d-694321a36105 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:31.093919 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889aac3-23aa-4bc1-bd8d-694321a36105 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:31.094227 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889aac3-23aa-4bc1-bd8d-694321a36105 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:31.096041 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889aac3-23aa-4bc1-bd8d-694321a36105 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:31.113552 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 469/943] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:21:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:31.115765 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036088ff-7c4a-4ae7-ae05-20851f7c8d32 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:31.126760 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036088ff-7c4a-4ae7-ae05-20851f7c8d32 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:31.131614 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ac173-2a10-4104-bc88-bbddcc792b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:31.132252 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ac173-2a10-4104-bc88-bbddcc792b95 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:31.132536 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ac173-2a10-4104-bc88-bbddcc792b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:31.132812 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ac173-2a10-4104-bc88-bbddcc792b95 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:31.133682 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ac173-2a10-4104-bc88-bbddcc792b95 admin admin] RBAC: Adding query filter params (role.id=41046f7a7b794737b3147350ce888a3b, scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6, user.id=b2f8304b85b64dc4ac58523897306660) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:31.133998 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ac173-2a10-4104-bc88-bbddcc792b95 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:31.135836 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ac173-2a10-4104-bc88-bbddcc792b95 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:31.141757 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 475/944] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:21:31 2021] GET /identity/v3/role_assignments?user.id=b2f8304b85b64dc4ac58523897306660&scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6&role.id=41046f7a7b794737b3147350ce888a3b => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:32.532017 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4697a51-ea36-4186-9480-d2a5d26dd2d4 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:32.532538 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4697a51-ea36-4186-9480-d2a5d26dd2d4 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:32.532614 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4697a51-ea36-4186-9480-d2a5d26dd2d4 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:32.534561 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 470/945] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:32.541070 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fccf3f-c5ea-4640-a7dc-df75678e5eb0 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:32.541469 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fccf3f-c5ea-4640-a7dc-df75678e5eb0 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:32.541668 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fccf3f-c5ea-4640-a7dc-df75678e5eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:32.559789 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-39fccf3f-c5ea-4640-a7dc-df75678e5eb0 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:32.560971 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-39fccf3f-c5ea-4640-a7dc-df75678e5eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:32.568663 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 476/946] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:32 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:32.591786 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4697a51-ea36-4186-9480-d2a5d26dd2d4 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:32.604784 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4697a51-ea36-4186-9480-d2a5d26dd2d4 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:32.609191 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163bb0b-467b-4f85-beb2-39cf21d54f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:32.609852 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163bb0b-467b-4f85-beb2-39cf21d54f46 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:32.610147 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163bb0b-467b-4f85-beb2-39cf21d54f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:32.610427 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163bb0b-467b-4f85-beb2-39cf21d54f46 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:32.618075 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163bb0b-467b-4f85-beb2-39cf21d54f46 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:32.620017 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163bb0b-467b-4f85-beb2-39cf21d54f46 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:32.629167 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 471/947] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:21:32 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:32.636271 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fccf3f-c5ea-4640-a7dc-df75678e5eb0 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:32.645820 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fccf3f-c5ea-4640-a7dc-df75678e5eb0 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:32.651222 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3f74b-07a1-422c-b94a-978c3d5f173b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:32.652134 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3f74b-07a1-422c-b94a-978c3d5f173b admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:32.652486 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3f74b-07a1-422c-b94a-978c3d5f173b admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:32.652887 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3f74b-07a1-422c-b94a-978c3d5f173b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:32.654206 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3f74b-07a1-422c-b94a-978c3d5f173b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:32.655916 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3f74b-07a1-422c-b94a-978c3d5f173b admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:32.657779 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 477/948] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:32 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:32.788411 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd55d9a-0540-4a81-bc8a-a05a7e9b6b65 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:32.789094 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd55d9a-0540-4a81-bc8a-a05a7e9b6b65 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:32.789522 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd55d9a-0540-4a81-bc8a-a05a7e9b6b65 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:32.791434 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 472/949] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:32.798270 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b233dc-62bf-43cf-aa1c-142f185ec3ec None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:32.798604 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b233dc-62bf-43cf-aa1c-142f185ec3ec None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:32.798828 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b233dc-62bf-43cf-aa1c-142f185ec3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:32.817860 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-60b233dc-62bf-43cf-aa1c-142f185ec3ec None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:32.819105 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-60b233dc-62bf-43cf-aa1c-142f185ec3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:32.827878 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 478/950] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:32 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:21:32.854723 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd55d9a-0540-4a81-bc8a-a05a7e9b6b65 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:32.867223 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd55d9a-0540-4a81-bc8a-a05a7e9b6b65 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:32.871927 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ff700-493c-4bfc-b468-a1c4dcef5e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:32.872717 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ff700-493c-4bfc-b468-a1c4dcef5e9f admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:32.873002 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ff700-493c-4bfc-b468-a1c4dcef5e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:32.873281 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ff700-493c-4bfc-b468-a1c4dcef5e9f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:32.874519 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ff700-493c-4bfc-b468-a1c4dcef5e9f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:32.876200 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ff700-493c-4bfc-b468-a1c4dcef5e9f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:32.877846 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 473/951] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:32 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:32.884746 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b233dc-62bf-43cf-aa1c-142f185ec3ec None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:32.894031 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b233dc-62bf-43cf-aa1c-142f185ec3ec None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:32.899409 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2e10e-49df-4aa4-94b6-4c666afbfd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:32.900063 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2e10e-49df-4aa4-94b6-4c666afbfd4a admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:32.900352 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2e10e-49df-4aa4-94b6-4c666afbfd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:32.900629 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2e10e-49df-4aa4-94b6-4c666afbfd4a admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:32.901357 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2e10e-49df-4aa4-94b6-4c666afbfd4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:32.903377 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2e10e-49df-4aa4-94b6-4c666afbfd4a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:32.925161 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 479/952] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Oct 27 01:21:32 2021] POST /identity/v3/users => generated 285 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:21:33.478409 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021afe1-43ce-45e9-a303-5b3b15a5ec7e None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:33.478700 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021afe1-43ce-45e9-a303-5b3b15a5ec7e None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:33.478987 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021afe1-43ce-45e9-a303-5b3b15a5ec7e None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:33.480769 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 474/953] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:33.487502 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bac41-c93e-45a1-9366-152f1d9ff62f None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:33.487873 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bac41-c93e-45a1-9366-152f1d9ff62f None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:33.488336 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bac41-c93e-45a1-9366-152f1d9ff62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:33.512301 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-f82bac41-c93e-45a1-9366-152f1d9ff62f None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:33.513562 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-f82bac41-c93e-45a1-9366-152f1d9ff62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:33.523444 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 480/954] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:33 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:33.546861 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021afe1-43ce-45e9-a303-5b3b15a5ec7e None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:33.559681 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021afe1-43ce-45e9-a303-5b3b15a5ec7e None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:33.563974 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25d471-0cda-4077-9936-dae0ddd9698b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:33.564763 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25d471-0cda-4077-9936-dae0ddd9698b admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:33.565047 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25d471-0cda-4077-9936-dae0ddd9698b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:33.565322 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25d471-0cda-4077-9936-dae0ddd9698b admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:33.576368 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a25d471-0cda-4077-9936-dae0ddd9698b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:21:33.583741 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-2a25d471-0cda-4077-9936-dae0ddd9698b admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 01:21:33.584867 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 475/955] 10.222.0.25 () {56 vars in 1141 bytes} [Wed Oct 27 01:21:33 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:33.591401 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bac41-c93e-45a1-9366-152f1d9ff62f None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:33.600065 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bac41-c93e-45a1-9366-152f1d9ff62f None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:33.604989 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f766d-2914-45e3-bd2d-a11084be20f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:33.605662 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f766d-2914-45e3-bd2d-a11084be20f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:33.605945 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f766d-2914-45e3-bd2d-a11084be20f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:33.606220 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f766d-2914-45e3-bd2d-a11084be20f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:33.606964 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f766d-2914-45e3-bd2d-a11084be20f7 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:33.607265 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f766d-2914-45e3-bd2d-a11084be20f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:33.608828 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f766d-2914-45e3-bd2d-a11084be20f7 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:33.617204 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 481/956] 10.222.0.25 () {56 vars in 1136 bytes} [Wed Oct 27 01:21:33 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:33.623569 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25d471-0cda-4077-9936-dae0ddd9698b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:33.633041 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25d471-0cda-4077-9936-dae0ddd9698b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:33.637861 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911ee58-9961-4e39-82bb-602c4d7ae30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:33.638691 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911ee58-9961-4e39-82bb-602c4d7ae30b admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:33.638981 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911ee58-9961-4e39-82bb-602c4d7ae30b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:33.639257 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911ee58-9961-4e39-82bb-602c4d7ae30b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:33.649246 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911ee58-9961-4e39-82bb-602c4d7ae30b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:33.651070 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911ee58-9961-4e39-82bb-602c4d7ae30b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:33.668707 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-5911ee58-9961-4e39-82bb-602c4d7ae30b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:33.669885 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 476/957] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:33.676162 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f766d-2914-45e3-bd2d-a11084be20f7 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:33.686542 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f766d-2914-45e3-bd2d-a11084be20f7 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:33.691042 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec4d1e-9f88-44d3-b0cb-6bc99e428b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:33.691689 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec4d1e-9f88-44d3-b0cb-6bc99e428b64 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:33.691973 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec4d1e-9f88-44d3-b0cb-6bc99e428b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:33.692251 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec4d1e-9f88-44d3-b0cb-6bc99e428b64 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:33.692976 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec4d1e-9f88-44d3-b0cb-6bc99e428b64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:33.693284 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec4d1e-9f88-44d3-b0cb-6bc99e428b64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:33.694918 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec4d1e-9f88-44d3-b0cb-6bc99e428b64 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:33.706645 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 482/958] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:33.712971 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911ee58-9961-4e39-82bb-602c4d7ae30b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:33.723509 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911ee58-9961-4e39-82bb-602c4d7ae30b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:33.728592 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49a311-bc13-4f98-802c-80ba4c1b895b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:33.729357 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49a311-bc13-4f98-802c-80ba4c1b895b admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:33.729675 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49a311-bc13-4f98-802c-80ba4c1b895b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:33.729957 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49a311-bc13-4f98-802c-80ba4c1b895b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:33.737593 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49a311-bc13-4f98-802c-80ba4c1b895b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:33.739841 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49a311-bc13-4f98-802c-80ba4c1b895b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:33.754411 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-8d49a311-bc13-4f98-802c-80ba4c1b895b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:21:33.755528 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 477/959] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Oct 27 01:21:33 2021] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:33.761864 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec4d1e-9f88-44d3-b0cb-6bc99e428b64 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:33.771568 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec4d1e-9f88-44d3-b0cb-6bc99e428b64 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:33.776131 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2aeea-642a-48d5-9890-80a81505dfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:33.776788 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2aeea-642a-48d5-9890-80a81505dfac admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:33.777089 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2aeea-642a-48d5-9890-80a81505dfac admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:33.777344 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2aeea-642a-48d5-9890-80a81505dfac admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:33.778227 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2aeea-642a-48d5-9890-80a81505dfac admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:33.778621 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2aeea-642a-48d5-9890-80a81505dfac admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:33.780545 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2aeea-642a-48d5-9890-80a81505dfac admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:33.797965 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 483/960] 10.222.0.25 () {56 vars in 1154 bytes} [Wed Oct 27 01:21:33 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:33.804743 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49a311-bc13-4f98-802c-80ba4c1b895b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:33.814498 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49a311-bc13-4f98-802c-80ba4c1b895b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:33.818920 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb2425-16e3-404e-9671-5fc222faea07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:33.819721 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb2425-16e3-404e-9671-5fc222faea07 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:33.820005 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb2425-16e3-404e-9671-5fc222faea07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:33.820312 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb2425-16e3-404e-9671-5fc222faea07 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:33.830363 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb2425-16e3-404e-9671-5fc222faea07 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:33.832166 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb2425-16e3-404e-9671-5fc222faea07 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:33.848639 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-0afb2425-16e3-404e-9671-5fc222faea07 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:33.849807 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 478/961] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:33.856749 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2aeea-642a-48d5-9890-80a81505dfac admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:33.867055 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2aeea-642a-48d5-9890-80a81505dfac admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:33.871591 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d63de7-8b2f-4b0c-9dc1-2b450338eadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:33.872243 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d63de7-8b2f-4b0c-9dc1-2b450338eadb admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:33.872529 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d63de7-8b2f-4b0c-9dc1-2b450338eadb admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:33.872814 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d63de7-8b2f-4b0c-9dc1-2b450338eadb admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:33.873582 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d63de7-8b2f-4b0c-9dc1-2b450338eadb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:33.873897 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d63de7-8b2f-4b0c-9dc1-2b450338eadb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:33.875507 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d63de7-8b2f-4b0c-9dc1-2b450338eadb admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:33.886672 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 484/962] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:33.892933 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb2425-16e3-404e-9671-5fc222faea07 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:33.903106 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb2425-16e3-404e-9671-5fc222faea07 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:33.907500 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49893541-2d94-4ebe-ada1-b6523a658f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:33.908264 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49893541-2d94-4ebe-ada1-b6523a658f0b admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:33.908543 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49893541-2d94-4ebe-ada1-b6523a658f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:33.908811 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49893541-2d94-4ebe-ada1-b6523a658f0b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:33.916084 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49893541-2d94-4ebe-ada1-b6523a658f0b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:33.918027 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49893541-2d94-4ebe-ada1-b6523a658f0b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:33.930568 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-49893541-2d94-4ebe-ada1-b6523a658f0b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:21:33.931690 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 479/963] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:21:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:21:33.938374 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d63de7-8b2f-4b0c-9dc1-2b450338eadb admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:33.947874 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d63de7-8b2f-4b0c-9dc1-2b450338eadb admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:33.952364 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d8ddd-6df1-464c-bcbc-cc7cf56ab502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:33.953009 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d8ddd-6df1-464c-bcbc-cc7cf56ab502 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:33.953299 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d8ddd-6df1-464c-bcbc-cc7cf56ab502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:33.953607 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d8ddd-6df1-464c-bcbc-cc7cf56ab502 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:33.954397 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d8ddd-6df1-464c-bcbc-cc7cf56ab502 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:33.954710 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d8ddd-6df1-464c-bcbc-cc7cf56ab502 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:33.956537 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d8ddd-6df1-464c-bcbc-cc7cf56ab502 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:33.969051 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 485/964] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:21:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:33.975570 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49893541-2d94-4ebe-ada1-b6523a658f0b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:33.986574 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49893541-2d94-4ebe-ada1-b6523a658f0b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:33.991065 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300225b-a5cd-4fe2-b232-c9ba3a9338c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:33.992016 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300225b-a5cd-4fe2-b232-c9ba3a9338c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:33.992372 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300225b-a5cd-4fe2-b232-c9ba3a9338c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:33.992720 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300225b-a5cd-4fe2-b232-c9ba3a9338c5 admin admin] PATH_INFO: `/v3/projects/2b95c6a455e74d9487ae73f44a9ba0e6/users/b2f8304b85b64dc4ac58523897306660/roles/41046f7a7b794737b3147350ce888a3b` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:33.995013 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300225b-a5cd-4fe2-b232-c9ba3a9338c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b95c6a455e74d9487ae73f44a9ba0e6, user_id=b2f8304b85b64dc4ac58523897306660, role_id=41046f7a7b794737b3147350ce888a3b)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:33.997742 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300225b-a5cd-4fe2-b232-c9ba3a9338c5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:34.010176 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 480/965] 10.222.0.25 () {58 vars in 1460 bytes} [Wed Oct 27 01:21:33 2021] PUT /identity/v3/projects/2b95c6a455e74d9487ae73f44a9ba0e6/users/b2f8304b85b64dc4ac58523897306660/roles/41046f7a7b794737b3147350ce888a3b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:21:35.227498 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bbf1f-209a-4efa-8b7d-2d9eb245504e None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:35.227990 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bbf1f-209a-4efa-8b7d-2d9eb245504e None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:35.227990 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bbf1f-209a-4efa-8b7d-2d9eb245504e None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:35.229750 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 486/966] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:35.235647 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7b166-2521-4a1e-a921-e986fa42934b None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:35.236092 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7b166-2521-4a1e-a921-e986fa42934b None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:35.236213 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7b166-2521-4a1e-a921-e986fa42934b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:35.253768 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-00f7b166-2521-4a1e-a921-e986fa42934b None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:35.254954 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-00f7b166-2521-4a1e-a921-e986fa42934b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:35.311000 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 481/967] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:35 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:35.335200 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bbf1f-209a-4efa-8b7d-2d9eb245504e None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:35.347168 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bbf1f-209a-4efa-8b7d-2d9eb245504e None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:35.352179 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d928af-623f-402c-b8f2-a646355f023e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:35.352957 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d928af-623f-402c-b8f2-a646355f023e admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:35.353241 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d928af-623f-402c-b8f2-a646355f023e admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:35.353543 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d928af-623f-402c-b8f2-a646355f023e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:35.363428 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d928af-623f-402c-b8f2-a646355f023e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:21:35.371005 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-18d928af-623f-402c-b8f2-a646355f023e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:21:35.372304 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 487/968] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:21:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:35.378708 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7b166-2521-4a1e-a921-e986fa42934b None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:35.387490 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7b166-2521-4a1e-a921-e986fa42934b None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:35.392088 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab0582-b5f3-4275-9ca5-350c64ae2c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:35.392826 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab0582-b5f3-4275-9ca5-350c64ae2c40 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:35.393179 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab0582-b5f3-4275-9ca5-350c64ae2c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:35.393556 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab0582-b5f3-4275-9ca5-350c64ae2c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:35.394411 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab0582-b5f3-4275-9ca5-350c64ae2c40 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:35.394784 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab0582-b5f3-4275-9ca5-350c64ae2c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:35.396412 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab0582-b5f3-4275-9ca5-350c64ae2c40 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:35.409858 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 482/969] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:21:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:35.410957 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d928af-623f-402c-b8f2-a646355f023e admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:35.421514 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d928af-623f-402c-b8f2-a646355f023e admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:35.426122 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed491797-77ea-4568-acdc-a5e63aecaa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:35.426995 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed491797-77ea-4568-acdc-a5e63aecaa81 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:35.427307 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed491797-77ea-4568-acdc-a5e63aecaa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:35.427606 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed491797-77ea-4568-acdc-a5e63aecaa81 admin admin] PATH_INFO: `/v3/users/4f748b378f634b44968b1b8be340c983` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:35.441013 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed491797-77ea-4568-acdc-a5e63aecaa81 admin admin] RBAC: Authorizing `identity:get_user(user_id=4f748b378f634b44968b1b8be340c983)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:35.443179 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed491797-77ea-4568-acdc-a5e63aecaa81 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:35.444776 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 488/970] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:21:35 2021] GET /identity/v3/users/4f748b378f634b44968b1b8be340c983 => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:35.450889 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab0582-b5f3-4275-9ca5-350c64ae2c40 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:35.461040 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab0582-b5f3-4275-9ca5-350c64ae2c40 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:35.465668 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96afa4c-73d3-4a80-8d5e-343ff55d592a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:35.466292 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96afa4c-73d3-4a80-8d5e-343ff55d592a admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:35.466580 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96afa4c-73d3-4a80-8d5e-343ff55d592a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:35.466861 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96afa4c-73d3-4a80-8d5e-343ff55d592a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:35.474422 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96afa4c-73d3-4a80-8d5e-343ff55d592a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:35.476747 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96afa4c-73d3-4a80-8d5e-343ff55d592a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:35.485345 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 483/971] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:21:35 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:35.491241 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed491797-77ea-4568-acdc-a5e63aecaa81 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:35.500385 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed491797-77ea-4568-acdc-a5e63aecaa81 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:35.504895 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d87d0e-3be1-4273-a1b1-ba0448b3ea55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:35.505753 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d87d0e-3be1-4273-a1b1-ba0448b3ea55 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:35.506043 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d87d0e-3be1-4273-a1b1-ba0448b3ea55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:35.506322 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d87d0e-3be1-4273-a1b1-ba0448b3ea55 admin admin] PATH_INFO: `/v3/projects/cd7d86467c28467780adb2bb32bc22a8` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:35.507492 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d87d0e-3be1-4273-a1b1-ba0448b3ea55 admin admin] RBAC: Authorizing `identity:get_project(project_id=cd7d86467c28467780adb2bb32bc22a8)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:35.509580 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d87d0e-3be1-4273-a1b1-ba0448b3ea55 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:35.516265 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 489/972] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:21:35 2021] GET /identity/v3/projects/cd7d86467c28467780adb2bb32bc22a8 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:35.517266 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96afa4c-73d3-4a80-8d5e-343ff55d592a admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:35.526463 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96afa4c-73d3-4a80-8d5e-343ff55d592a admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:35.531319 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daee7fe-c78f-4c3a-8987-13c4c781160a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:35.531950 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daee7fe-c78f-4c3a-8987-13c4c781160a admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:35.532237 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daee7fe-c78f-4c3a-8987-13c4c781160a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:35.532519 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daee7fe-c78f-4c3a-8987-13c4c781160a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:35.533346 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daee7fe-c78f-4c3a-8987-13c4c781160a admin admin] RBAC: Adding query filter params (role.id=df3a437e6ea14518a9c1b9a348e18c99, scope.project.id=cd7d86467c28467780adb2bb32bc22a8, user.id=4f748b378f634b44968b1b8be340c983) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:35.533713 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daee7fe-c78f-4c3a-8987-13c4c781160a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:35.535518 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daee7fe-c78f-4c3a-8987-13c4c781160a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:35.541432 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 484/973] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:21:35 2021] GET /identity/v3/role_assignments?user.id=4f748b378f634b44968b1b8be340c983&scope.project.id=cd7d86467c28467780adb2bb32bc22a8&role.id=df3a437e6ea14518a9c1b9a348e18c99 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:36.254495 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceace49b-e677-4a2c-a02c-1ca6afa70129 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:36.254991 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceace49b-e677-4a2c-a02c-1ca6afa70129 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:36.254991 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceace49b-e677-4a2c-a02c-1ca6afa70129 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:36.256747 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 490/974] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:36.263334 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f11fe-394b-4648-8b58-66d410ad1cd3 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:36.263811 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f11fe-394b-4648-8b58-66d410ad1cd3 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:36.263983 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f11fe-394b-4648-8b58-66d410ad1cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:36.281253 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-208f11fe-394b-4648-8b58-66d410ad1cd3 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:36.282480 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-208f11fe-394b-4648-8b58-66d410ad1cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:36.290142 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 485/975] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:36 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:36.315826 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceace49b-e677-4a2c-a02c-1ca6afa70129 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:36.328549 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceace49b-e677-4a2c-a02c-1ca6afa70129 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:36.332939 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbaf414-e54e-4ccb-837a-026166d0b26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:36.333763 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbaf414-e54e-4ccb-837a-026166d0b26a admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:36.334055 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbaf414-e54e-4ccb-837a-026166d0b26a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:36.334333 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbaf414-e54e-4ccb-837a-026166d0b26a admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:36.344399 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbaf414-e54e-4ccb-837a-026166d0b26a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:21:36.351804 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-6bbaf414-e54e-4ccb-837a-026166d0b26a admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 01:21:36.352962 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 491/976] 10.222.0.25 () {56 vars in 1141 bytes} [Wed Oct 27 01:21:36 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:36.360054 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f11fe-394b-4648-8b58-66d410ad1cd3 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:36.370173 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f11fe-394b-4648-8b58-66d410ad1cd3 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:36.375140 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14775fc5-d63d-4932-8c25-1b182ca6809e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:36.375802 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14775fc5-d63d-4932-8c25-1b182ca6809e admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:36.376088 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14775fc5-d63d-4932-8c25-1b182ca6809e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:36.376368 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14775fc5-d63d-4932-8c25-1b182ca6809e admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:36.377153 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14775fc5-d63d-4932-8c25-1b182ca6809e admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:36.377561 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14775fc5-d63d-4932-8c25-1b182ca6809e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:36.379201 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14775fc5-d63d-4932-8c25-1b182ca6809e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:36.388366 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 486/977] 10.222.0.25 () {56 vars in 1136 bytes} [Wed Oct 27 01:21:36 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:36.394692 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbaf414-e54e-4ccb-837a-026166d0b26a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:36.404889 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbaf414-e54e-4ccb-837a-026166d0b26a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:36.409440 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93c29b-b2a7-453a-84a9-02902eca9084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:36.410232 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93c29b-b2a7-453a-84a9-02902eca9084 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:36.410518 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93c29b-b2a7-453a-84a9-02902eca9084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:36.410797 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93c29b-b2a7-453a-84a9-02902eca9084 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:36.420713 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93c29b-b2a7-453a-84a9-02902eca9084 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:36.422587 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93c29b-b2a7-453a-84a9-02902eca9084 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:36.440548 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-7d93c29b-b2a7-453a-84a9-02902eca9084 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:36.441704 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 492/978] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:21:36.448712 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14775fc5-d63d-4932-8c25-1b182ca6809e admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:36.458266 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14775fc5-d63d-4932-8c25-1b182ca6809e admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:36.462696 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9280ef1-a098-4d9f-9414-d03c34e7f4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:36.463342 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9280ef1-a098-4d9f-9414-d03c34e7f4cf admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:36.463625 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9280ef1-a098-4d9f-9414-d03c34e7f4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:36.463902 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9280ef1-a098-4d9f-9414-d03c34e7f4cf admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:36.464634 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9280ef1-a098-4d9f-9414-d03c34e7f4cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:36.464943 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9280ef1-a098-4d9f-9414-d03c34e7f4cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:36.466528 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9280ef1-a098-4d9f-9414-d03c34e7f4cf admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:36.478313 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 487/979] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:36.484584 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93c29b-b2a7-453a-84a9-02902eca9084 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:36.494888 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93c29b-b2a7-453a-84a9-02902eca9084 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:36.499823 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e4511-b105-47de-b8e0-ac63ac05dacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:36.500603 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e4511-b105-47de-b8e0-ac63ac05dacf admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:36.500891 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e4511-b105-47de-b8e0-ac63ac05dacf admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:36.501170 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e4511-b105-47de-b8e0-ac63ac05dacf admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:36.508861 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e4511-b105-47de-b8e0-ac63ac05dacf admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:36.510871 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e4511-b105-47de-b8e0-ac63ac05dacf admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:36.524804 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-5c4e4511-b105-47de-b8e0-ac63ac05dacf admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:21:36.526122 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 493/980] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Oct 27 01:21:36 2021] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:36.532238 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9280ef1-a098-4d9f-9414-d03c34e7f4cf admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:36.542413 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9280ef1-a098-4d9f-9414-d03c34e7f4cf admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:36.546969 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8d6f8-a629-4306-9196-e3fe05507755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:36.547694 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8d6f8-a629-4306-9196-e3fe05507755 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:36.548039 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8d6f8-a629-4306-9196-e3fe05507755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:36.548384 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8d6f8-a629-4306-9196-e3fe05507755 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:36.549295 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8d6f8-a629-4306-9196-e3fe05507755 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:36.549706 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8d6f8-a629-4306-9196-e3fe05507755 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:36.551587 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8d6f8-a629-4306-9196-e3fe05507755 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:36.568949 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 488/981] 10.222.0.25 () {56 vars in 1154 bytes} [Wed Oct 27 01:21:36 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:36.576285 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e4511-b105-47de-b8e0-ac63ac05dacf admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:36.586685 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e4511-b105-47de-b8e0-ac63ac05dacf admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:36.591357 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c776574-ca38-4d1e-8913-19e9948a2d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:36.592016 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c776574-ca38-4d1e-8913-19e9948a2d09 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:36.592303 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c776574-ca38-4d1e-8913-19e9948a2d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:36.592582 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c776574-ca38-4d1e-8913-19e9948a2d09 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:36.600360 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c776574-ca38-4d1e-8913-19e9948a2d09 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:36.602121 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c776574-ca38-4d1e-8913-19e9948a2d09 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:36.611429 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 494/982] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:21:36 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:36.618033 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8d6f8-a629-4306-9196-e3fe05507755 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:36.627917 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8d6f8-a629-4306-9196-e3fe05507755 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:36.633165 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81fc36-d741-4611-b130-e26fc2ab2ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:36.633968 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81fc36-d741-4611-b130-e26fc2ab2ddf admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:36.634255 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81fc36-d741-4611-b130-e26fc2ab2ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:36.634534 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81fc36-d741-4611-b130-e26fc2ab2ddf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:36.644675 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81fc36-d741-4611-b130-e26fc2ab2ddf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:36.646712 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81fc36-d741-4611-b130-e26fc2ab2ddf admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:36.664221 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-0d81fc36-d741-4611-b130-e26fc2ab2ddf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:21:36.665539 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 489/983] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:36.671814 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c776574-ca38-4d1e-8913-19e9948a2d09 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:36.680633 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c776574-ca38-4d1e-8913-19e9948a2d09 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:36.685541 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5a56a-a601-4906-bf30-041c1e323ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:36.686213 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5a56a-a601-4906-bf30-041c1e323ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:36.686499 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5a56a-a601-4906-bf30-041c1e323ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:36.686778 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5a56a-a601-4906-bf30-041c1e323ed3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:36.687557 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5a56a-a601-4906-bf30-041c1e323ed3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:36.687865 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5a56a-a601-4906-bf30-041c1e323ed3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:36.689512 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5a56a-a601-4906-bf30-041c1e323ed3 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:36.702696 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 495/984] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:21:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:36.709182 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81fc36-d741-4611-b130-e26fc2ab2ddf admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:36.719912 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81fc36-d741-4611-b130-e26fc2ab2ddf admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:36.724480 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb667730-9ce8-4804-bb2c-9a1a7d9d4860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:36.725284 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb667730-9ce8-4804-bb2c-9a1a7d9d4860 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:36.725600 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb667730-9ce8-4804-bb2c-9a1a7d9d4860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:36.725881 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb667730-9ce8-4804-bb2c-9a1a7d9d4860 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:36.732918 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb667730-9ce8-4804-bb2c-9a1a7d9d4860 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:36.734901 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb667730-9ce8-4804-bb2c-9a1a7d9d4860 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:36.747646 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-cb667730-9ce8-4804-bb2c-9a1a7d9d4860 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:21:36.748805 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 490/985] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:21:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:36.755290 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5a56a-a601-4906-bf30-041c1e323ed3 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:36.765724 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5a56a-a601-4906-bf30-041c1e323ed3 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:36.770211 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7251bac-af1f-4f15-8150-b55a6a72a884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:36.770853 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7251bac-af1f-4f15-8150-b55a6a72a884 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:36.771140 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7251bac-af1f-4f15-8150-b55a6a72a884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:36.771442 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7251bac-af1f-4f15-8150-b55a6a72a884 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:36.772237 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7251bac-af1f-4f15-8150-b55a6a72a884 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:36.772548 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7251bac-af1f-4f15-8150-b55a6a72a884 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:36.775007 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7251bac-af1f-4f15-8150-b55a6a72a884 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:36.786946 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 496/986] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:21:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:36.793759 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb667730-9ce8-4804-bb2c-9a1a7d9d4860 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:36.803893 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb667730-9ce8-4804-bb2c-9a1a7d9d4860 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:36.808507 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91cb20-61b5-456e-8720-6248b8ef46f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:36.809158 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91cb20-61b5-456e-8720-6248b8ef46f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:36.809436 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91cb20-61b5-456e-8720-6248b8ef46f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:36.809739 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91cb20-61b5-456e-8720-6248b8ef46f9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:36.810596 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91cb20-61b5-456e-8720-6248b8ef46f9 admin admin] RBAC: Adding query filter params (role.id=41046f7a7b794737b3147350ce888a3b, scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6, user.id=b2f8304b85b64dc4ac58523897306660) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:36.810906 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91cb20-61b5-456e-8720-6248b8ef46f9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:36.812722 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91cb20-61b5-456e-8720-6248b8ef46f9 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:36.818389 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 491/987] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:21:36 2021] GET /identity/v3/role_assignments?user.id=b2f8304b85b64dc4ac58523897306660&scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6&role.id=41046f7a7b794737b3147350ce888a3b => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:37.765146 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f00c0-cd16-485c-b578-5b4103c239b4 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:37.765683 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f00c0-cd16-485c-b578-5b4103c239b4 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:37.765800 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f00c0-cd16-485c-b578-5b4103c239b4 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:37.767486 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 497/988] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:37.773752 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b82a66-e2c1-4adc-8e13-56d71628e913 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:37.774162 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b82a66-e2c1-4adc-8e13-56d71628e913 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:37.774306 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b82a66-e2c1-4adc-8e13-56d71628e913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:37.791998 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-62b82a66-e2c1-4adc-8e13-56d71628e913 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:37.793165 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-62b82a66-e2c1-4adc-8e13-56d71628e913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:37.800702 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 492/989] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:37 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:37.824407 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f00c0-cd16-485c-b578-5b4103c239b4 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:37.837106 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f00c0-cd16-485c-b578-5b4103c239b4 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:37.841462 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98953a30-72ac-46bc-92fb-da28bcb8eb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:37.842301 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98953a30-72ac-46bc-92fb-da28bcb8eb81 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:37.842588 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98953a30-72ac-46bc-92fb-da28bcb8eb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:37.842903 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98953a30-72ac-46bc-92fb-da28bcb8eb81 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:37.853826 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98953a30-72ac-46bc-92fb-da28bcb8eb81 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:21:37.860990 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-98953a30-72ac-46bc-92fb-da28bcb8eb81 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:21:37.862159 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 498/990] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:21:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:37.868413 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b82a66-e2c1-4adc-8e13-56d71628e913 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:37.877091 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b82a66-e2c1-4adc-8e13-56d71628e913 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:37.881559 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901058ca-01bf-4de2-befc-5ffe245135d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:37.882204 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901058ca-01bf-4de2-befc-5ffe245135d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:37.882486 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901058ca-01bf-4de2-befc-5ffe245135d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:37.882761 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901058ca-01bf-4de2-befc-5ffe245135d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:37.883511 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901058ca-01bf-4de2-befc-5ffe245135d2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:37.883817 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901058ca-01bf-4de2-befc-5ffe245135d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:37.885385 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901058ca-01bf-4de2-befc-5ffe245135d2 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:37.893376 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 493/991] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:21:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:37.900220 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98953a30-72ac-46bc-92fb-da28bcb8eb81 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:37.910566 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98953a30-72ac-46bc-92fb-da28bcb8eb81 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:37.915945 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c261e8f-e79d-4c3e-8090-f2d255c7ee9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:37.916840 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c261e8f-e79d-4c3e-8090-f2d255c7ee9a admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:37.917126 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c261e8f-e79d-4c3e-8090-f2d255c7ee9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:37.917426 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c261e8f-e79d-4c3e-8090-f2d255c7ee9a admin admin] PATH_INFO: `/v3/users/4f748b378f634b44968b1b8be340c983` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:37.918712 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c261e8f-e79d-4c3e-8090-f2d255c7ee9a admin admin] RBAC: Authorizing `identity:get_user(user_id=4f748b378f634b44968b1b8be340c983)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:37.920928 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c261e8f-e79d-4c3e-8090-f2d255c7ee9a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:37.922625 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 499/992] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:21:37 2021] GET /identity/v3/users/4f748b378f634b44968b1b8be340c983 => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:37.928578 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901058ca-01bf-4de2-befc-5ffe245135d2 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:37.938227 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901058ca-01bf-4de2-befc-5ffe245135d2 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:37.942640 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3e9be-f0e2-457d-8e18-588c354d9025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:37.943462 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3e9be-f0e2-457d-8e18-588c354d9025 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:37.943743 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3e9be-f0e2-457d-8e18-588c354d9025 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:37.944017 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3e9be-f0e2-457d-8e18-588c354d9025 admin admin] PATH_INFO: `/v3/projects/cd7d86467c28467780adb2bb32bc22a8` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:37.945180 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3e9be-f0e2-457d-8e18-588c354d9025 admin admin] RBAC: Authorizing `identity:get_project(project_id=cd7d86467c28467780adb2bb32bc22a8)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:37.947224 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3e9be-f0e2-457d-8e18-588c354d9025 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:37.948821 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 494/993] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:21:37 2021] GET /identity/v3/projects/cd7d86467c28467780adb2bb32bc22a8 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:37.954749 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c261e8f-e79d-4c3e-8090-f2d255c7ee9a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:37.964530 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c261e8f-e79d-4c3e-8090-f2d255c7ee9a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:37.968984 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee4c8d-2705-4e57-9feb-1004d1324ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:37.969862 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee4c8d-2705-4e57-9feb-1004d1324ae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:37.970143 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee4c8d-2705-4e57-9feb-1004d1324ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:37.970435 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee4c8d-2705-4e57-9feb-1004d1324ae9 admin admin] PATH_INFO: `/v3/projects/cd7d86467c28467780adb2bb32bc22a8/users/4f748b378f634b44968b1b8be340c983/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:37.972358 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee4c8d-2705-4e57-9feb-1004d1324ae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd7d86467c28467780adb2bb32bc22a8, user_id=4f748b378f634b44968b1b8be340c983, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:37.974978 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee4c8d-2705-4e57-9feb-1004d1324ae9 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:37.988188 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 500/994] 10.222.0.25 () {58 vars in 1460 bytes} [Wed Oct 27 01:21:37 2021] PUT /identity/v3/projects/cd7d86467c28467780adb2bb32bc22a8/users/4f748b378f634b44968b1b8be340c983/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:40.212795 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb2cff-8634-4694-a429-b6d737a85ac2 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:40.213346 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb2cff-8634-4694-a429-b6d737a85ac2 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:40.213346 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb2cff-8634-4694-a429-b6d737a85ac2 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:40.215210 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 495/995] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:40.221430 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56ebed-2c49-4391-8c8b-856c7dde1f8d None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:40.221868 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56ebed-2c49-4391-8c8b-856c7dde1f8d None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:40.221959 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56ebed-2c49-4391-8c8b-856c7dde1f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:40.239679 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-4a56ebed-2c49-4391-8c8b-856c7dde1f8d None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:40.240861 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4a56ebed-2c49-4391-8c8b-856c7dde1f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:40.294792 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 501/996] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:40 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:40.319878 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb2cff-8634-4694-a429-b6d737a85ac2 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:40.331865 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb2cff-8634-4694-a429-b6d737a85ac2 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:40.337229 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646aff7a-1c43-4fc0-9a9a-5195a76e5681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:40.338028 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646aff7a-1c43-4fc0-9a9a-5195a76e5681 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:40.338318 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646aff7a-1c43-4fc0-9a9a-5195a76e5681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:40.338599 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646aff7a-1c43-4fc0-9a9a-5195a76e5681 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:40.348493 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646aff7a-1c43-4fc0-9a9a-5195a76e5681 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:21:40.355828 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-646aff7a-1c43-4fc0-9a9a-5195a76e5681 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:21:40.356951 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 496/997] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:21:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:40.363177 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56ebed-2c49-4391-8c8b-856c7dde1f8d None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:40.371722 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56ebed-2c49-4391-8c8b-856c7dde1f8d None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:40.376245 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c41dc3-586d-4264-9cb6-ffaa530098fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:40.376886 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c41dc3-586d-4264-9cb6-ffaa530098fa admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:40.377170 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c41dc3-586d-4264-9cb6-ffaa530098fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:40.377448 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c41dc3-586d-4264-9cb6-ffaa530098fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:40.378232 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c41dc3-586d-4264-9cb6-ffaa530098fa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:40.378539 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c41dc3-586d-4264-9cb6-ffaa530098fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:40.380105 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c41dc3-586d-4264-9cb6-ffaa530098fa admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:40.389124 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 502/998] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:21:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:40.395205 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646aff7a-1c43-4fc0-9a9a-5195a76e5681 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:40.407407 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646aff7a-1c43-4fc0-9a9a-5195a76e5681 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:40.411974 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9efe04-f6fb-4362-8024-0aafdcbdcfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:40.412818 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9efe04-f6fb-4362-8024-0aafdcbdcfea admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:40.413119 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9efe04-f6fb-4362-8024-0aafdcbdcfea admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:40.413423 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9efe04-f6fb-4362-8024-0aafdcbdcfea admin admin] PATH_INFO: `/v3/users/4f748b378f634b44968b1b8be340c983` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:40.414655 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9efe04-f6fb-4362-8024-0aafdcbdcfea admin admin] RBAC: Authorizing `identity:get_user(user_id=4f748b378f634b44968b1b8be340c983)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:40.416742 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9efe04-f6fb-4362-8024-0aafdcbdcfea admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:40.418423 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 497/999] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:21:40 2021] GET /identity/v3/users/4f748b378f634b44968b1b8be340c983 => generated 285 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:40.424502 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c41dc3-586d-4264-9cb6-ffaa530098fa admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:40.434090 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c41dc3-586d-4264-9cb6-ffaa530098fa admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:40.438600 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a8bd9-9aaa-4670-bf71-964a08d2efe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:40.439221 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a8bd9-9aaa-4670-bf71-964a08d2efe3 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:40.439507 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a8bd9-9aaa-4670-bf71-964a08d2efe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:40.439787 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a8bd9-9aaa-4670-bf71-964a08d2efe3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:40.447774 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a8bd9-9aaa-4670-bf71-964a08d2efe3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:40.449506 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a8bd9-9aaa-4670-bf71-964a08d2efe3 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:40.458077 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 503/1000] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:21:40 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:40.464694 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9efe04-f6fb-4362-8024-0aafdcbdcfea admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:40.474026 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9efe04-f6fb-4362-8024-0aafdcbdcfea admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:40.483316 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5371f8-4738-4fd3-8c21-6681c3c569da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:40.484147 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5371f8-4738-4fd3-8c21-6681c3c569da admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:40.484432 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5371f8-4738-4fd3-8c21-6681c3c569da admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:40.484709 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5371f8-4738-4fd3-8c21-6681c3c569da admin admin] PATH_INFO: `/v3/projects/cd7d86467c28467780adb2bb32bc22a8` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:40.485920 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5371f8-4738-4fd3-8c21-6681c3c569da admin admin] RBAC: Authorizing `identity:get_project(project_id=cd7d86467c28467780adb2bb32bc22a8)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:40.487940 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5371f8-4738-4fd3-8c21-6681c3c569da admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:40.489619 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 498/1001] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:21:40 2021] GET /identity/v3/projects/cd7d86467c28467780adb2bb32bc22a8 => generated 311 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:40.496428 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a8bd9-9aaa-4670-bf71-964a08d2efe3 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:40.505653 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a8bd9-9aaa-4670-bf71-964a08d2efe3 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:40.510745 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b009fc-f8d5-4445-a6a7-df8487824798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:40.511384 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b009fc-f8d5-4445-a6a7-df8487824798 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:40.511687 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b009fc-f8d5-4445-a6a7-df8487824798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:40.511966 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b009fc-f8d5-4445-a6a7-df8487824798 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:40.512774 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b009fc-f8d5-4445-a6a7-df8487824798 admin admin] RBAC: Adding query filter params (role.id=df3a437e6ea14518a9c1b9a348e18c99, scope.project.id=cd7d86467c28467780adb2bb32bc22a8, user.id=4f748b378f634b44968b1b8be340c983) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:40.513086 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b009fc-f8d5-4445-a6a7-df8487824798 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:40.514964 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b009fc-f8d5-4445-a6a7-df8487824798 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:40.520586 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 504/1002] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:21:40 2021] GET /identity/v3/role_assignments?user.id=4f748b378f634b44968b1b8be340c983&scope.project.id=cd7d86467c28467780adb2bb32bc22a8&role.id=df3a437e6ea14518a9c1b9a348e18c99 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:42.753307 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5306d2-4180-426c-9f85-afab3652c14a None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:42.753881 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5306d2-4180-426c-9f85-afab3652c14a None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:42.753975 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5306d2-4180-426c-9f85-afab3652c14a None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:42.755674 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 499/1003] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:42.762243 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f785ecc-d88f-4be0-aaf9-1918785df89b None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:42.762659 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f785ecc-d88f-4be0-aaf9-1918785df89b None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:42.762807 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f785ecc-d88f-4be0-aaf9-1918785df89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:42.780625 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-2f785ecc-d88f-4be0-aaf9-1918785df89b None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:42.781854 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-2f785ecc-d88f-4be0-aaf9-1918785df89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:42.789450 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 505/1004] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:42 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:42.814610 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5306d2-4180-426c-9f85-afab3652c14a None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:42.826848 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5306d2-4180-426c-9f85-afab3652c14a None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:42.831122 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7198acc-6ca1-46f8-919b-421cb5513820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:42.831880 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7198acc-6ca1-46f8-919b-421cb5513820 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:42.832163 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7198acc-6ca1-46f8-919b-421cb5513820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:42.832440 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7198acc-6ca1-46f8-919b-421cb5513820 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:42.833623 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7198acc-6ca1-46f8-919b-421cb5513820 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:42.835862 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7198acc-6ca1-46f8-919b-421cb5513820 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:42.837389 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 500/1005] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:42 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:42.843278 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f785ecc-d88f-4be0-aaf9-1918785df89b None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:42.851982 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f785ecc-d88f-4be0-aaf9-1918785df89b None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:42.856596 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ac877-ea88-49dc-84af-90d0863aac9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:42.857237 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ac877-ea88-49dc-84af-90d0863aac9e admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:42.857557 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ac877-ea88-49dc-84af-90d0863aac9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:42.857844 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ac877-ea88-49dc-84af-90d0863aac9e admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:42.858557 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ac877-ea88-49dc-84af-90d0863aac9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:42.860435 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ac877-ea88-49dc-84af-90d0863aac9e admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:42.879001 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 506/1006] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Oct 27 01:21:42 2021] POST /identity/v3/users => generated 286 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:21:45.123952 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee166861-a1d9-42b6-adb7-4a1da2c03d4a None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:45.124461 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee166861-a1d9-42b6-adb7-4a1da2c03d4a None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:45.124547 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee166861-a1d9-42b6-adb7-4a1da2c03d4a None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:45.126292 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 501/1007] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:45.132274 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e3ef6-af96-43fe-9e15-6fb6febf3fe0 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:45.132646 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e3ef6-af96-43fe-9e15-6fb6febf3fe0 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:45.132836 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e3ef6-af96-43fe-9e15-6fb6febf3fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:45.150513 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-5c9e3ef6-af96-43fe-9e15-6fb6febf3fe0 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:45.151695 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-5c9e3ef6-af96-43fe-9e15-6fb6febf3fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:45.159257 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 507/1008] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:45 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:45.184255 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee166861-a1d9-42b6-adb7-4a1da2c03d4a None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:45.196099 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee166861-a1d9-42b6-adb7-4a1da2c03d4a None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:45.200425 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0c0be-1d3d-4973-a2f6-f1c3c6f4500a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:45.201248 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0c0be-1d3d-4973-a2f6-f1c3c6f4500a admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:45.201593 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0c0be-1d3d-4973-a2f6-f1c3c6f4500a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:45.201875 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0c0be-1d3d-4973-a2f6-f1c3c6f4500a admin admin] PATH_INFO: `/v3/roles/22382371cf4846fe84d1403e3ab1785e` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:45.203339 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0c0be-1d3d-4973-a2f6-f1c3c6f4500a admin admin] RBAC: Authorizing `identity:get_role(role_id=22382371cf4846fe84d1403e3ab1785e)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:45.204334 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING py.warnings [None req-61f0c0be-1d3d-4973-a2f6-f1c3c6f4500a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:21:45.204334 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: warnings.warn(msg) Oct 27 01:21:45.204334 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: Oct 27 01:21:45.205198 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0c0be-1d3d-4973-a2f6-f1c3c6f4500a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:45.206530 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 502/1009] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:21:45 2021] GET /identity/v3/roles/22382371cf4846fe84d1403e3ab1785e => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:45.212896 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e3ef6-af96-43fe-9e15-6fb6febf3fe0 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:45.221700 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e3ef6-af96-43fe-9e15-6fb6febf3fe0 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:45.226846 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72e995-42e3-4afc-8fa2-ec478ba3567f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:45.227693 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72e995-42e3-4afc-8fa2-ec478ba3567f admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:45.227979 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72e995-42e3-4afc-8fa2-ec478ba3567f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:45.228258 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72e995-42e3-4afc-8fa2-ec478ba3567f admin admin] PATH_INFO: `/v3/users/0e415f6d85464dac8814d9c6c7655c70` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:45.241040 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72e995-42e3-4afc-8fa2-ec478ba3567f admin admin] RBAC: Authorizing `identity:get_user(user_id=0e415f6d85464dac8814d9c6c7655c70)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:45.243172 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72e995-42e3-4afc-8fa2-ec478ba3567f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:45.244745 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 508/1010] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:21:45 2021] GET /identity/v3/users/0e415f6d85464dac8814d9c6c7655c70 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:45.250855 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0c0be-1d3d-4973-a2f6-f1c3c6f4500a admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:45.260047 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0c0be-1d3d-4973-a2f6-f1c3c6f4500a admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:45.264500 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38aebd-e0e6-4eb7-8a16-95df75a1e270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:45.265106 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38aebd-e0e6-4eb7-8a16-95df75a1e270 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:45.265392 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38aebd-e0e6-4eb7-8a16-95df75a1e270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:45.265710 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38aebd-e0e6-4eb7-8a16-95df75a1e270 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:45.273786 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38aebd-e0e6-4eb7-8a16-95df75a1e270 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:45.275468 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38aebd-e0e6-4eb7-8a16-95df75a1e270 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:45.284130 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 503/1011] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:21:45 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:45.290557 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72e995-42e3-4afc-8fa2-ec478ba3567f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:45.299614 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72e995-42e3-4afc-8fa2-ec478ba3567f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:45.304052 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a2d79-8974-43a5-b0e9-e7a301766885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:45.304848 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a2d79-8974-43a5-b0e9-e7a301766885 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:45.305134 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a2d79-8974-43a5-b0e9-e7a301766885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:45.305415 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a2d79-8974-43a5-b0e9-e7a301766885 admin admin] PATH_INFO: `/v3/projects/cd7d86467c28467780adb2bb32bc22a8` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:45.306602 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a2d79-8974-43a5-b0e9-e7a301766885 admin admin] RBAC: Authorizing `identity:get_project(project_id=cd7d86467c28467780adb2bb32bc22a8)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:45.308865 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a2d79-8974-43a5-b0e9-e7a301766885 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:45.310668 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 509/1012] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:21:45 2021] GET /identity/v3/projects/cd7d86467c28467780adb2bb32bc22a8 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:45.316492 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38aebd-e0e6-4eb7-8a16-95df75a1e270 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:45.324737 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38aebd-e0e6-4eb7-8a16-95df75a1e270 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:45.329162 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa38e5-3cb3-4e93-953d-85432fa19c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:45.329819 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa38e5-3cb3-4e93-953d-85432fa19c29 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:45.330106 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa38e5-3cb3-4e93-953d-85432fa19c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:45.330384 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa38e5-3cb3-4e93-953d-85432fa19c29 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:45.331190 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa38e5-3cb3-4e93-953d-85432fa19c29 admin admin] RBAC: Adding query filter params (role.id=22382371cf4846fe84d1403e3ab1785e, scope.project.id=cd7d86467c28467780adb2bb32bc22a8, user.id=0e415f6d85464dac8814d9c6c7655c70) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:45.331502 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa38e5-3cb3-4e93-953d-85432fa19c29 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:45.333239 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa38e5-3cb3-4e93-953d-85432fa19c29 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:45.339033 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 504/1013] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:21:45 2021] GET /identity/v3/role_assignments?user.id=0e415f6d85464dac8814d9c6c7655c70&scope.project.id=cd7d86467c28467780adb2bb32bc22a8&role.id=22382371cf4846fe84d1403e3ab1785e => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:47.538201 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad8e01-af28-48f7-bca8-07b7122329bd None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:47.538731 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad8e01-af28-48f7-bca8-07b7122329bd None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:47.538731 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad8e01-af28-48f7-bca8-07b7122329bd None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:47.541030 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 510/1014] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:47.546875 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f57c51-6f1e-4713-b15a-224d946b16ec None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:47.547282 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f57c51-6f1e-4713-b15a-224d946b16ec None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:47.547435 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f57c51-6f1e-4713-b15a-224d946b16ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:47.564659 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-07f57c51-6f1e-4713-b15a-224d946b16ec None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:47.565862 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-07f57c51-6f1e-4713-b15a-224d946b16ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:47.573702 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 505/1015] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:47 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:21:47.597107 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad8e01-af28-48f7-bca8-07b7122329bd None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:47.609443 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad8e01-af28-48f7-bca8-07b7122329bd None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:47.613764 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1e21a-e495-4567-8d9f-82957fc2c279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:47.614577 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1e21a-e495-4567-8d9f-82957fc2c279 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:47.614855 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1e21a-e495-4567-8d9f-82957fc2c279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:47.615125 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1e21a-e495-4567-8d9f-82957fc2c279 admin admin] PATH_INFO: `/v3/roles/22382371cf4846fe84d1403e3ab1785e` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:47.616568 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1e21a-e495-4567-8d9f-82957fc2c279 admin admin] RBAC: Authorizing `identity:get_role(role_id=22382371cf4846fe84d1403e3ab1785e)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:47.617589 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING py.warnings [None req-ecd1e21a-e495-4567-8d9f-82957fc2c279 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:21:47.617589 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: warnings.warn(msg) Oct 27 01:21:47.617589 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: Oct 27 01:21:47.618460 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1e21a-e495-4567-8d9f-82957fc2c279 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:47.619738 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 511/1016] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:21:47 2021] GET /identity/v3/roles/22382371cf4846fe84d1403e3ab1785e => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:47.625760 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f57c51-6f1e-4713-b15a-224d946b16ec None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:47.634285 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f57c51-6f1e-4713-b15a-224d946b16ec None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:47.638695 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53860c2c-0c80-4dbf-ab11-03b14c466f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:47.639556 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53860c2c-0c80-4dbf-ab11-03b14c466f05 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:47.639837 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53860c2c-0c80-4dbf-ab11-03b14c466f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:47.640110 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53860c2c-0c80-4dbf-ab11-03b14c466f05 admin admin] PATH_INFO: `/v3/users/0e415f6d85464dac8814d9c6c7655c70` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:47.641299 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53860c2c-0c80-4dbf-ab11-03b14c466f05 admin admin] RBAC: Authorizing `identity:get_user(user_id=0e415f6d85464dac8814d9c6c7655c70)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:47.643405 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53860c2c-0c80-4dbf-ab11-03b14c466f05 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:47.644937 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 506/1017] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:21:47 2021] GET /identity/v3/users/0e415f6d85464dac8814d9c6c7655c70 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:47.651233 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1e21a-e495-4567-8d9f-82957fc2c279 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:47.660428 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1e21a-e495-4567-8d9f-82957fc2c279 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:47.665629 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e7a99-3f9c-4ada-aeed-2a18cada4f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:47.666420 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e7a99-3f9c-4ada-aeed-2a18cada4f07 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:47.666706 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e7a99-3f9c-4ada-aeed-2a18cada4f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:47.666986 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e7a99-3f9c-4ada-aeed-2a18cada4f07 admin admin] PATH_INFO: `/v3/projects/cd7d86467c28467780adb2bb32bc22a8` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:47.668153 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e7a99-3f9c-4ada-aeed-2a18cada4f07 admin admin] RBAC: Authorizing `identity:get_project(project_id=cd7d86467c28467780adb2bb32bc22a8)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:47.670178 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e7a99-3f9c-4ada-aeed-2a18cada4f07 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:47.671769 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 512/1018] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:21:47 2021] GET /identity/v3/projects/cd7d86467c28467780adb2bb32bc22a8 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:47.677582 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53860c2c-0c80-4dbf-ab11-03b14c466f05 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:47.686878 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53860c2c-0c80-4dbf-ab11-03b14c466f05 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:47.691263 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132bf66-5223-44a4-bcc4-44f1e53d44c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:47.692073 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132bf66-5223-44a4-bcc4-44f1e53d44c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:47.692353 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132bf66-5223-44a4-bcc4-44f1e53d44c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:47.692629 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132bf66-5223-44a4-bcc4-44f1e53d44c2 admin admin] PATH_INFO: `/v3/projects/cd7d86467c28467780adb2bb32bc22a8/users/0e415f6d85464dac8814d9c6c7655c70/roles/22382371cf4846fe84d1403e3ab1785e` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:47.694845 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132bf66-5223-44a4-bcc4-44f1e53d44c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd7d86467c28467780adb2bb32bc22a8, user_id=0e415f6d85464dac8814d9c6c7655c70, role_id=22382371cf4846fe84d1403e3ab1785e)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:47.697354 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132bf66-5223-44a4-bcc4-44f1e53d44c2 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:47.710330 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 507/1019] 10.222.0.25 () {58 vars in 1460 bytes} [Wed Oct 27 01:21:47 2021] PUT /identity/v3/projects/cd7d86467c28467780adb2bb32bc22a8/users/0e415f6d85464dac8814d9c6c7655c70/roles/22382371cf4846fe84d1403e3ab1785e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:21:49.924884 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e527d8e-7fa6-4df2-b365-5f303def7d06 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:49.925413 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e527d8e-7fa6-4df2-b365-5f303def7d06 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:49.925555 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e527d8e-7fa6-4df2-b365-5f303def7d06 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:49.927280 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 513/1020] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:49.933418 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b687a-833c-49aa-adad-543897ea1a1d None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:49.933808 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b687a-833c-49aa-adad-543897ea1a1d None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:49.934012 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b687a-833c-49aa-adad-543897ea1a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:49.951085 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-722b687a-833c-49aa-adad-543897ea1a1d None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:49.952272 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-722b687a-833c-49aa-adad-543897ea1a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:50.006985 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 508/1021] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:49 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:50.031777 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e527d8e-7fa6-4df2-b365-5f303def7d06 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:50.044422 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e527d8e-7fa6-4df2-b365-5f303def7d06 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:50.048873 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8396475-2127-4480-be18-a5b54cd5396e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:50.049743 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8396475-2127-4480-be18-a5b54cd5396e admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:50.050030 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8396475-2127-4480-be18-a5b54cd5396e admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:50.050313 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8396475-2127-4480-be18-a5b54cd5396e admin admin] PATH_INFO: `/v3/roles/22382371cf4846fe84d1403e3ab1785e` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:50.051781 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8396475-2127-4480-be18-a5b54cd5396e admin admin] RBAC: Authorizing `identity:get_role(role_id=22382371cf4846fe84d1403e3ab1785e)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:50.053385 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8396475-2127-4480-be18-a5b54cd5396e admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:50.054719 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 514/1022] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:21:50 2021] GET /identity/v3/roles/22382371cf4846fe84d1403e3ab1785e => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:50.060896 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b687a-833c-49aa-adad-543897ea1a1d None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:50.069983 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b687a-833c-49aa-adad-543897ea1a1d None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:50.074417 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77656d-64b0-474f-afbd-e8360a54794d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:50.075262 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77656d-64b0-474f-afbd-e8360a54794d admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:50.075543 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77656d-64b0-474f-afbd-e8360a54794d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:50.075815 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77656d-64b0-474f-afbd-e8360a54794d admin admin] PATH_INFO: `/v3/users/0e415f6d85464dac8814d9c6c7655c70` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:50.076999 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77656d-64b0-474f-afbd-e8360a54794d admin admin] RBAC: Authorizing `identity:get_user(user_id=0e415f6d85464dac8814d9c6c7655c70)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:50.079113 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77656d-64b0-474f-afbd-e8360a54794d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:50.080655 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 509/1023] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:21:50 2021] GET /identity/v3/users/0e415f6d85464dac8814d9c6c7655c70 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:50.087245 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8396475-2127-4480-be18-a5b54cd5396e admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:50.096300 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8396475-2127-4480-be18-a5b54cd5396e admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:50.100796 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aabfd4-4cc0-404d-920a-22895aaffb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:50.101388 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aabfd4-4cc0-404d-920a-22895aaffb4f admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:50.101705 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aabfd4-4cc0-404d-920a-22895aaffb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:50.101988 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aabfd4-4cc0-404d-920a-22895aaffb4f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:50.109457 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aabfd4-4cc0-404d-920a-22895aaffb4f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:50.111139 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aabfd4-4cc0-404d-920a-22895aaffb4f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:50.119773 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 515/1024] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:21:50 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:50.125709 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77656d-64b0-474f-afbd-e8360a54794d admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:50.135213 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77656d-64b0-474f-afbd-e8360a54794d admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:50.139651 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d2305-b9b4-4149-a641-c14ed807a728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:50.140431 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d2305-b9b4-4149-a641-c14ed807a728 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:50.140716 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d2305-b9b4-4149-a641-c14ed807a728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:50.140994 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d2305-b9b4-4149-a641-c14ed807a728 admin admin] PATH_INFO: `/v3/projects/cd7d86467c28467780adb2bb32bc22a8` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:50.142294 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d2305-b9b4-4149-a641-c14ed807a728 admin admin] RBAC: Authorizing `identity:get_project(project_id=cd7d86467c28467780adb2bb32bc22a8)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:50.144262 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d2305-b9b4-4149-a641-c14ed807a728 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:50.145919 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 510/1025] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:21:50 2021] GET /identity/v3/projects/cd7d86467c28467780adb2bb32bc22a8 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:50.152674 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aabfd4-4cc0-404d-920a-22895aaffb4f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:50.160988 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aabfd4-4cc0-404d-920a-22895aaffb4f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:50.165573 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1bdad-3b46-4d0d-bf61-a5e89a82b0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:50.166179 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1bdad-3b46-4d0d-bf61-a5e89a82b0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:50.166466 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1bdad-3b46-4d0d-bf61-a5e89a82b0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:50.166747 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1bdad-3b46-4d0d-bf61-a5e89a82b0b2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:50.167559 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1bdad-3b46-4d0d-bf61-a5e89a82b0b2 admin admin] RBAC: Adding query filter params (role.id=22382371cf4846fe84d1403e3ab1785e, scope.project.id=cd7d86467c28467780adb2bb32bc22a8, user.id=0e415f6d85464dac8814d9c6c7655c70) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:50.167872 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1bdad-3b46-4d0d-bf61-a5e89a82b0b2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:50.169667 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1bdad-3b46-4d0d-bf61-a5e89a82b0b2 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:50.175401 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 516/1026] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:21:50 2021] GET /identity/v3/role_assignments?user.id=0e415f6d85464dac8814d9c6c7655c70&scope.project.id=cd7d86467c28467780adb2bb32bc22a8&role.id=22382371cf4846fe84d1403e3ab1785e => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:52.419696 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b895d0a-55fa-43f8-8b18-09f6026187f0 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:52.420209 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b895d0a-55fa-43f8-8b18-09f6026187f0 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:52.420321 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b895d0a-55fa-43f8-8b18-09f6026187f0 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:52.422070 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 511/1027] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:52.427867 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff717a97-bd55-4722-862a-3a97b335f923 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:52.428239 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff717a97-bd55-4722-862a-3a97b335f923 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:52.428460 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff717a97-bd55-4722-862a-3a97b335f923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:52.446355 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-ff717a97-bd55-4722-862a-3a97b335f923 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:52.447537 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-ff717a97-bd55-4722-862a-3a97b335f923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:52.455532 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 517/1028] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:52 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:52.481033 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b895d0a-55fa-43f8-8b18-09f6026187f0 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:52.492921 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b895d0a-55fa-43f8-8b18-09f6026187f0 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:52.497204 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d6f81-3bcb-4d8e-a463-6d5dfd7a7f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:52.498029 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d6f81-3bcb-4d8e-a463-6d5dfd7a7f98 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:52.498316 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d6f81-3bcb-4d8e-a463-6d5dfd7a7f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:52.498594 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d6f81-3bcb-4d8e-a463-6d5dfd7a7f98 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:52.499758 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d6f81-3bcb-4d8e-a463-6d5dfd7a7f98 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:52.501408 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d6f81-3bcb-4d8e-a463-6d5dfd7a7f98 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:52.502988 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 512/1029] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:52 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:52.509351 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff717a97-bd55-4722-862a-3a97b335f923 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:52.518012 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff717a97-bd55-4722-862a-3a97b335f923 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:52.523069 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580b42e-aed0-4590-87f8-ee2adeba000f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:52.523712 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580b42e-aed0-4590-87f8-ee2adeba000f admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:52.524001 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580b42e-aed0-4590-87f8-ee2adeba000f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:52.524281 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580b42e-aed0-4590-87f8-ee2adeba000f admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:52.524990 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7580b42e-aed0-4590-87f8-ee2adeba000f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:52.526885 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7580b42e-aed0-4590-87f8-ee2adeba000f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:52.550754 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 518/1030] 10.222.0.25 () {60 vars in 1162 bytes} [Wed Oct 27 01:21:52 2021] POST /identity/v3/projects => generated 311 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:21:54.802149 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac7413-c320-4635-bad5-dde6c9068c02 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:54.802735 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac7413-c320-4635-bad5-dde6c9068c02 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:54.802735 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac7413-c320-4635-bad5-dde6c9068c02 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:54.805150 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 513/1031] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:54.811259 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8467a-7ffe-444a-87ef-1e5a760ca566 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:54.811652 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8467a-7ffe-444a-87ef-1e5a760ca566 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:54.811824 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8467a-7ffe-444a-87ef-1e5a760ca566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:54.828885 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-8fa8467a-7ffe-444a-87ef-1e5a760ca566 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:54.830101 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-8fa8467a-7ffe-444a-87ef-1e5a760ca566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:54.884567 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 519/1032] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:54 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:54.910145 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac7413-c320-4635-bad5-dde6c9068c02 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:54.922611 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac7413-c320-4635-bad5-dde6c9068c02 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:54.926914 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fbae0-c00d-44b8-938d-82d5a30bfbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:54.927682 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fbae0-c00d-44b8-938d-82d5a30bfbb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:54.927967 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fbae0-c00d-44b8-938d-82d5a30bfbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:54.928248 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fbae0-c00d-44b8-938d-82d5a30bfbb2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:54.929413 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fbae0-c00d-44b8-938d-82d5a30bfbb2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:54.931099 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fbae0-c00d-44b8-938d-82d5a30bfbb2 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:54.932905 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 514/1033] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:21:54 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:54.938743 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8467a-7ffe-444a-87ef-1e5a760ca566 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:54.947427 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8467a-7ffe-444a-87ef-1e5a760ca566 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:54.951928 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbaa02-f1cb-46ed-9244-17ea92e5012f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:54.952575 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbaa02-f1cb-46ed-9244-17ea92e5012f admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:54.952862 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbaa02-f1cb-46ed-9244-17ea92e5012f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:54.953141 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbaa02-f1cb-46ed-9244-17ea92e5012f admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:54.953883 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbbaa02-f1cb-46ed-9244-17ea92e5012f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:54.955796 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbbaa02-f1cb-46ed-9244-17ea92e5012f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:54.977250 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 520/1034] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Oct 27 01:21:54 2021] POST /identity/v3/users => generated 286 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:21:57.247663 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36f50a-a219-40f8-a62b-4ae1319ce771 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:57.248175 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36f50a-a219-40f8-a62b-4ae1319ce771 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:57.248175 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36f50a-a219-40f8-a62b-4ae1319ce771 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:57.249981 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 515/1035] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:57.255862 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439d056-f385-4412-b4d7-a6f513ad703f None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:57.256329 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439d056-f385-4412-b4d7-a6f513ad703f None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:57.256458 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439d056-f385-4412-b4d7-a6f513ad703f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:57.274588 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-4439d056-f385-4412-b4d7-a6f513ad703f None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:57.275763 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4439d056-f385-4412-b4d7-a6f513ad703f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:57.283212 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 521/1036] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:57 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:57.318709 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36f50a-a219-40f8-a62b-4ae1319ce771 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:57.330699 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36f50a-a219-40f8-a62b-4ae1319ce771 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:57.335518 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402e6b7-c42b-4875-a194-164c82b1084e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:57.336279 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402e6b7-c42b-4875-a194-164c82b1084e admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:57.336562 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402e6b7-c42b-4875-a194-164c82b1084e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:57.336838 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402e6b7-c42b-4875-a194-164c82b1084e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:57.346636 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402e6b7-c42b-4875-a194-164c82b1084e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:21:57.354222 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-7402e6b7-c42b-4875-a194-164c82b1084e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:21:57.355342 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 516/1037] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:21:57 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:57.361931 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439d056-f385-4412-b4d7-a6f513ad703f None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:57.370730 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439d056-f385-4412-b4d7-a6f513ad703f None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:57.375239 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5f35f-592e-4f64-bac0-cd33d2ee0dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:57.375894 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5f35f-592e-4f64-bac0-cd33d2ee0dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:57.376181 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5f35f-592e-4f64-bac0-cd33d2ee0dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:57.376461 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5f35f-592e-4f64-bac0-cd33d2ee0dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:57.377225 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5f35f-592e-4f64-bac0-cd33d2ee0dc5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:57.377570 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5f35f-592e-4f64-bac0-cd33d2ee0dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:57.379177 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5f35f-592e-4f64-bac0-cd33d2ee0dc5 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:57.387225 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 522/1038] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:21:57 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:57.393175 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402e6b7-c42b-4875-a194-164c82b1084e admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:57.403409 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402e6b7-c42b-4875-a194-164c82b1084e admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:57.407820 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697021e-80a1-4019-9acb-09b31267fb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:57.408640 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697021e-80a1-4019-9acb-09b31267fb87 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:57.408926 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697021e-80a1-4019-9acb-09b31267fb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:57.409204 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697021e-80a1-4019-9acb-09b31267fb87 admin admin] PATH_INFO: `/v3/users/e286c2e89b884ab3ad3bd157a549016f` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:57.422406 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697021e-80a1-4019-9acb-09b31267fb87 admin admin] RBAC: Authorizing `identity:get_user(user_id=e286c2e89b884ab3ad3bd157a549016f)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:57.424488 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697021e-80a1-4019-9acb-09b31267fb87 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:57.426084 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 517/1039] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:21:57 2021] GET /identity/v3/users/e286c2e89b884ab3ad3bd157a549016f => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:57.432309 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5f35f-592e-4f64-bac0-cd33d2ee0dc5 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:57.441806 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5f35f-592e-4f64-bac0-cd33d2ee0dc5 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:57.446297 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae74c80-d390-4d44-b9e7-666e55476851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:57.446915 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae74c80-d390-4d44-b9e7-666e55476851 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:57.447199 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae74c80-d390-4d44-b9e7-666e55476851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:57.447477 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae74c80-d390-4d44-b9e7-666e55476851 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:57.454991 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae74c80-d390-4d44-b9e7-666e55476851 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:57.456696 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae74c80-d390-4d44-b9e7-666e55476851 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:57.465808 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 523/1040] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:21:57 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:57.471812 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697021e-80a1-4019-9acb-09b31267fb87 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:57.481679 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697021e-80a1-4019-9acb-09b31267fb87 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:57.486386 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7f497-e2d7-40bc-bfa0-66e9adcc5441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:57.487201 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7f497-e2d7-40bc-bfa0-66e9adcc5441 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:57.487482 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7f497-e2d7-40bc-bfa0-66e9adcc5441 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:57.487756 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7f497-e2d7-40bc-bfa0-66e9adcc5441 admin admin] PATH_INFO: `/v3/projects/1c2561d46a214d4e90408d58a46cf8d8` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:57.488909 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7f497-e2d7-40bc-bfa0-66e9adcc5441 admin admin] RBAC: Authorizing `identity:get_project(project_id=1c2561d46a214d4e90408d58a46cf8d8)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:57.490916 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7f497-e2d7-40bc-bfa0-66e9adcc5441 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:57.492502 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 518/1041] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:21:57 2021] GET /identity/v3/projects/1c2561d46a214d4e90408d58a46cf8d8 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:57.498629 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae74c80-d390-4d44-b9e7-666e55476851 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:57.506951 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae74c80-d390-4d44-b9e7-666e55476851 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:57.511462 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a288d7-f596-4a51-bc58-ec6b1cb9f4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:57.512068 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a288d7-f596-4a51-bc58-ec6b1cb9f4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:57.512353 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a288d7-f596-4a51-bc58-ec6b1cb9f4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:57.512634 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a288d7-f596-4a51-bc58-ec6b1cb9f4d5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:57.513444 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a288d7-f596-4a51-bc58-ec6b1cb9f4d5 admin admin] RBAC: Adding query filter params (role.id=df3a437e6ea14518a9c1b9a348e18c99, scope.project.id=1c2561d46a214d4e90408d58a46cf8d8, user.id=e286c2e89b884ab3ad3bd157a549016f) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:57.513790 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a288d7-f596-4a51-bc58-ec6b1cb9f4d5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:57.515563 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a288d7-f596-4a51-bc58-ec6b1cb9f4d5 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:57.521125 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 524/1042] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:21:57 2021] GET /identity/v3/role_assignments?user.id=e286c2e89b884ab3ad3bd157a549016f&scope.project.id=1c2561d46a214d4e90408d58a46cf8d8&role.id=df3a437e6ea14518a9c1b9a348e18c99 => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:59.715204 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c5335-2424-4003-aaf9-0566f479bfad None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:59.715760 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c5335-2424-4003-aaf9-0566f479bfad None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:59.715760 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c5335-2424-4003-aaf9-0566f479bfad None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:59.717541 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 519/1043] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:21:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:21:59.723531 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762d23f-f5f3-44a6-a66a-95f66bcfc287 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:59.723926 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762d23f-f5f3-44a6-a66a-95f66bcfc287 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:59.724086 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762d23f-f5f3-44a6-a66a-95f66bcfc287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:59.741947 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-e762d23f-f5f3-44a6-a66a-95f66bcfc287 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:59.743124 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-e762d23f-f5f3-44a6-a66a-95f66bcfc287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:59.750751 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 525/1044] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:21:59 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:59.773596 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c5335-2424-4003-aaf9-0566f479bfad None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:59.785338 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c5335-2424-4003-aaf9-0566f479bfad None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:59.790341 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd93fe4-1981-414c-994e-c0cebf6a3273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:59.791100 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd93fe4-1981-414c-994e-c0cebf6a3273 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:59.791388 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd93fe4-1981-414c-994e-c0cebf6a3273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:59.791668 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd93fe4-1981-414c-994e-c0cebf6a3273 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:59.801509 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd93fe4-1981-414c-994e-c0cebf6a3273 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:21:59.808668 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-6bd93fe4-1981-414c-994e-c0cebf6a3273 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:21:59.809821 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 520/1045] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:21:59 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:21:59.816094 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762d23f-f5f3-44a6-a66a-95f66bcfc287 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:59.825217 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762d23f-f5f3-44a6-a66a-95f66bcfc287 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:59.829732 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56588d35-b97c-4ce9-9671-ca9f912dcf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:59.830373 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56588d35-b97c-4ce9-9671-ca9f912dcf14 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:59.830656 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56588d35-b97c-4ce9-9671-ca9f912dcf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:59.830972 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56588d35-b97c-4ce9-9671-ca9f912dcf14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:59.831730 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56588d35-b97c-4ce9-9671-ca9f912dcf14 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:59.832038 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56588d35-b97c-4ce9-9671-ca9f912dcf14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:59.833633 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56588d35-b97c-4ce9-9671-ca9f912dcf14 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:59.842164 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 526/1046] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:21:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:59.848227 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd93fe4-1981-414c-994e-c0cebf6a3273 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:59.858050 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd93fe4-1981-414c-994e-c0cebf6a3273 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:59.862505 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3accb2d-3a4f-4cbb-b500-58b0b1f0264e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:59.863320 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3accb2d-3a4f-4cbb-b500-58b0b1f0264e admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:59.863605 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3accb2d-3a4f-4cbb-b500-58b0b1f0264e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:59.863881 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3accb2d-3a4f-4cbb-b500-58b0b1f0264e admin admin] PATH_INFO: `/v3/users/e286c2e89b884ab3ad3bd157a549016f` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:59.865067 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3accb2d-3a4f-4cbb-b500-58b0b1f0264e admin admin] RBAC: Authorizing `identity:get_user(user_id=e286c2e89b884ab3ad3bd157a549016f)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:59.867203 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3accb2d-3a4f-4cbb-b500-58b0b1f0264e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:59.868748 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 521/1047] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:21:59 2021] GET /identity/v3/users/e286c2e89b884ab3ad3bd157a549016f => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:59.874572 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56588d35-b97c-4ce9-9671-ca9f912dcf14 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:59.884140 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56588d35-b97c-4ce9-9671-ca9f912dcf14 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:59.888617 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb964f-20f5-4599-84b3-898134fbc5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:59.889425 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb964f-20f5-4599-84b3-898134fbc5da admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:59.889740 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb964f-20f5-4599-84b3-898134fbc5da admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:59.890017 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb964f-20f5-4599-84b3-898134fbc5da admin admin] PATH_INFO: `/v3/projects/1c2561d46a214d4e90408d58a46cf8d8` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:59.891174 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb964f-20f5-4599-84b3-898134fbc5da admin admin] RBAC: Authorizing `identity:get_project(project_id=1c2561d46a214d4e90408d58a46cf8d8)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:59.893155 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb964f-20f5-4599-84b3-898134fbc5da admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:59.894777 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 527/1048] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:21:59 2021] GET /identity/v3/projects/1c2561d46a214d4e90408d58a46cf8d8 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:59.901327 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3accb2d-3a4f-4cbb-b500-58b0b1f0264e admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:59.910560 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3accb2d-3a4f-4cbb-b500-58b0b1f0264e admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:59.915034 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6069b-9c1c-45db-ba45-fadd64c92226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:59.915893 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6069b-9c1c-45db-ba45-fadd64c92226 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:59.916206 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6069b-9c1c-45db-ba45-fadd64c92226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:59.916509 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6069b-9c1c-45db-ba45-fadd64c92226 admin admin] PATH_INFO: `/v3/projects/1c2561d46a214d4e90408d58a46cf8d8/users/e286c2e89b884ab3ad3bd157a549016f/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:59.918482 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6069b-9c1c-45db-ba45-fadd64c92226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c2561d46a214d4e90408d58a46cf8d8, user_id=e286c2e89b884ab3ad3bd157a549016f, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:59.921075 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6069b-9c1c-45db-ba45-fadd64c92226 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:59.935468 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 522/1049] 10.222.0.25 () {58 vars in 1460 bytes} [Wed Oct 27 01:21:59 2021] PUT /identity/v3/projects/1c2561d46a214d4e90408d58a46cf8d8/users/e286c2e89b884ab3ad3bd157a549016f/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:22:02.141855 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed46e89-9f84-490b-a7d9-8a215f567810 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:02.142437 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed46e89-9f84-490b-a7d9-8a215f567810 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:02.142437 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed46e89-9f84-490b-a7d9-8a215f567810 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:02.144176 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 528/1050] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:22:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:22:02.150791 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bb2b9-a5f1-4b46-93f1-875420d9d4b7 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:02.151201 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bb2b9-a5f1-4b46-93f1-875420d9d4b7 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:02.151361 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bb2b9-a5f1-4b46-93f1-875420d9d4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:02.168447 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-915bb2b9-a5f1-4b46-93f1-875420d9d4b7 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:02.169674 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-915bb2b9-a5f1-4b46-93f1-875420d9d4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:02.223958 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 523/1051] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:22:02 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:02.247719 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed46e89-9f84-490b-a7d9-8a215f567810 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:02.260306 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed46e89-9f84-490b-a7d9-8a215f567810 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:02.264710 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d64fe3-0859-4ff1-8cab-6d880a6aa558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:02.265495 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d64fe3-0859-4ff1-8cab-6d880a6aa558 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:02.265795 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d64fe3-0859-4ff1-8cab-6d880a6aa558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:02.266078 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d64fe3-0859-4ff1-8cab-6d880a6aa558 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:02.276597 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d64fe3-0859-4ff1-8cab-6d880a6aa558 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:22:02.283437 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-c8d64fe3-0859-4ff1-8cab-6d880a6aa558 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:22:02.284563 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 529/1052] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:22:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:22:02.290717 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bb2b9-a5f1-4b46-93f1-875420d9d4b7 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:02.299193 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bb2b9-a5f1-4b46-93f1-875420d9d4b7 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:02.303634 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e213d-74d8-4264-a24a-354b077a5e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:02.304272 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e213d-74d8-4264-a24a-354b077a5e98 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:02.304551 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e213d-74d8-4264-a24a-354b077a5e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:02.304825 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e213d-74d8-4264-a24a-354b077a5e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:02.305597 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e213d-74d8-4264-a24a-354b077a5e98 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:22:02.305902 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e213d-74d8-4264-a24a-354b077a5e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:02.307708 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e213d-74d8-4264-a24a-354b077a5e98 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:02.315531 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 524/1053] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:22:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:22:02.321982 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d64fe3-0859-4ff1-8cab-6d880a6aa558 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:02.331892 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d64fe3-0859-4ff1-8cab-6d880a6aa558 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:02.337094 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e3abe-aa0d-4cc9-8f3b-3dbe9152f29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:02.337952 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e3abe-aa0d-4cc9-8f3b-3dbe9152f29f admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:02.338239 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e3abe-aa0d-4cc9-8f3b-3dbe9152f29f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:02.338516 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e3abe-aa0d-4cc9-8f3b-3dbe9152f29f admin admin] PATH_INFO: `/v3/users/e286c2e89b884ab3ad3bd157a549016f` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:02.339715 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e3abe-aa0d-4cc9-8f3b-3dbe9152f29f admin admin] RBAC: Authorizing `identity:get_user(user_id=e286c2e89b884ab3ad3bd157a549016f)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:02.341866 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e3abe-aa0d-4cc9-8f3b-3dbe9152f29f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:02.343471 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 530/1054] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:22:02 2021] GET /identity/v3/users/e286c2e89b884ab3ad3bd157a549016f => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:22:02.349588 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e213d-74d8-4264-a24a-354b077a5e98 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:02.358753 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e213d-74d8-4264-a24a-354b077a5e98 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:02.363105 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014354cb-da8e-40aa-b3de-7e4af74b568a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:02.363717 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014354cb-da8e-40aa-b3de-7e4af74b568a admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:02.363997 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014354cb-da8e-40aa-b3de-7e4af74b568a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:02.364271 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014354cb-da8e-40aa-b3de-7e4af74b568a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:02.371682 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014354cb-da8e-40aa-b3de-7e4af74b568a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:02.373370 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014354cb-da8e-40aa-b3de-7e4af74b568a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:02.382353 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 525/1055] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:22:02 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:22:02.388387 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e3abe-aa0d-4cc9-8f3b-3dbe9152f29f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:02.397685 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e3abe-aa0d-4cc9-8f3b-3dbe9152f29f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:02.402190 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1d80e-619b-40e2-8007-300a5714644a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:02.402984 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1d80e-619b-40e2-8007-300a5714644a admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:02.403270 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1d80e-619b-40e2-8007-300a5714644a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:02.403557 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1d80e-619b-40e2-8007-300a5714644a admin admin] PATH_INFO: `/v3/projects/1c2561d46a214d4e90408d58a46cf8d8` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:02.404719 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1d80e-619b-40e2-8007-300a5714644a admin admin] RBAC: Authorizing `identity:get_project(project_id=1c2561d46a214d4e90408d58a46cf8d8)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:02.406740 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1d80e-619b-40e2-8007-300a5714644a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:02.408330 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 531/1056] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:22:02 2021] GET /identity/v3/projects/1c2561d46a214d4e90408d58a46cf8d8 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:22:02.414524 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014354cb-da8e-40aa-b3de-7e4af74b568a admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:02.422942 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014354cb-da8e-40aa-b3de-7e4af74b568a admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:02.427372 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4608c-88ae-40d3-9ea1-1ec0e1e97184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:02.428488 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4608c-88ae-40d3-9ea1-1ec0e1e97184 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:02.428769 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4608c-88ae-40d3-9ea1-1ec0e1e97184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:02.429040 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4608c-88ae-40d3-9ea1-1ec0e1e97184 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:02.429952 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4608c-88ae-40d3-9ea1-1ec0e1e97184 admin admin] RBAC: Adding query filter params (role.id=df3a437e6ea14518a9c1b9a348e18c99, scope.project.id=1c2561d46a214d4e90408d58a46cf8d8, user.id=e286c2e89b884ab3ad3bd157a549016f) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:22:02.430264 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4608c-88ae-40d3-9ea1-1ec0e1e97184 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:02.432026 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4608c-88ae-40d3-9ea1-1ec0e1e97184 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:02.437861 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 526/1057] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:22:02 2021] GET /identity/v3/role_assignments?user.id=e286c2e89b884ab3ad3bd157a549016f&scope.project.id=1c2561d46a214d4e90408d58a46cf8d8&role.id=df3a437e6ea14518a9c1b9a348e18c99 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:22:04.698545 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4775b2-5ba0-4f92-810c-b20278af9083 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:04.699104 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4775b2-5ba0-4f92-810c-b20278af9083 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:04.699104 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4775b2-5ba0-4f92-810c-b20278af9083 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:04.700874 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 532/1058] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:22:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:22:04.706796 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5184e4e-3d20-477a-8424-2190dacd7e5e None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:04.707212 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5184e4e-3d20-477a-8424-2190dacd7e5e None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:04.707358 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5184e4e-3d20-477a-8424-2190dacd7e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:04.725761 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-c5184e4e-3d20-477a-8424-2190dacd7e5e None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:04.726941 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-c5184e4e-3d20-477a-8424-2190dacd7e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:04.734530 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 527/1059] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:22:04 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:04.757005 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4775b2-5ba0-4f92-810c-b20278af9083 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:04.768698 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4775b2-5ba0-4f92-810c-b20278af9083 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:04.773500 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246cb45-030b-442e-8c74-fafec62a295a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:04.774150 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246cb45-030b-442e-8c74-fafec62a295a admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:04.774430 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246cb45-030b-442e-8c74-fafec62a295a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:04.774703 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246cb45-030b-442e-8c74-fafec62a295a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:04.782053 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246cb45-030b-442e-8c74-fafec62a295a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:04.783755 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246cb45-030b-442e-8c74-fafec62a295a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:04.792764 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 533/1060] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:22:04 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:22:04.798894 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5184e4e-3d20-477a-8424-2190dacd7e5e None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:04.807707 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5184e4e-3d20-477a-8424-2190dacd7e5e None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:04.812160 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc514b-7fa7-4722-959c-7cc4cf1fbcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:04.812932 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc514b-7fa7-4722-959c-7cc4cf1fbcaa admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:04.813217 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc514b-7fa7-4722-959c-7cc4cf1fbcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:04.813513 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc514b-7fa7-4722-959c-7cc4cf1fbcaa admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:04.820196 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc514b-7fa7-4722-959c-7cc4cf1fbcaa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:04.822013 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc514b-7fa7-4722-959c-7cc4cf1fbcaa admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:04.835941 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-19cc514b-7fa7-4722-959c-7cc4cf1fbcaa admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 27 01:22:04.837025 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 528/1061] 10.222.0.25 () {56 vars in 1138 bytes} [Wed Oct 27 01:22:04 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:22:04.843148 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246cb45-030b-442e-8c74-fafec62a295a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:04.852242 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246cb45-030b-442e-8c74-fafec62a295a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:04.856786 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591d588-b200-4a0c-b1c4-3b7c7793b43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:04.857409 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591d588-b200-4a0c-b1c4-3b7c7793b43a admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:04.857724 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591d588-b200-4a0c-b1c4-3b7c7793b43a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:04.858002 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591d588-b200-4a0c-b1c4-3b7c7793b43a admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:04.858715 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591d588-b200-4a0c-b1c4-3b7c7793b43a admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:22:04.859020 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591d588-b200-4a0c-b1c4-3b7c7793b43a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:04.860544 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591d588-b200-4a0c-b1c4-3b7c7793b43a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:04.867531 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 534/1062] 10.222.0.25 () {56 vars in 1136 bytes} [Wed Oct 27 01:22:04 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:22:07.079444 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe05091-8662-4945-be30-cc7c0e2e789a None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:07.079961 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe05091-8662-4945-be30-cc7c0e2e789a None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:07.079961 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe05091-8662-4945-be30-cc7c0e2e789a None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:07.081783 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 529/1063] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:22:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:22:07.088433 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f878e1-8681-47af-a566-11d6d54de815 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:07.088849 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f878e1-8681-47af-a566-11d6d54de815 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:07.088996 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f878e1-8681-47af-a566-11d6d54de815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:07.106663 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-a1f878e1-8681-47af-a566-11d6d54de815 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:07.107848 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-a1f878e1-8681-47af-a566-11d6d54de815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:07.115425 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 535/1064] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:22:07 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:07.138728 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe05091-8662-4945-be30-cc7c0e2e789a None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:07.150995 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe05091-8662-4945-be30-cc7c0e2e789a None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:07.155467 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586d2ce-08f3-4c81-8a61-8576e4375036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:07.156090 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586d2ce-08f3-4c81-8a61-8576e4375036 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:07.156370 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586d2ce-08f3-4c81-8a61-8576e4375036 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:07.156643 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586d2ce-08f3-4c81-8a61-8576e4375036 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:07.157391 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8586d2ce-08f3-4c81-8a61-8576e4375036 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:07.158409 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING py.warnings [None req-8586d2ce-08f3-4c81-8a61-8576e4375036 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:22:07.158409 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: warnings.warn(msg) Oct 27 01:22:07.158409 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: Oct 27 01:22:07.159275 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8586d2ce-08f3-4c81-8a61-8576e4375036 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:07.173193 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 530/1065] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Oct 27 01:22:07 2021] POST /identity/v3/domains => generated 267 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:22:09.433188 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c0b5d-b471-4596-a67b-73b1f8747878 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:09.433771 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c0b5d-b471-4596-a67b-73b1f8747878 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:09.433771 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c0b5d-b471-4596-a67b-73b1f8747878 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:09.435558 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 536/1066] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:22:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:22:09.441930 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d1973-3906-48d3-a77d-eee3c8efa519 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:09.442359 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d1973-3906-48d3-a77d-eee3c8efa519 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:09.442496 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d1973-3906-48d3-a77d-eee3c8efa519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:09.460501 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-8d2d1973-3906-48d3-a77d-eee3c8efa519 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:09.461718 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-8d2d1973-3906-48d3-a77d-eee3c8efa519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:09.516148 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 531/1067] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:22:09 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:22:09.540879 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c0b5d-b471-4596-a67b-73b1f8747878 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:09.553431 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c0b5d-b471-4596-a67b-73b1f8747878 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:09.558104 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebe4a5-9737-44f5-a2d9-ff0fa75861ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:09.558939 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebe4a5-9737-44f5-a2d9-ff0fa75861ef admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:09.559221 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebe4a5-9737-44f5-a2d9-ff0fa75861ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:09.559497 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebe4a5-9737-44f5-a2d9-ff0fa75861ef admin admin] PATH_INFO: `/v3/domains/6a7afa22480a4e4fa6a3a3c3ae54d365` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:09.569745 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebe4a5-9737-44f5-a2d9-ff0fa75861ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=6a7afa22480a4e4fa6a3a3c3ae54d365)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:09.571676 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebe4a5-9737-44f5-a2d9-ff0fa75861ef admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:09.573230 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 537/1068] 10.222.0.25 () {56 vars in 1204 bytes} [Wed Oct 27 01:22:09 2021] GET /identity/v3/domains/6a7afa22480a4e4fa6a3a3c3ae54d365 => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:22:09.579417 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d1973-3906-48d3-a77d-eee3c8efa519 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:09.588020 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d1973-3906-48d3-a77d-eee3c8efa519 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:09.592490 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7749e1e-825d-4d00-85a3-5e5e7fba23b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:09.593126 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7749e1e-825d-4d00-85a3-5e5e7fba23b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:09.593412 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7749e1e-825d-4d00-85a3-5e5e7fba23b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:09.593723 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7749e1e-825d-4d00-85a3-5e5e7fba23b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:09.594438 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7749e1e-825d-4d00-85a3-5e5e7fba23b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:09.596298 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7749e1e-825d-4d00-85a3-5e5e7fba23b7 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:09.621315 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 532/1069] 10.222.0.25 () {60 vars in 1162 bytes} [Wed Oct 27 01:22:09 2021] POST /identity/v3/projects => generated 361 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:22:11.880553 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce73fc7-ec78-475b-a39d-0087ff3ab8dd None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:11.881089 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce73fc7-ec78-475b-a39d-0087ff3ab8dd None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:11.881089 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce73fc7-ec78-475b-a39d-0087ff3ab8dd None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:11.882892 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 538/1070] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:22:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:22:11.888822 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f0cd2-bad7-46a4-848b-dfc601192559 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:11.889256 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f0cd2-bad7-46a4-848b-dfc601192559 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:11.889395 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f0cd2-bad7-46a4-848b-dfc601192559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:11.908197 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-1e2f0cd2-bad7-46a4-848b-dfc601192559 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:11.909387 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-1e2f0cd2-bad7-46a4-848b-dfc601192559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:11.964294 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 533/1071] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:22:11 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:11.990927 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce73fc7-ec78-475b-a39d-0087ff3ab8dd None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:12.002625 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce73fc7-ec78-475b-a39d-0087ff3ab8dd None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:12.006965 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02796f15-497c-43e9-8e51-243505f08e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:12.007791 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02796f15-497c-43e9-8e51-243505f08e3f admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:12.008068 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02796f15-497c-43e9-8e51-243505f08e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:12.008337 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02796f15-497c-43e9-8e51-243505f08e3f admin admin] PATH_INFO: `/v3/domains/6a7afa22480a4e4fa6a3a3c3ae54d365` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:12.009516 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02796f15-497c-43e9-8e51-243505f08e3f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=6a7afa22480a4e4fa6a3a3c3ae54d365)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:12.011423 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02796f15-497c-43e9-8e51-243505f08e3f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:12.012946 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 539/1072] 10.222.0.25 () {56 vars in 1204 bytes} [Wed Oct 27 01:22:11 2021] GET /identity/v3/domains/6a7afa22480a4e4fa6a3a3c3ae54d365 => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:22:12.018854 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f0cd2-bad7-46a4-848b-dfc601192559 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:12.027498 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f0cd2-bad7-46a4-848b-dfc601192559 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:12.031965 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdde10-622f-401a-aa5e-61469c080cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:12.032616 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdde10-622f-401a-aa5e-61469c080cfa admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:12.032903 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdde10-622f-401a-aa5e-61469c080cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:12.033183 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdde10-622f-401a-aa5e-61469c080cfa admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:12.033935 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdde10-622f-401a-aa5e-61469c080cfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:12.035806 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdde10-622f-401a-aa5e-61469c080cfa admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:12.055753 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 534/1073] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Oct 27 01:22:12 2021] POST /identity/v3/users => generated 311 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:22:14.335949 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5302cb-400a-492d-9643-a928d7c6c35e None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:14.336464 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5302cb-400a-492d-9643-a928d7c6c35e None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:14.336464 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5302cb-400a-492d-9643-a928d7c6c35e None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:14.338272 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 540/1074] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:22:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:22:14.344323 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffd022-b6e5-44f5-afcd-9d9eb73882bb None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:14.344760 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffd022-b6e5-44f5-afcd-9d9eb73882bb None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:14.344878 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffd022-b6e5-44f5-afcd-9d9eb73882bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:14.361860 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-f9ffd022-b6e5-44f5-afcd-9d9eb73882bb None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:14.363027 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-f9ffd022-b6e5-44f5-afcd-9d9eb73882bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:14.370653 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 535/1075] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:22:14 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:22:14.395501 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5302cb-400a-492d-9643-a928d7c6c35e None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:14.408327 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5302cb-400a-492d-9643-a928d7c6c35e None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:14.412764 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d596b11-5161-40ba-b29d-63f5c6afa379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:14.413578 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d596b11-5161-40ba-b29d-63f5c6afa379 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:14.413892 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d596b11-5161-40ba-b29d-63f5c6afa379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:14.414174 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d596b11-5161-40ba-b29d-63f5c6afa379 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:14.424607 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d596b11-5161-40ba-b29d-63f5c6afa379 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:22:14.432088 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-8d596b11-5161-40ba-b29d-63f5c6afa379 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:22:14.433456 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 541/1076] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:22:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:22:14.439933 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffd022-b6e5-44f5-afcd-9d9eb73882bb None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:14.449031 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffd022-b6e5-44f5-afcd-9d9eb73882bb None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:14.453500 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12853c6c-a815-4552-bd75-868b5626cd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:14.454148 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12853c6c-a815-4552-bd75-868b5626cd3a admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:14.454428 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12853c6c-a815-4552-bd75-868b5626cd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:14.454699 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12853c6c-a815-4552-bd75-868b5626cd3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:14.455433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12853c6c-a815-4552-bd75-868b5626cd3a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:22:14.455734 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12853c6c-a815-4552-bd75-868b5626cd3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:14.457279 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12853c6c-a815-4552-bd75-868b5626cd3a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:14.465186 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 536/1077] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:22:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:22:14.471209 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d596b11-5161-40ba-b29d-63f5c6afa379 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:14.480476 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d596b11-5161-40ba-b29d-63f5c6afa379 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:14.484998 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dbfc14-10d1-42cf-9abb-74199fa5aa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:14.485877 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbfc14-10d1-42cf-9abb-74199fa5aa4d admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:14.486166 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbfc14-10d1-42cf-9abb-74199fa5aa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:14.486447 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbfc14-10d1-42cf-9abb-74199fa5aa4d admin admin] PATH_INFO: `/v3/users/b4c2d9702593486480adc70622a855d0` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:14.500009 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dbfc14-10d1-42cf-9abb-74199fa5aa4d admin admin] RBAC: Authorizing `identity:get_user(user_id=b4c2d9702593486480adc70622a855d0)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:14.502198 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dbfc14-10d1-42cf-9abb-74199fa5aa4d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:14.503792 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 542/1078] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:22:14 2021] GET /identity/v3/users/b4c2d9702593486480adc70622a855d0 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:22:14.510323 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12853c6c-a815-4552-bd75-868b5626cd3a admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:14.519289 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12853c6c-a815-4552-bd75-868b5626cd3a admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:14.523777 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be90e5a-b8ad-49cc-a63f-4662f82aaef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:14.524383 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be90e5a-b8ad-49cc-a63f-4662f82aaef3 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:14.524664 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be90e5a-b8ad-49cc-a63f-4662f82aaef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:14.524939 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be90e5a-b8ad-49cc-a63f-4662f82aaef3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:14.532294 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be90e5a-b8ad-49cc-a63f-4662f82aaef3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:14.534004 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be90e5a-b8ad-49cc-a63f-4662f82aaef3 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:14.542355 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 537/1079] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:22:14 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:22:14.548327 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dbfc14-10d1-42cf-9abb-74199fa5aa4d admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:14.558178 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dbfc14-10d1-42cf-9abb-74199fa5aa4d admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:14.562877 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8670c-332b-44fa-bb3e-df90806dbef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:14.563708 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8670c-332b-44fa-bb3e-df90806dbef4 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:14.563993 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8670c-332b-44fa-bb3e-df90806dbef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:14.564272 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8670c-332b-44fa-bb3e-df90806dbef4 admin admin] PATH_INFO: `/v3/projects/6def349c5d5f4766a9afeced44a5b6e1` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:14.565449 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8670c-332b-44fa-bb3e-df90806dbef4 admin admin] RBAC: Authorizing `identity:get_project(project_id=6def349c5d5f4766a9afeced44a5b6e1)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:14.567469 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8670c-332b-44fa-bb3e-df90806dbef4 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:14.569743 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 543/1080] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:22:14 2021] GET /identity/v3/projects/6def349c5d5f4766a9afeced44a5b6e1 => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:22:14.576276 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be90e5a-b8ad-49cc-a63f-4662f82aaef3 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:14.585180 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be90e5a-b8ad-49cc-a63f-4662f82aaef3 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:14.589904 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7163576-c174-4151-8cad-327ca45f6127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:14.590477 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7163576-c174-4151-8cad-327ca45f6127 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:14.590762 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7163576-c174-4151-8cad-327ca45f6127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:14.591041 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7163576-c174-4151-8cad-327ca45f6127 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:14.591901 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7163576-c174-4151-8cad-327ca45f6127 admin admin] RBAC: Adding query filter params (role.id=df3a437e6ea14518a9c1b9a348e18c99, scope.project.id=6def349c5d5f4766a9afeced44a5b6e1, user.id=b4c2d9702593486480adc70622a855d0) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:22:14.592218 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7163576-c174-4151-8cad-327ca45f6127 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:14.594045 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7163576-c174-4151-8cad-327ca45f6127 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:14.599350 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 538/1081] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:22:14 2021] GET /identity/v3/role_assignments?user.id=b4c2d9702593486480adc70622a855d0&scope.project.id=6def349c5d5f4766a9afeced44a5b6e1&role.id=df3a437e6ea14518a9c1b9a348e18c99 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:22:16.800962 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9645c-f7f4-4958-84d5-912c45bb307d None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:16.801532 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9645c-f7f4-4958-84d5-912c45bb307d None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:16.801680 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9645c-f7f4-4958-84d5-912c45bb307d None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:16.803486 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 544/1082] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:22:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:22:16.809729 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42699f95-643e-4847-9682-fce07d14dc82 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:16.810173 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42699f95-643e-4847-9682-fce07d14dc82 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:16.810274 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42699f95-643e-4847-9682-fce07d14dc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:16.828197 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-42699f95-643e-4847-9682-fce07d14dc82 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:16.829386 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-42699f95-643e-4847-9682-fce07d14dc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:16.851510 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 539/1083] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:22:16 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:16.875468 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9645c-f7f4-4958-84d5-912c45bb307d None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:16.887489 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9645c-f7f4-4958-84d5-912c45bb307d None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:16.891809 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27422550-ad2d-4892-b80d-1d6c38c731e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:16.892580 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27422550-ad2d-4892-b80d-1d6c38c731e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:16.892865 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27422550-ad2d-4892-b80d-1d6c38c731e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:16.893143 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27422550-ad2d-4892-b80d-1d6c38c731e5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:16.903491 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27422550-ad2d-4892-b80d-1d6c38c731e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:22:16.910346 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-27422550-ad2d-4892-b80d-1d6c38c731e5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:22:16.911470 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 545/1084] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:22:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:22:16.918583 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42699f95-643e-4847-9682-fce07d14dc82 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:16.927343 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42699f95-643e-4847-9682-fce07d14dc82 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:16.931831 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26101da-1853-461a-a130-49c520a97c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:16.932755 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26101da-1853-461a-a130-49c520a97c31 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:16.933042 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26101da-1853-461a-a130-49c520a97c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:16.933320 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26101da-1853-461a-a130-49c520a97c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:16.934109 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26101da-1853-461a-a130-49c520a97c31 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:22:16.934420 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26101da-1853-461a-a130-49c520a97c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:16.935990 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26101da-1853-461a-a130-49c520a97c31 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:16.943976 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 540/1085] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:22:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:22:16.950109 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27422550-ad2d-4892-b80d-1d6c38c731e5 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:16.960455 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27422550-ad2d-4892-b80d-1d6c38c731e5 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:16.964966 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401f243-c3e1-4a05-b5e4-a9da2b93fe59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:16.965827 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401f243-c3e1-4a05-b5e4-a9da2b93fe59 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:16.966109 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401f243-c3e1-4a05-b5e4-a9da2b93fe59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:16.966381 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401f243-c3e1-4a05-b5e4-a9da2b93fe59 admin admin] PATH_INFO: `/v3/users/b4c2d9702593486480adc70622a855d0` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:16.967841 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401f243-c3e1-4a05-b5e4-a9da2b93fe59 admin admin] RBAC: Authorizing `identity:get_user(user_id=b4c2d9702593486480adc70622a855d0)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:16.969672 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401f243-c3e1-4a05-b5e4-a9da2b93fe59 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:16.971236 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 546/1086] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:22:16 2021] GET /identity/v3/users/b4c2d9702593486480adc70622a855d0 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:22:16.978050 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26101da-1853-461a-a130-49c520a97c31 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:16.987459 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26101da-1853-461a-a130-49c520a97c31 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:16.992042 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c49b23-0f0c-4aee-942d-b6f28a503f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:16.992874 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c49b23-0f0c-4aee-942d-b6f28a503f94 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:16.993160 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c49b23-0f0c-4aee-942d-b6f28a503f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:16.993437 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c49b23-0f0c-4aee-942d-b6f28a503f94 admin admin] PATH_INFO: `/v3/projects/6def349c5d5f4766a9afeced44a5b6e1` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:16.994641 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c49b23-0f0c-4aee-942d-b6f28a503f94 admin admin] RBAC: Authorizing `identity:get_project(project_id=6def349c5d5f4766a9afeced44a5b6e1)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:16.996660 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c49b23-0f0c-4aee-942d-b6f28a503f94 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:16.998310 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 541/1087] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:22:16 2021] GET /identity/v3/projects/6def349c5d5f4766a9afeced44a5b6e1 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:22:17.004300 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401f243-c3e1-4a05-b5e4-a9da2b93fe59 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:17.013442 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401f243-c3e1-4a05-b5e4-a9da2b93fe59 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:17.017925 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bf96d-63dc-4663-913c-575d966a958c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:17.018752 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bf96d-63dc-4663-913c-575d966a958c admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:17.019036 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bf96d-63dc-4663-913c-575d966a958c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:17.019307 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bf96d-63dc-4663-913c-575d966a958c admin admin] PATH_INFO: `/v3/projects/6def349c5d5f4766a9afeced44a5b6e1/users/b4c2d9702593486480adc70622a855d0/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:17.021789 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bf96d-63dc-4663-913c-575d966a958c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6def349c5d5f4766a9afeced44a5b6e1, user_id=b4c2d9702593486480adc70622a855d0, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:17.024342 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bf96d-63dc-4663-913c-575d966a958c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:17.036576 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 547/1088] 10.222.0.25 () {58 vars in 1460 bytes} [Wed Oct 27 01:22:17 2021] PUT /identity/v3/projects/6def349c5d5f4766a9afeced44a5b6e1/users/b4c2d9702593486480adc70622a855d0/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:22:19.247130 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5e621-6c3b-40b6-b939-4a3a22ca4bc1 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:19.247645 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5e621-6c3b-40b6-b939-4a3a22ca4bc1 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:19.247645 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5e621-6c3b-40b6-b939-4a3a22ca4bc1 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:19.249394 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 542/1089] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:22:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:22:19.255423 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c1ea5-d6a0-4aa2-8076-7520a379c366 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:19.255818 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c1ea5-d6a0-4aa2-8076-7520a379c366 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:19.255980 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c1ea5-d6a0-4aa2-8076-7520a379c366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:19.273732 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-070c1ea5-d6a0-4aa2-8076-7520a379c366 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:19.274915 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-070c1ea5-d6a0-4aa2-8076-7520a379c366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:19.330125 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 548/1090] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:22:19 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:19.354736 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5e621-6c3b-40b6-b939-4a3a22ca4bc1 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:19.366409 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5e621-6c3b-40b6-b939-4a3a22ca4bc1 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:19.370667 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d4422-11d8-40ad-ac8f-ff004fa9cd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:19.371426 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d4422-11d8-40ad-ac8f-ff004fa9cd8b admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:19.371708 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d4422-11d8-40ad-ac8f-ff004fa9cd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:19.371982 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d4422-11d8-40ad-ac8f-ff004fa9cd8b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:19.382214 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d4422-11d8-40ad-ac8f-ff004fa9cd8b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:22:19.388963 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-fc8d4422-11d8-40ad-ac8f-ff004fa9cd8b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:22:19.390091 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 543/1091] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:22:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:22:19.396311 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c1ea5-d6a0-4aa2-8076-7520a379c366 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:19.405413 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c1ea5-d6a0-4aa2-8076-7520a379c366 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:19.409880 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb609df-f8da-4cb9-b760-864513aabc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:19.410515 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb609df-f8da-4cb9-b760-864513aabc39 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:19.410795 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb609df-f8da-4cb9-b760-864513aabc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:19.411067 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb609df-f8da-4cb9-b760-864513aabc39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:19.411892 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb609df-f8da-4cb9-b760-864513aabc39 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:22:19.412197 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb609df-f8da-4cb9-b760-864513aabc39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:19.413781 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb609df-f8da-4cb9-b760-864513aabc39 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:19.421702 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 549/1092] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:22:19 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:22:19.427694 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d4422-11d8-40ad-ac8f-ff004fa9cd8b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:19.438029 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d4422-11d8-40ad-ac8f-ff004fa9cd8b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:19.442459 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dbc76-cc21-46b0-9859-133c26bf6466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:19.443867 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dbc76-cc21-46b0-9859-133c26bf6466 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:19.444152 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dbc76-cc21-46b0-9859-133c26bf6466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:19.444427 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dbc76-cc21-46b0-9859-133c26bf6466 admin admin] PATH_INFO: `/v3/users/b4c2d9702593486480adc70622a855d0` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:19.445647 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74dbc76-cc21-46b0-9859-133c26bf6466 admin admin] RBAC: Authorizing `identity:get_user(user_id=b4c2d9702593486480adc70622a855d0)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:19.447786 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74dbc76-cc21-46b0-9859-133c26bf6466 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:19.449330 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 544/1093] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:22:19 2021] GET /identity/v3/users/b4c2d9702593486480adc70622a855d0 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:22:19.455188 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb609df-f8da-4cb9-b760-864513aabc39 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:19.464751 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb609df-f8da-4cb9-b760-864513aabc39 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:19.469153 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6abe6d-21c4-410d-84e8-8df6efeb9c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:19.469793 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6abe6d-21c4-410d-84e8-8df6efeb9c0c admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:19.470075 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6abe6d-21c4-410d-84e8-8df6efeb9c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:19.470349 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6abe6d-21c4-410d-84e8-8df6efeb9c0c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:19.477715 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6abe6d-21c4-410d-84e8-8df6efeb9c0c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:19.479395 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6abe6d-21c4-410d-84e8-8df6efeb9c0c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:19.487741 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 550/1094] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:22:19 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:22:19.493753 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dbc76-cc21-46b0-9859-133c26bf6466 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:19.502966 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dbc76-cc21-46b0-9859-133c26bf6466 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:19.507856 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4b99d-413a-4d2d-9842-cc0100aaf7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:19.508669 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4b99d-413a-4d2d-9842-cc0100aaf7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:19.508955 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4b99d-413a-4d2d-9842-cc0100aaf7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:19.509235 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4b99d-413a-4d2d-9842-cc0100aaf7e4 admin admin] PATH_INFO: `/v3/projects/6def349c5d5f4766a9afeced44a5b6e1` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:19.510421 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4b99d-413a-4d2d-9842-cc0100aaf7e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=6def349c5d5f4766a9afeced44a5b6e1)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:19.512419 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4b99d-413a-4d2d-9842-cc0100aaf7e4 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:19.514082 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 545/1095] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:22:19 2021] GET /identity/v3/projects/6def349c5d5f4766a9afeced44a5b6e1 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:22:19.520505 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6abe6d-21c4-410d-84e8-8df6efeb9c0c admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:19.530237 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6abe6d-21c4-410d-84e8-8df6efeb9c0c admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:19.534858 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4f72f-9a89-4b0c-8a13-c652be89c1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:19.535502 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4f72f-9a89-4b0c-8a13-c652be89c1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:19.535790 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4f72f-9a89-4b0c-8a13-c652be89c1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:19.536068 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4f72f-9a89-4b0c-8a13-c652be89c1c7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:19.536929 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4f72f-9a89-4b0c-8a13-c652be89c1c7 admin admin] RBAC: Adding query filter params (role.id=df3a437e6ea14518a9c1b9a348e18c99, scope.project.id=6def349c5d5f4766a9afeced44a5b6e1, user.id=b4c2d9702593486480adc70622a855d0) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:22:19.537239 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4f72f-9a89-4b0c-8a13-c652be89c1c7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:19.539094 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4f72f-9a89-4b0c-8a13-c652be89c1c7 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:19.544662 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 551/1096] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:22:19 2021] GET /identity/v3/role_assignments?user.id=b4c2d9702593486480adc70622a855d0&scope.project.id=6def349c5d5f4766a9afeced44a5b6e1&role.id=df3a437e6ea14518a9c1b9a348e18c99 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:14.901223 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146fbcb-1fd7-47a0-92e7-56b82793f406 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:14.901848 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146fbcb-1fd7-47a0-92e7-56b82793f406 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:14.901848 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146fbcb-1fd7-47a0-92e7-56b82793f406 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:14.903763 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 546/1097] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:23:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:23:14.911610 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e9814-3758-4800-9673-43a28f74c70c None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:14.912199 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e9814-3758-4800-9673-43a28f74c70c None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:14.912199 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e9814-3758-4800-9673-43a28f74c70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:14.931637 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-4b5e9814-3758-4800-9673-43a28f74c70c None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:14.933109 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4b5e9814-3758-4800-9673-43a28f74c70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:14.950361 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 552/1098] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:23:14 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:14.976507 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146fbcb-1fd7-47a0-92e7-56b82793f406 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:14.991485 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146fbcb-1fd7-47a0-92e7-56b82793f406 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:14.996224 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9627cc-90df-47c3-bcac-c5f6cd4e4443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:14.997069 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9627cc-90df-47c3-bcac-c5f6cd4e4443 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:14.997433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9627cc-90df-47c3-bcac-c5f6cd4e4443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:14.997808 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9627cc-90df-47c3-bcac-c5f6cd4e4443 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:15.010151 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9627cc-90df-47c3-bcac-c5f6cd4e4443 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:15.012278 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9627cc-90df-47c3-bcac-c5f6cd4e4443 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:15.037583 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-dc9627cc-90df-47c3-bcac-c5f6cd4e4443 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:23:15.039336 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 547/1099] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:23:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:23:15.047074 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e9814-3758-4800-9673-43a28f74c70c None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:15.058389 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e9814-3758-4800-9673-43a28f74c70c None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:15.063474 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944550c-43ab-4900-919d-fa1c499e606d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:15.064730 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944550c-43ab-4900-919d-fa1c499e606d admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:15.065180 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944550c-43ab-4900-919d-fa1c499e606d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:15.065700 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944550c-43ab-4900-919d-fa1c499e606d admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:15.067234 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944550c-43ab-4900-919d-fa1c499e606d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:15.067742 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944550c-43ab-4900-919d-fa1c499e606d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:15.069514 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944550c-43ab-4900-919d-fa1c499e606d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:15.085538 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 553/1100] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:23:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:15.090500 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9627cc-90df-47c3-bcac-c5f6cd4e4443 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:15.103366 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9627cc-90df-47c3-bcac-c5f6cd4e4443 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:15.109317 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329545df-9da1-42dd-962d-1965646cf61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:15.110151 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329545df-9da1-42dd-962d-1965646cf61e admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:15.110434 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329545df-9da1-42dd-962d-1965646cf61e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:15.110753 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329545df-9da1-42dd-962d-1965646cf61e admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:15.111482 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329545df-9da1-42dd-962d-1965646cf61e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:15.114053 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329545df-9da1-42dd-962d-1965646cf61e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:15.142230 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 548/1101] 10.222.0.25 () {60 vars in 1153 bytes} [Wed Oct 27 01:23:15 2021] POST /identity/v3/users => generated 251 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:17.799534 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088382d-8dd3-441c-afa2-97ae509be1de None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:17.800124 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088382d-8dd3-441c-afa2-97ae509be1de None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:17.800124 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088382d-8dd3-441c-afa2-97ae509be1de None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:17.802579 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 554/1102] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:23:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:23:17.811794 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819271b-e540-4408-8a2b-58b84db1cb52 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:17.812368 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819271b-e540-4408-8a2b-58b84db1cb52 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:17.812368 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819271b-e540-4408-8a2b-58b84db1cb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:17.833095 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-e819271b-e540-4408-8a2b-58b84db1cb52 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:17.834360 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-e819271b-e540-4408-8a2b-58b84db1cb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:17.842865 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 549/1103] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:23:17 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:17.870831 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088382d-8dd3-441c-afa2-97ae509be1de None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:17.884464 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088382d-8dd3-441c-afa2-97ae509be1de None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:17.890187 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f50c3b-dc1d-405d-852c-a73b6ed66c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:17.890985 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f50c3b-dc1d-405d-852c-a73b6ed66c27 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:17.891270 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f50c3b-dc1d-405d-852c-a73b6ed66c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:17.891550 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f50c3b-dc1d-405d-852c-a73b6ed66c27 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:17.904422 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f50c3b-dc1d-405d-852c-a73b6ed66c27 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:23:17.912862 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-61f50c3b-dc1d-405d-852c-a73b6ed66c27 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:23:17.914462 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 555/1104] 10.222.0.25 () {56 vars in 1123 bytes} [Wed Oct 27 01:23:17 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:23:17.921871 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819271b-e540-4408-8a2b-58b84db1cb52 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:17.935051 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819271b-e540-4408-8a2b-58b84db1cb52 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:17.940398 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b9ac2-fa0a-4337-a78b-c1eb72832d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:17.941208 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b9ac2-fa0a-4337-a78b-c1eb72832d3e admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:17.941632 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b9ac2-fa0a-4337-a78b-c1eb72832d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:17.942059 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b9ac2-fa0a-4337-a78b-c1eb72832d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:17.943049 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b9ac2-fa0a-4337-a78b-c1eb72832d3e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:17.943415 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b9ac2-fa0a-4337-a78b-c1eb72832d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:17.945198 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b9ac2-fa0a-4337-a78b-c1eb72832d3e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:17.954962 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 550/1105] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Oct 27 01:23:17 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:17.962433 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f50c3b-dc1d-405d-852c-a73b6ed66c27 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:17.975101 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f50c3b-dc1d-405d-852c-a73b6ed66c27 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:17.981276 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4c994-9a49-4395-be21-0a77c8866be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:17.982726 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4c994-9a49-4395-be21-0a77c8866be3 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:17.983527 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4c994-9a49-4395-be21-0a77c8866be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:17.984034 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4c994-9a49-4395-be21-0a77c8866be3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:17.999479 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4c994-9a49-4395-be21-0a77c8866be3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:18.002036 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4c994-9a49-4395-be21-0a77c8866be3 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:18.027713 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-c0d4c994-9a49-4395-be21-0a77c8866be3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:23:18.034586 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 556/1106] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:23:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:23:18.036482 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b9ac2-fa0a-4337-a78b-c1eb72832d3e admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:18.046925 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b9ac2-fa0a-4337-a78b-c1eb72832d3e admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:18.052510 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d44d7-b550-4485-a6eb-721a618b2c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:18.053116 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d44d7-b550-4485-a6eb-721a618b2c69 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:18.053408 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d44d7-b550-4485-a6eb-721a618b2c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:18.053855 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d44d7-b550-4485-a6eb-721a618b2c69 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:18.054602 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d44d7-b550-4485-a6eb-721a618b2c69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:18.055139 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d44d7-b550-4485-a6eb-721a618b2c69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:18.058541 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d44d7-b550-4485-a6eb-721a618b2c69 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:18.069945 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 551/1107] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:23:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:18.076753 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4c994-9a49-4395-be21-0a77c8866be3 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:18.088449 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4c994-9a49-4395-be21-0a77c8866be3 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:18.093417 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4891711-fff4-4924-96d2-7c7a3e919da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:18.094241 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4891711-fff4-4924-96d2-7c7a3e919da7 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:18.094518 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4891711-fff4-4924-96d2-7c7a3e919da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:18.094796 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4891711-fff4-4924-96d2-7c7a3e919da7 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:18.103317 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4891711-fff4-4924-96d2-7c7a3e919da7 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:18.105442 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4891711-fff4-4924-96d2-7c7a3e919da7 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:18.120921 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-b4891711-fff4-4924-96d2-7c7a3e919da7 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 01:23:18.122121 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 557/1108] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:23:18 2021] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:23:18.129383 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d44d7-b550-4485-a6eb-721a618b2c69 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:18.139532 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d44d7-b550-4485-a6eb-721a618b2c69 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:18.144984 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d2173-f392-41c6-9ea3-ebe076d289e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:18.145750 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d2173-f392-41c6-9ea3-ebe076d289e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:18.146031 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d2173-f392-41c6-9ea3-ebe076d289e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:18.146307 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d2173-f392-41c6-9ea3-ebe076d289e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:18.147150 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d2173-f392-41c6-9ea3-ebe076d289e2 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:18.148647 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d2173-f392-41c6-9ea3-ebe076d289e2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:18.149460 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d2173-f392-41c6-9ea3-ebe076d289e2 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:18.167275 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 552/1109] 10.222.0.25 () {56 vars in 1164 bytes} [Wed Oct 27 01:23:18 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:18.173779 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4891711-fff4-4924-96d2-7c7a3e919da7 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:18.184187 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4891711-fff4-4924-96d2-7c7a3e919da7 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:18.188970 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337cf0bc-1675-4171-9ca6-246aa9565a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:18.189686 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337cf0bc-1675-4171-9ca6-246aa9565a65 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:18.189968 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337cf0bc-1675-4171-9ca6-246aa9565a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:18.190240 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337cf0bc-1675-4171-9ca6-246aa9565a65 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:18.198011 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337cf0bc-1675-4171-9ca6-246aa9565a65 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:18.199777 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337cf0bc-1675-4171-9ca6-246aa9565a65 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:18.215131 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 558/1110] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:23:18 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:23:18.216329 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d2173-f392-41c6-9ea3-ebe076d289e2 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:18.228077 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d2173-f392-41c6-9ea3-ebe076d289e2 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:18.233985 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067aebae-a493-4584-b749-26d79ba04cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:18.234875 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067aebae-a493-4584-b749-26d79ba04cbd admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:18.235338 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067aebae-a493-4584-b749-26d79ba04cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:18.235661 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067aebae-a493-4584-b749-26d79ba04cbd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:18.248692 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067aebae-a493-4584-b749-26d79ba04cbd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:18.251014 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067aebae-a493-4584-b749-26d79ba04cbd admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:18.268837 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-067aebae-a493-4584-b749-26d79ba04cbd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:23:18.270272 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 553/1111] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:23:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:23:18.276403 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337cf0bc-1675-4171-9ca6-246aa9565a65 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:18.285661 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337cf0bc-1675-4171-9ca6-246aa9565a65 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:18.290607 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ec8be-1faf-4796-858d-8e88415c4eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:18.291285 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ec8be-1faf-4796-858d-8e88415c4eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:18.291514 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ec8be-1faf-4796-858d-8e88415c4eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:18.291791 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ec8be-1faf-4796-858d-8e88415c4eb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:18.292518 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ec8be-1faf-4796-858d-8e88415c4eb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:18.292820 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ec8be-1faf-4796-858d-8e88415c4eb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:18.294441 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ec8be-1faf-4796-858d-8e88415c4eb0 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:18.306752 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 559/1112] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:23:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:23:18.313227 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067aebae-a493-4584-b749-26d79ba04cbd admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:18.323545 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067aebae-a493-4584-b749-26d79ba04cbd admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:18.328437 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f6fc0-8946-4676-ae97-8d2dbd95aec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:18.329197 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f6fc0-8946-4676-ae97-8d2dbd95aec7 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:18.329505 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f6fc0-8946-4676-ae97-8d2dbd95aec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:18.329793 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f6fc0-8946-4676-ae97-8d2dbd95aec7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:18.337435 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f6fc0-8946-4676-ae97-8d2dbd95aec7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:18.339399 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f6fc0-8946-4676-ae97-8d2dbd95aec7 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:18.352355 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-711f6fc0-8946-4676-ae97-8d2dbd95aec7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:23:18.359137 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 554/1113] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:23:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:23:18.360137 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ec8be-1faf-4796-858d-8e88415c4eb0 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:18.370389 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ec8be-1faf-4796-858d-8e88415c4eb0 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:18.375081 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d96ce-508d-4ff7-9e5d-bbbacd619437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:18.375730 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d96ce-508d-4ff7-9e5d-bbbacd619437 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:18.376193 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d96ce-508d-4ff7-9e5d-bbbacd619437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:18.376305 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d96ce-508d-4ff7-9e5d-bbbacd619437 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:18.377042 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d96ce-508d-4ff7-9e5d-bbbacd619437 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:18.377348 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d96ce-508d-4ff7-9e5d-bbbacd619437 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:18.379763 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d96ce-508d-4ff7-9e5d-bbbacd619437 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:18.392919 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 560/1114] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:23:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:23:18.400372 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f6fc0-8946-4676-ae97-8d2dbd95aec7 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:18.414229 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f6fc0-8946-4676-ae97-8d2dbd95aec7 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:18.422055 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96049772-caaa-44fb-a759-5d0ca2205e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:18.423286 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96049772-caaa-44fb-a759-5d0ca2205e37 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:18.423885 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96049772-caaa-44fb-a759-5d0ca2205e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:18.424456 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96049772-caaa-44fb-a759-5d0ca2205e37 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:18.426045 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96049772-caaa-44fb-a759-5d0ca2205e37 admin admin] RBAC: Adding query filter params (role.id=983c0291e0fa484ea053a791ead0e9c5, scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6, user.id=2ff82e315d8c42e49556ab67fbf53b32) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:18.427136 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96049772-caaa-44fb-a759-5d0ca2205e37 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:18.432780 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96049772-caaa-44fb-a759-5d0ca2205e37 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:18.443039 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 555/1115] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:23:18 2021] GET /identity/v3/role_assignments?user.id=2ff82e315d8c42e49556ab67fbf53b32&scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6&role.id=983c0291e0fa484ea053a791ead0e9c5 => generated 259 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:21.903738 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b4de4-250c-431c-812a-08195a594583 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:21.904306 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b4de4-250c-431c-812a-08195a594583 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:21.904573 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b4de4-250c-431c-812a-08195a594583 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:21.906828 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 561/1116] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:23:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:23:21.915327 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9aea9-a61b-46e5-ab3c-e64d98066d85 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:21.916076 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9aea9-a61b-46e5-ab3c-e64d98066d85 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:21.916076 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9aea9-a61b-46e5-ab3c-e64d98066d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:21.935939 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-c1d9aea9-a61b-46e5-ab3c-e64d98066d85 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:21.937224 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-c1d9aea9-a61b-46e5-ab3c-e64d98066d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:21.949515 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 556/1117] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:23:21 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:21.971496 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b4de4-250c-431c-812a-08195a594583 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:21.986354 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b4de4-250c-431c-812a-08195a594583 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:21.991544 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d655a76-ac60-475f-a648-558236eac0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:21.992336 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d655a76-ac60-475f-a648-558236eac0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:21.992610 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d655a76-ac60-475f-a648-558236eac0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:21.992886 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d655a76-ac60-475f-a648-558236eac0a1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:22.003379 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d655a76-ac60-475f-a648-558236eac0a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:23:22.010398 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-6d655a76-ac60-475f-a648-558236eac0a1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:23:22.011792 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 562/1118] 10.222.0.25 () {56 vars in 1123 bytes} [Wed Oct 27 01:23:21 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:23:22.018584 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9aea9-a61b-46e5-ab3c-e64d98066d85 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:22.031442 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9aea9-a61b-46e5-ab3c-e64d98066d85 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:22.037177 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d6e46-eb9d-46d1-9abe-ab0791121ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:22.038019 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d6e46-eb9d-46d1-9abe-ab0791121ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:22.038305 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d6e46-eb9d-46d1-9abe-ab0791121ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:22.038585 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d6e46-eb9d-46d1-9abe-ab0791121ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:22.039450 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d6e46-eb9d-46d1-9abe-ab0791121ad2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:22.039826 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d6e46-eb9d-46d1-9abe-ab0791121ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:22.041691 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d6e46-eb9d-46d1-9abe-ab0791121ad2 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:22.051733 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 557/1119] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Oct 27 01:23:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:22.059483 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d655a76-ac60-475f-a648-558236eac0a1 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:22.070515 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d655a76-ac60-475f-a648-558236eac0a1 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:22.075386 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e397c-d808-43e9-8002-15f18c349cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:22.076285 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e397c-d808-43e9-8002-15f18c349cfa admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:22.076638 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e397c-d808-43e9-8002-15f18c349cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:22.076979 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e397c-d808-43e9-8002-15f18c349cfa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:22.089510 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e397c-d808-43e9-8002-15f18c349cfa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:22.091508 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e397c-d808-43e9-8002-15f18c349cfa admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:22.110188 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-445e397c-d808-43e9-8002-15f18c349cfa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:23:22.111371 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 563/1120] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:23:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:23:22.118111 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d6e46-eb9d-46d1-9abe-ab0791121ad2 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:22.128843 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d6e46-eb9d-46d1-9abe-ab0791121ad2 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:22.134005 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d808f-ee14-4b9c-9761-5728a71667b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:22.134724 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d808f-ee14-4b9c-9761-5728a71667b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:22.135016 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d808f-ee14-4b9c-9761-5728a71667b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:22.135300 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d808f-ee14-4b9c-9761-5728a71667b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:22.136052 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d808f-ee14-4b9c-9761-5728a71667b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:22.136436 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d808f-ee14-4b9c-9761-5728a71667b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:22.138096 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d808f-ee14-4b9c-9761-5728a71667b0 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:22.151867 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 558/1121] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:23:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:22.159272 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e397c-d808-43e9-8002-15f18c349cfa admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:22.173049 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e397c-d808-43e9-8002-15f18c349cfa admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:22.178701 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24a44b-1f31-4127-89c7-bdaf09cd8b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:22.183152 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24a44b-1f31-4127-89c7-bdaf09cd8b77 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:22.183152 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24a44b-1f31-4127-89c7-bdaf09cd8b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:22.183152 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24a44b-1f31-4127-89c7-bdaf09cd8b77 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:22.189291 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24a44b-1f31-4127-89c7-bdaf09cd8b77 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:22.191419 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24a44b-1f31-4127-89c7-bdaf09cd8b77 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:22.208404 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-eb24a44b-1f31-4127-89c7-bdaf09cd8b77 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 01:23:22.209639 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 564/1122] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:23:22 2021] GET /identity/v3/users/placement => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:23:22.216166 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d808f-ee14-4b9c-9761-5728a71667b0 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:22.226641 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d808f-ee14-4b9c-9761-5728a71667b0 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:22.231217 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7881df7-ad67-4d36-a268-44f5b5d2d05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:22.231866 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7881df7-ad67-4d36-a268-44f5b5d2d05d admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:22.232144 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7881df7-ad67-4d36-a268-44f5b5d2d05d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:22.232416 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7881df7-ad67-4d36-a268-44f5b5d2d05d admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:22.233258 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7881df7-ad67-4d36-a268-44f5b5d2d05d admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:22.233600 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7881df7-ad67-4d36-a268-44f5b5d2d05d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:22.235406 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7881df7-ad67-4d36-a268-44f5b5d2d05d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:22.252877 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 559/1123] 10.222.0.25 () {56 vars in 1164 bytes} [Wed Oct 27 01:23:22 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:22.259223 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24a44b-1f31-4127-89c7-bdaf09cd8b77 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:22.272052 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24a44b-1f31-4127-89c7-bdaf09cd8b77 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:22.278101 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84fc4f1-2bf7-4e4f-961c-4b5d906a41c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:22.278979 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fc4f1-2bf7-4e4f-961c-4b5d906a41c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:22.279385 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fc4f1-2bf7-4e4f-961c-4b5d906a41c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:22.279722 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fc4f1-2bf7-4e4f-961c-4b5d906a41c6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:22.292587 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84fc4f1-2bf7-4e4f-961c-4b5d906a41c6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:22.294444 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84fc4f1-2bf7-4e4f-961c-4b5d906a41c6 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:22.314819 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-b84fc4f1-2bf7-4e4f-961c-4b5d906a41c6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:23:22.316016 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 565/1124] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:23:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:23:22.322477 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7881df7-ad67-4d36-a268-44f5b5d2d05d admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:22.333187 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7881df7-ad67-4d36-a268-44f5b5d2d05d admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:22.338475 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae5930-6c93-4b70-9bdb-55fd5b3da893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:22.339559 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae5930-6c93-4b70-9bdb-55fd5b3da893 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:22.339863 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae5930-6c93-4b70-9bdb-55fd5b3da893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:22.340235 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae5930-6c93-4b70-9bdb-55fd5b3da893 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:22.341271 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae5930-6c93-4b70-9bdb-55fd5b3da893 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:22.341806 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae5930-6c93-4b70-9bdb-55fd5b3da893 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:22.343657 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae5930-6c93-4b70-9bdb-55fd5b3da893 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:22.358626 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 560/1125] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:23:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:23:22.364922 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84fc4f1-2bf7-4e4f-961c-4b5d906a41c6 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:22.374749 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84fc4f1-2bf7-4e4f-961c-4b5d906a41c6 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:22.379486 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933206ef-2027-4f53-bcee-06453151dfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:22.380242 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933206ef-2027-4f53-bcee-06453151dfbf admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:22.380530 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933206ef-2027-4f53-bcee-06453151dfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:22.380854 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933206ef-2027-4f53-bcee-06453151dfbf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:22.388293 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933206ef-2027-4f53-bcee-06453151dfbf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:22.390282 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933206ef-2027-4f53-bcee-06453151dfbf admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:22.404087 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-933206ef-2027-4f53-bcee-06453151dfbf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:23:22.405512 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 566/1126] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:23:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:23:22.412860 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae5930-6c93-4b70-9bdb-55fd5b3da893 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:22.423684 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae5930-6c93-4b70-9bdb-55fd5b3da893 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:22.430173 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de53224-ff75-4dd8-995b-7ac77c9e5e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:22.430838 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de53224-ff75-4dd8-995b-7ac77c9e5e71 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:22.431129 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de53224-ff75-4dd8-995b-7ac77c9e5e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:22.431410 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de53224-ff75-4dd8-995b-7ac77c9e5e71 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:22.432458 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de53224-ff75-4dd8-995b-7ac77c9e5e71 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:22.432768 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de53224-ff75-4dd8-995b-7ac77c9e5e71 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:22.434708 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de53224-ff75-4dd8-995b-7ac77c9e5e71 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:22.447567 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 561/1127] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:23:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:23:22.455877 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933206ef-2027-4f53-bcee-06453151dfbf admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:22.468192 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933206ef-2027-4f53-bcee-06453151dfbf admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:22.473165 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0f0b6-e8b8-4887-a12a-9f16f5ffb01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:22.474049 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0f0b6-e8b8-4887-a12a-9f16f5ffb01c admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:22.474429 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0f0b6-e8b8-4887-a12a-9f16f5ffb01c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:22.474611 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0f0b6-e8b8-4887-a12a-9f16f5ffb01c admin admin] PATH_INFO: `/v3/projects/2b95c6a455e74d9487ae73f44a9ba0e6/users/2ff82e315d8c42e49556ab67fbf53b32/roles/983c0291e0fa484ea053a791ead0e9c5` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:22.489633 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0f0b6-e8b8-4887-a12a-9f16f5ffb01c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b95c6a455e74d9487ae73f44a9ba0e6, user_id=2ff82e315d8c42e49556ab67fbf53b32, role_id=983c0291e0fa484ea053a791ead0e9c5)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:22.492271 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0f0b6-e8b8-4887-a12a-9f16f5ffb01c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:22.505090 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 567/1128] 10.222.0.25 () {58 vars in 1460 bytes} [Wed Oct 27 01:23:22 2021] PUT /identity/v3/projects/2b95c6a455e74d9487ae73f44a9ba0e6/users/2ff82e315d8c42e49556ab67fbf53b32/roles/983c0291e0fa484ea053a791ead0e9c5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:25.017349 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d530a5a-caaf-4090-8137-40a8437bc83b None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:25.018009 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d530a5a-caaf-4090-8137-40a8437bc83b None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:25.018009 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d530a5a-caaf-4090-8137-40a8437bc83b None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:25.019769 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 562/1129] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:23:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:23:25.025614 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d8940-ece6-4b6f-8d5b-2860b44c185a None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:25.026217 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d8940-ece6-4b6f-8d5b-2860b44c185a None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:25.026217 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d8940-ece6-4b6f-8d5b-2860b44c185a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:25.044478 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-a65d8940-ece6-4b6f-8d5b-2860b44c185a None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:25.045711 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-a65d8940-ece6-4b6f-8d5b-2860b44c185a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:25.103756 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 568/1130] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:23:25 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:25.128861 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d530a5a-caaf-4090-8137-40a8437bc83b None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:25.142362 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d530a5a-caaf-4090-8137-40a8437bc83b None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:25.146801 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcf4f6-48b4-4e0e-9511-01427b661179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:25.147587 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcf4f6-48b4-4e0e-9511-01427b661179 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:25.147874 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcf4f6-48b4-4e0e-9511-01427b661179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:25.148155 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcf4f6-48b4-4e0e-9511-01427b661179 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:25.158409 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcf4f6-48b4-4e0e-9511-01427b661179 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:23:25.165949 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-6bfcf4f6-48b4-4e0e-9511-01427b661179 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:23:25.167136 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 563/1131] 10.222.0.25 () {56 vars in 1123 bytes} [Wed Oct 27 01:23:25 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:23:25.173748 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d8940-ece6-4b6f-8d5b-2860b44c185a None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:25.183746 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d8940-ece6-4b6f-8d5b-2860b44c185a None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:25.188256 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934ec7e-e13b-49e5-a0cd-3878e4669884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:25.188921 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934ec7e-e13b-49e5-a0cd-3878e4669884 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:25.189189 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934ec7e-e13b-49e5-a0cd-3878e4669884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:25.189465 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934ec7e-e13b-49e5-a0cd-3878e4669884 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:25.190247 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934ec7e-e13b-49e5-a0cd-3878e4669884 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:25.190548 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934ec7e-e13b-49e5-a0cd-3878e4669884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:25.192397 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934ec7e-e13b-49e5-a0cd-3878e4669884 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:25.200960 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 569/1132] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Oct 27 01:23:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:25.207313 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcf4f6-48b4-4e0e-9511-01427b661179 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:25.217953 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcf4f6-48b4-4e0e-9511-01427b661179 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:25.223100 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0864e51-e767-4579-9e7e-99b428690068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:25.224061 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0864e51-e767-4579-9e7e-99b428690068 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:25.224524 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0864e51-e767-4579-9e7e-99b428690068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:25.224813 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0864e51-e767-4579-9e7e-99b428690068 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:25.241806 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0864e51-e767-4579-9e7e-99b428690068 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:25.243637 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0864e51-e767-4579-9e7e-99b428690068 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:25.265212 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-e0864e51-e767-4579-9e7e-99b428690068 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:23:25.267067 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 564/1133] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:23:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:23:25.273371 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934ec7e-e13b-49e5-a0cd-3878e4669884 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:25.283289 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934ec7e-e13b-49e5-a0cd-3878e4669884 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:25.288907 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca5618-5cf9-4305-b552-3864ff30da0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:25.289608 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca5618-5cf9-4305-b552-3864ff30da0a admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:25.289901 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca5618-5cf9-4305-b552-3864ff30da0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:25.290181 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca5618-5cf9-4305-b552-3864ff30da0a admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:25.290908 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca5618-5cf9-4305-b552-3864ff30da0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:25.291227 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca5618-5cf9-4305-b552-3864ff30da0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:25.292815 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca5618-5cf9-4305-b552-3864ff30da0a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:25.306592 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 570/1134] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:23:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:25.313725 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0864e51-e767-4579-9e7e-99b428690068 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:25.323736 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0864e51-e767-4579-9e7e-99b428690068 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:25.329043 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a7acb-b9ae-4038-b0a1-fcb72f85de3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:25.330028 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a7acb-b9ae-4038-b0a1-fcb72f85de3c admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:25.330316 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a7acb-b9ae-4038-b0a1-fcb72f85de3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:25.330596 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a7acb-b9ae-4038-b0a1-fcb72f85de3c admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:25.339044 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a7acb-b9ae-4038-b0a1-fcb72f85de3c admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:25.341107 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a7acb-b9ae-4038-b0a1-fcb72f85de3c admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:25.361008 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-bb1a7acb-b9ae-4038-b0a1-fcb72f85de3c admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 01:23:25.362933 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 565/1135] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:23:25 2021] GET /identity/v3/users/placement => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:23:25.369785 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca5618-5cf9-4305-b552-3864ff30da0a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:25.380380 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca5618-5cf9-4305-b552-3864ff30da0a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:25.385055 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000fd1a-b2ef-46ee-9719-1a5c8707b1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:25.385823 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000fd1a-b2ef-46ee-9719-1a5c8707b1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:25.386180 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000fd1a-b2ef-46ee-9719-1a5c8707b1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:25.386537 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000fd1a-b2ef-46ee-9719-1a5c8707b1c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:25.387448 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000fd1a-b2ef-46ee-9719-1a5c8707b1c8 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:25.387850 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000fd1a-b2ef-46ee-9719-1a5c8707b1c8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:25.389771 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000fd1a-b2ef-46ee-9719-1a5c8707b1c8 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:25.410705 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 571/1136] 10.222.0.25 () {56 vars in 1164 bytes} [Wed Oct 27 01:23:25 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:25.417513 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a7acb-b9ae-4038-b0a1-fcb72f85de3c admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:25.427418 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a7acb-b9ae-4038-b0a1-fcb72f85de3c admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:25.432072 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef689d9c-d630-4ce5-b592-45e0b9a5ad35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:25.432992 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef689d9c-d630-4ce5-b592-45e0b9a5ad35 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:25.433283 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef689d9c-d630-4ce5-b592-45e0b9a5ad35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:25.433594 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef689d9c-d630-4ce5-b592-45e0b9a5ad35 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:25.441730 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef689d9c-d630-4ce5-b592-45e0b9a5ad35 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:25.443469 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef689d9c-d630-4ce5-b592-45e0b9a5ad35 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:25.452266 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 566/1137] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:23:25 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:23:25.459505 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000fd1a-b2ef-46ee-9719-1a5c8707b1c8 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:25.469414 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000fd1a-b2ef-46ee-9719-1a5c8707b1c8 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:25.474284 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f10fe7-9bb8-44e1-b22a-71abadda7764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:25.475032 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f10fe7-9bb8-44e1-b22a-71abadda7764 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:25.475346 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f10fe7-9bb8-44e1-b22a-71abadda7764 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:25.475566 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f10fe7-9bb8-44e1-b22a-71abadda7764 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:25.486214 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f10fe7-9bb8-44e1-b22a-71abadda7764 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:25.488589 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f10fe7-9bb8-44e1-b22a-71abadda7764 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:25.515463 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-12f10fe7-9bb8-44e1-b22a-71abadda7764 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:23:25.520952 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 572/1138] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:23:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:23:25.523899 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef689d9c-d630-4ce5-b592-45e0b9a5ad35 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:25.533200 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef689d9c-d630-4ce5-b592-45e0b9a5ad35 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:25.539484 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77b291-0cd3-4c09-9bb2-d8c2b178bcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:25.540144 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77b291-0cd3-4c09-9bb2-d8c2b178bcac admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:25.540425 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77b291-0cd3-4c09-9bb2-d8c2b178bcac admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:25.540700 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77b291-0cd3-4c09-9bb2-d8c2b178bcac admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:25.541429 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77b291-0cd3-4c09-9bb2-d8c2b178bcac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:25.541760 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77b291-0cd3-4c09-9bb2-d8c2b178bcac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:25.543322 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77b291-0cd3-4c09-9bb2-d8c2b178bcac admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:25.556798 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 567/1139] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:23:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:23:25.563084 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f10fe7-9bb8-44e1-b22a-71abadda7764 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:25.573701 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f10fe7-9bb8-44e1-b22a-71abadda7764 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:25.578715 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cdabaa-ddc3-40d4-9580-a11bd40dc7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:25.579784 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdabaa-ddc3-40d4-9580-a11bd40dc7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:25.580206 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdabaa-ddc3-40d4-9580-a11bd40dc7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:25.580558 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdabaa-ddc3-40d4-9580-a11bd40dc7f5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:25.588423 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cdabaa-ddc3-40d4-9580-a11bd40dc7f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:25.590831 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cdabaa-ddc3-40d4-9580-a11bd40dc7f5 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:25.603963 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-74cdabaa-ddc3-40d4-9580-a11bd40dc7f5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:23:25.605252 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 573/1140] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:23:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:23:25.611792 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77b291-0cd3-4c09-9bb2-d8c2b178bcac admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:25.622984 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77b291-0cd3-4c09-9bb2-d8c2b178bcac admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:25.628900 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3359d8-9afb-433f-b0fc-f3cd502a5cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:25.629745 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3359d8-9afb-433f-b0fc-f3cd502a5cab admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:25.630034 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3359d8-9afb-433f-b0fc-f3cd502a5cab admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:25.630367 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3359d8-9afb-433f-b0fc-f3cd502a5cab admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:25.631456 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3359d8-9afb-433f-b0fc-f3cd502a5cab admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:25.631807 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3359d8-9afb-433f-b0fc-f3cd502a5cab admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:25.636488 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3359d8-9afb-433f-b0fc-f3cd502a5cab admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:25.649784 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 568/1141] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:23:25 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:25.657851 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cdabaa-ddc3-40d4-9580-a11bd40dc7f5 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:25.669747 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cdabaa-ddc3-40d4-9580-a11bd40dc7f5 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:25.674439 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee30b5c-c820-40a5-ac29-de9beeb01662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:25.675685 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee30b5c-c820-40a5-ac29-de9beeb01662 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:25.675967 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee30b5c-c820-40a5-ac29-de9beeb01662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:25.676295 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee30b5c-c820-40a5-ac29-de9beeb01662 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:25.677083 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee30b5c-c820-40a5-ac29-de9beeb01662 admin admin] RBAC: Adding query filter params (role.id=983c0291e0fa484ea053a791ead0e9c5, scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6, user.id=2ff82e315d8c42e49556ab67fbf53b32) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:25.677380 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee30b5c-c820-40a5-ac29-de9beeb01662 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:25.679233 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee30b5c-c820-40a5-ac29-de9beeb01662 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:25.685308 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 574/1142] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:23:25 2021] GET /identity/v3/role_assignments?user.id=2ff82e315d8c42e49556ab67fbf53b32&scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6&role.id=983c0291e0fa484ea053a791ead0e9c5 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:28.274063 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3eecc0-0c17-46be-9cb1-e42f6f4432b1 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:28.274604 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3eecc0-0c17-46be-9cb1-e42f6f4432b1 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:28.274604 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3eecc0-0c17-46be-9cb1-e42f6f4432b1 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:28.276287 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 569/1143] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:23:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:23:28.283675 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16985e-5e1b-4d57-b640-a4cf1c7942fb None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:28.284105 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16985e-5e1b-4d57-b640-a4cf1c7942fb None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:28.284793 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16985e-5e1b-4d57-b640-a4cf1c7942fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:28.305549 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-db16985e-5e1b-4d57-b640-a4cf1c7942fb None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:28.306772 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-db16985e-5e1b-4d57-b640-a4cf1c7942fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:28.315879 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 575/1144] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:23:28 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:28.340917 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3eecc0-0c17-46be-9cb1-e42f6f4432b1 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:28.354067 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3eecc0-0c17-46be-9cb1-e42f6f4432b1 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:28.358705 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7d37c-e29c-4c68-afcf-c25bf44875fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:28.359481 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7d37c-e29c-4c68-afcf-c25bf44875fb admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:28.359767 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7d37c-e29c-4c68-afcf-c25bf44875fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:28.360042 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7d37c-e29c-4c68-afcf-c25bf44875fb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:28.370633 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7d37c-e29c-4c68-afcf-c25bf44875fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:23:28.377828 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-68a7d37c-e29c-4c68-afcf-c25bf44875fb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:23:28.379030 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 570/1145] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:23:28 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:23:28.386163 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16985e-5e1b-4d57-b640-a4cf1c7942fb None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:28.395745 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16985e-5e1b-4d57-b640-a4cf1c7942fb None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:28.401043 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bc560-df2d-401e-a81d-a46bbe2f93cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:28.401767 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bc560-df2d-401e-a81d-a46bbe2f93cf admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:28.402111 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bc560-df2d-401e-a81d-a46bbe2f93cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:28.402388 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bc560-df2d-401e-a81d-a46bbe2f93cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:28.403172 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755bc560-df2d-401e-a81d-a46bbe2f93cf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:28.403508 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755bc560-df2d-401e-a81d-a46bbe2f93cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:28.405373 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755bc560-df2d-401e-a81d-a46bbe2f93cf admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:28.414411 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 576/1146] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:23:28 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:28.420931 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7d37c-e29c-4c68-afcf-c25bf44875fb admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:28.431156 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7d37c-e29c-4c68-afcf-c25bf44875fb admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:28.436019 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcdc64-8020-4ba8-be59-1a551ba6dc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:28.437505 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcdc64-8020-4ba8-be59-1a551ba6dc25 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:28.437868 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcdc64-8020-4ba8-be59-1a551ba6dc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:28.438152 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcdc64-8020-4ba8-be59-1a551ba6dc25 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:28.448457 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dcdc64-8020-4ba8-be59-1a551ba6dc25 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:28.450325 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dcdc64-8020-4ba8-be59-1a551ba6dc25 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:28.467582 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-a3dcdc64-8020-4ba8-be59-1a551ba6dc25 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:23:28.468756 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 571/1147] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:23:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:23:28.475743 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bc560-df2d-401e-a81d-a46bbe2f93cf admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:28.487249 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bc560-df2d-401e-a81d-a46bbe2f93cf admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:28.492955 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafd033-939b-41d8-b23a-dac9ae7ceca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:28.493633 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafd033-939b-41d8-b23a-dac9ae7ceca3 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:28.493916 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafd033-939b-41d8-b23a-dac9ae7ceca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:28.494192 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafd033-939b-41d8-b23a-dac9ae7ceca3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:28.494912 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafd033-939b-41d8-b23a-dac9ae7ceca3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:28.495220 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafd033-939b-41d8-b23a-dac9ae7ceca3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:28.497265 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafd033-939b-41d8-b23a-dac9ae7ceca3 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:28.517033 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 577/1148] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:23:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:28.518313 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcdc64-8020-4ba8-be59-1a551ba6dc25 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:28.529156 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcdc64-8020-4ba8-be59-1a551ba6dc25 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:28.534085 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b09647-7a56-4318-a85f-aa7922697b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:28.534872 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b09647-7a56-4318-a85f-aa7922697b48 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:28.535192 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b09647-7a56-4318-a85f-aa7922697b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:28.535444 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b09647-7a56-4318-a85f-aa7922697b48 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:28.542875 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b09647-7a56-4318-a85f-aa7922697b48 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:28.544865 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b09647-7a56-4318-a85f-aa7922697b48 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:28.559638 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-03b09647-7a56-4318-a85f-aa7922697b48 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 01:23:28.560992 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 572/1149] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:23:28 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:23:28.569248 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafd033-939b-41d8-b23a-dac9ae7ceca3 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:28.579018 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafd033-939b-41d8-b23a-dac9ae7ceca3 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:28.583981 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4eb3e-c648-435f-a92f-fb64da812cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:28.584646 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4eb3e-c648-435f-a92f-fb64da812cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:28.584931 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4eb3e-c648-435f-a92f-fb64da812cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:28.585210 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4eb3e-c648-435f-a92f-fb64da812cc8 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:28.586102 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4eb3e-c648-435f-a92f-fb64da812cc8 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:28.586416 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4eb3e-c648-435f-a92f-fb64da812cc8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:28.588265 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4eb3e-c648-435f-a92f-fb64da812cc8 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:28.606220 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 578/1150] 10.222.0.25 () {56 vars in 1164 bytes} [Wed Oct 27 01:23:28 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:28.614297 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b09647-7a56-4318-a85f-aa7922697b48 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:28.624143 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b09647-7a56-4318-a85f-aa7922697b48 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:28.629817 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57dbd75-1483-4fa5-bb64-efe65ad931f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:28.630498 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dbd75-1483-4fa5-bb64-efe65ad931f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:28.630748 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dbd75-1483-4fa5-bb64-efe65ad931f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:28.631051 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dbd75-1483-4fa5-bb64-efe65ad931f9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:28.639893 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57dbd75-1483-4fa5-bb64-efe65ad931f9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:28.642698 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57dbd75-1483-4fa5-bb64-efe65ad931f9 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:28.654899 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 573/1151] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:23:28 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:23:28.662359 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4eb3e-c648-435f-a92f-fb64da812cc8 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:28.672871 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4eb3e-c648-435f-a92f-fb64da812cc8 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:28.679532 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09322317-736d-407e-bb07-f966f6790d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:28.680529 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09322317-736d-407e-bb07-f966f6790d32 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:28.680847 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09322317-736d-407e-bb07-f966f6790d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:28.681332 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09322317-736d-407e-bb07-f966f6790d32 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:28.694737 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09322317-736d-407e-bb07-f966f6790d32 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:28.696980 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09322317-736d-407e-bb07-f966f6790d32 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:28.717347 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-09322317-736d-407e-bb07-f966f6790d32 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:23:28.718902 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 579/1152] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:23:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:23:28.728806 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57dbd75-1483-4fa5-bb64-efe65ad931f9 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:28.743950 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57dbd75-1483-4fa5-bb64-efe65ad931f9 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:28.750465 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6e367-f3ea-4857-99f5-256ea50c7aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:28.751494 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6e367-f3ea-4857-99f5-256ea50c7aca admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:28.751957 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6e367-f3ea-4857-99f5-256ea50c7aca admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:28.752233 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6e367-f3ea-4857-99f5-256ea50c7aca admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:28.753433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6e367-f3ea-4857-99f5-256ea50c7aca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:28.753924 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6e367-f3ea-4857-99f5-256ea50c7aca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:28.756143 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6e367-f3ea-4857-99f5-256ea50c7aca admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:28.771681 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 574/1153] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:23:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:28.778559 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09322317-736d-407e-bb07-f966f6790d32 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:28.789974 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09322317-736d-407e-bb07-f966f6790d32 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:28.794963 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22ff10-6a40-4715-b815-08bfe184cd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:28.795783 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22ff10-6a40-4715-b815-08bfe184cd41 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:28.796086 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22ff10-6a40-4715-b815-08bfe184cd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:28.796385 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22ff10-6a40-4715-b815-08bfe184cd41 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:28.804520 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22ff10-6a40-4715-b815-08bfe184cd41 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:28.806888 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22ff10-6a40-4715-b815-08bfe184cd41 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:28.820664 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-9e22ff10-6a40-4715-b815-08bfe184cd41 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:23:28.822093 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 580/1154] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:23:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:23:28.829084 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6e367-f3ea-4857-99f5-256ea50c7aca admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:28.839928 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6e367-f3ea-4857-99f5-256ea50c7aca admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:28.845146 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab6a9e-680f-4ebc-b366-074311545e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:28.845911 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab6a9e-680f-4ebc-b366-074311545e93 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:28.846231 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab6a9e-680f-4ebc-b366-074311545e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:28.846538 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab6a9e-680f-4ebc-b366-074311545e93 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:28.847883 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab6a9e-680f-4ebc-b366-074311545e93 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:28.848241 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab6a9e-680f-4ebc-b366-074311545e93 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:28.850202 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab6a9e-680f-4ebc-b366-074311545e93 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:28.863512 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 575/1155] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:23:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:28.870638 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22ff10-6a40-4715-b815-08bfe184cd41 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:28.882297 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22ff10-6a40-4715-b815-08bfe184cd41 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:28.886918 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96581306-0fa8-4c2f-b6e9-4d3f3598cf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:28.888272 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96581306-0fa8-4c2f-b6e9-4d3f3598cf20 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:28.888272 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96581306-0fa8-4c2f-b6e9-4d3f3598cf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:28.888272 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96581306-0fa8-4c2f-b6e9-4d3f3598cf20 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:28.888919 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96581306-0fa8-4c2f-b6e9-4d3f3598cf20 admin admin] RBAC: Adding query filter params (role.id=df3a437e6ea14518a9c1b9a348e18c99, scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6, user.id=2ff82e315d8c42e49556ab67fbf53b32) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:28.889230 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96581306-0fa8-4c2f-b6e9-4d3f3598cf20 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:28.891101 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96581306-0fa8-4c2f-b6e9-4d3f3598cf20 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:28.896670 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 581/1156] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:23:28 2021] GET /identity/v3/role_assignments?user.id=2ff82e315d8c42e49556ab67fbf53b32&scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6&role.id=df3a437e6ea14518a9c1b9a348e18c99 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:31.226319 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5e1af-ac89-43a0-9acd-83d02c72d997 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:31.226836 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5e1af-ac89-43a0-9acd-83d02c72d997 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:31.226836 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5e1af-ac89-43a0-9acd-83d02c72d997 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:31.228588 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 576/1157] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:23:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:23:31.234448 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76877044-0541-465d-966d-2c528b36b651 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:31.234836 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76877044-0541-465d-966d-2c528b36b651 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:31.234995 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76877044-0541-465d-966d-2c528b36b651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:31.252014 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-76877044-0541-465d-966d-2c528b36b651 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:31.253730 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-76877044-0541-465d-966d-2c528b36b651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:31.261104 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 582/1158] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:23:31 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:31.284366 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5e1af-ac89-43a0-9acd-83d02c72d997 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:31.296502 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5e1af-ac89-43a0-9acd-83d02c72d997 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:31.300818 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ef40e-8d97-4187-b142-4bb93555e7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:31.301628 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ef40e-8d97-4187-b142-4bb93555e7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:31.301918 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ef40e-8d97-4187-b142-4bb93555e7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:31.302200 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ef40e-8d97-4187-b142-4bb93555e7f2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:31.312403 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ef40e-8d97-4187-b142-4bb93555e7f2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:23:31.319819 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-f14ef40e-8d97-4187-b142-4bb93555e7f2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:23:31.320962 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 577/1159] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:23:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:23:31.327551 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76877044-0541-465d-966d-2c528b36b651 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:31.336878 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76877044-0541-465d-966d-2c528b36b651 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:31.341311 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cc768-2eda-402c-b6ee-18d978d9c3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:31.341992 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cc768-2eda-402c-b6ee-18d978d9c3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:31.342279 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cc768-2eda-402c-b6ee-18d978d9c3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:31.342556 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cc768-2eda-402c-b6ee-18d978d9c3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:31.343306 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cc768-2eda-402c-b6ee-18d978d9c3b7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:31.343610 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cc768-2eda-402c-b6ee-18d978d9c3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:31.345173 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cc768-2eda-402c-b6ee-18d978d9c3b7 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:31.353133 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 583/1160] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:23:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:31.359010 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ef40e-8d97-4187-b142-4bb93555e7f2 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:31.369389 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ef40e-8d97-4187-b142-4bb93555e7f2 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:31.373867 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e02b98-8393-4efa-aa09-06850cd5abb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:31.374630 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e02b98-8393-4efa-aa09-06850cd5abb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:31.374919 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e02b98-8393-4efa-aa09-06850cd5abb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:31.375198 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e02b98-8393-4efa-aa09-06850cd5abb9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:31.385839 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e02b98-8393-4efa-aa09-06850cd5abb9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:31.387632 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e02b98-8393-4efa-aa09-06850cd5abb9 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:31.404908 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-f9e02b98-8393-4efa-aa09-06850cd5abb9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:23:31.406175 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 578/1161] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:23:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:23:31.412028 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cc768-2eda-402c-b6ee-18d978d9c3b7 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:31.421349 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cc768-2eda-402c-b6ee-18d978d9c3b7 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:31.426425 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592c594-91b1-4d0a-b243-eb22682c4201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:31.427058 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592c594-91b1-4d0a-b243-eb22682c4201 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:31.427345 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592c594-91b1-4d0a-b243-eb22682c4201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:31.427631 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592c594-91b1-4d0a-b243-eb22682c4201 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:31.428353 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592c594-91b1-4d0a-b243-eb22682c4201 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:31.428664 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592c594-91b1-4d0a-b243-eb22682c4201 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:31.430267 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592c594-91b1-4d0a-b243-eb22682c4201 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:31.442416 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 584/1162] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:23:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:31.448404 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e02b98-8393-4efa-aa09-06850cd5abb9 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:31.458031 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e02b98-8393-4efa-aa09-06850cd5abb9 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:31.462551 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92d09d-bd4c-4e12-b31e-6ba81e06889a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:31.463316 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92d09d-bd4c-4e12-b31e-6ba81e06889a admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:31.463620 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92d09d-bd4c-4e12-b31e-6ba81e06889a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:31.463916 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92d09d-bd4c-4e12-b31e-6ba81e06889a admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:31.471062 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92d09d-bd4c-4e12-b31e-6ba81e06889a admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:31.473196 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92d09d-bd4c-4e12-b31e-6ba81e06889a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:31.487259 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-1f92d09d-bd4c-4e12-b31e-6ba81e06889a admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 01:23:31.488905 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 579/1163] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:23:31 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:23:31.494709 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592c594-91b1-4d0a-b243-eb22682c4201 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:31.503967 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592c594-91b1-4d0a-b243-eb22682c4201 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:31.508570 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c19dd-60aa-42da-aad5-7354f2a0c9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:31.509202 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c19dd-60aa-42da-aad5-7354f2a0c9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:31.509501 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c19dd-60aa-42da-aad5-7354f2a0c9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:31.509799 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c19dd-60aa-42da-aad5-7354f2a0c9e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:31.510630 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c19dd-60aa-42da-aad5-7354f2a0c9e4 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:31.510940 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c19dd-60aa-42da-aad5-7354f2a0c9e4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:31.512730 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c19dd-60aa-42da-aad5-7354f2a0c9e4 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:31.529642 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 585/1164] 10.222.0.25 () {56 vars in 1164 bytes} [Wed Oct 27 01:23:31 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:31.536290 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92d09d-bd4c-4e12-b31e-6ba81e06889a admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:31.545771 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92d09d-bd4c-4e12-b31e-6ba81e06889a admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:31.551015 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b325a03-7109-405c-a074-18ed683db1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:31.551751 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b325a03-7109-405c-a074-18ed683db1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:31.552035 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b325a03-7109-405c-a074-18ed683db1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:31.552309 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b325a03-7109-405c-a074-18ed683db1c3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:31.562848 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b325a03-7109-405c-a074-18ed683db1c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:31.564689 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b325a03-7109-405c-a074-18ed683db1c3 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:31.582093 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-2b325a03-7109-405c-a074-18ed683db1c3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:23:31.583246 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 580/1165] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:23:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:23:31.589067 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c19dd-60aa-42da-aad5-7354f2a0c9e4 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:31.598350 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c19dd-60aa-42da-aad5-7354f2a0c9e4 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:31.602939 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292feaf4-d2a5-4ba8-8a30-a43677af8f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:31.603567 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292feaf4-d2a5-4ba8-8a30-a43677af8f68 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:31.603859 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292feaf4-d2a5-4ba8-8a30-a43677af8f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:31.604142 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292feaf4-d2a5-4ba8-8a30-a43677af8f68 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:31.604863 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292feaf4-d2a5-4ba8-8a30-a43677af8f68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:31.605174 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292feaf4-d2a5-4ba8-8a30-a43677af8f68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:31.606773 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292feaf4-d2a5-4ba8-8a30-a43677af8f68 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:31.618242 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 586/1166] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:23:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:31.623955 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b325a03-7109-405c-a074-18ed683db1c3 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:31.634121 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b325a03-7109-405c-a074-18ed683db1c3 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:31.638697 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03209215-c036-4b84-a554-3e592da8b9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:31.639449 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03209215-c036-4b84-a554-3e592da8b9cb admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:31.639739 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03209215-c036-4b84-a554-3e592da8b9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:31.640050 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03209215-c036-4b84-a554-3e592da8b9cb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:31.646767 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03209215-c036-4b84-a554-3e592da8b9cb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:31.648784 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03209215-c036-4b84-a554-3e592da8b9cb admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:31.661854 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-03209215-c036-4b84-a554-3e592da8b9cb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:23:31.662924 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 581/1167] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:23:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:23:31.668811 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292feaf4-d2a5-4ba8-8a30-a43677af8f68 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:31.678410 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292feaf4-d2a5-4ba8-8a30-a43677af8f68 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:31.683089 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f4e62-899c-4bf4-bebf-a2f29266f6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:31.683701 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f4e62-899c-4bf4-bebf-a2f29266f6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:31.683979 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f4e62-899c-4bf4-bebf-a2f29266f6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:31.684251 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f4e62-899c-4bf4-bebf-a2f29266f6b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:31.685015 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f4e62-899c-4bf4-bebf-a2f29266f6b5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:31.685320 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f4e62-899c-4bf4-bebf-a2f29266f6b5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:31.687135 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f4e62-899c-4bf4-bebf-a2f29266f6b5 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:31.699074 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 587/1168] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:23:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:31.705007 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03209215-c036-4b84-a554-3e592da8b9cb admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:31.715004 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03209215-c036-4b84-a554-3e592da8b9cb admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:31.719474 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616a1a7-2841-48a9-9317-172a26474515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:31.720406 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616a1a7-2841-48a9-9317-172a26474515 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:31.720735 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616a1a7-2841-48a9-9317-172a26474515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:31.721105 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616a1a7-2841-48a9-9317-172a26474515 admin admin] PATH_INFO: `/v3/projects/2b95c6a455e74d9487ae73f44a9ba0e6/users/2ff82e315d8c42e49556ab67fbf53b32/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:31.724120 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616a1a7-2841-48a9-9317-172a26474515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b95c6a455e74d9487ae73f44a9ba0e6, user_id=2ff82e315d8c42e49556ab67fbf53b32, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:31.727543 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616a1a7-2841-48a9-9317-172a26474515 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:31.743662 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 582/1169] 10.222.0.25 () {58 vars in 1460 bytes} [Wed Oct 27 01:23:31 2021] PUT /identity/v3/projects/2b95c6a455e74d9487ae73f44a9ba0e6/users/2ff82e315d8c42e49556ab67fbf53b32/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:33.986021 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3b62c-e2d8-451b-8a58-57101b91198e None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:33.986485 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3b62c-e2d8-451b-8a58-57101b91198e None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:33.986595 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3b62c-e2d8-451b-8a58-57101b91198e None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:33.988987 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 588/1170] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:23:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:23:33.994773 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a48cd-4915-4461-a7fa-79aecd070128 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:33.995200 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a48cd-4915-4461-a7fa-79aecd070128 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:33.995335 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a48cd-4915-4461-a7fa-79aecd070128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:34.012154 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-5f3a48cd-4915-4461-a7fa-79aecd070128 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:34.013361 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-5f3a48cd-4915-4461-a7fa-79aecd070128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:34.068501 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 583/1171] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:23:33 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:34.092546 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3b62c-e2d8-451b-8a58-57101b91198e None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:34.105938 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3b62c-e2d8-451b-8a58-57101b91198e None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:34.110866 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7905d7a-df13-414d-899f-83f4abaf5e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:34.111738 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7905d7a-df13-414d-899f-83f4abaf5e77 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:34.112030 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7905d7a-df13-414d-899f-83f4abaf5e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:34.113022 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7905d7a-df13-414d-899f-83f4abaf5e77 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:34.124377 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7905d7a-df13-414d-899f-83f4abaf5e77 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:23:34.131703 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-f7905d7a-df13-414d-899f-83f4abaf5e77 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:23:34.132990 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 589/1172] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Oct 27 01:23:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:23:34.139105 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a48cd-4915-4461-a7fa-79aecd070128 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:34.147733 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a48cd-4915-4461-a7fa-79aecd070128 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:34.152251 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4972dec-45e7-4242-9fbe-36f42b2c6e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:34.152897 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4972dec-45e7-4242-9fbe-36f42b2c6e55 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:34.153183 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4972dec-45e7-4242-9fbe-36f42b2c6e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:34.153462 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4972dec-45e7-4242-9fbe-36f42b2c6e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:34.154243 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4972dec-45e7-4242-9fbe-36f42b2c6e55 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:34.154554 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4972dec-45e7-4242-9fbe-36f42b2c6e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:34.156117 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4972dec-45e7-4242-9fbe-36f42b2c6e55 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:34.164565 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 584/1173] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Oct 27 01:23:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:34.170594 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7905d7a-df13-414d-899f-83f4abaf5e77 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:34.181476 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7905d7a-df13-414d-899f-83f4abaf5e77 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:34.186787 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb447f46-d6c4-435f-9e27-5865e8b7a649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:34.187589 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb447f46-d6c4-435f-9e27-5865e8b7a649 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:34.187907 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb447f46-d6c4-435f-9e27-5865e8b7a649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:34.188214 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb447f46-d6c4-435f-9e27-5865e8b7a649 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:34.199114 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb447f46-d6c4-435f-9e27-5865e8b7a649 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:34.201060 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb447f46-d6c4-435f-9e27-5865e8b7a649 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:34.218235 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-fb447f46-d6c4-435f-9e27-5865e8b7a649 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:23:34.219471 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 590/1174] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:23:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:23:34.225849 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4972dec-45e7-4242-9fbe-36f42b2c6e55 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:34.235013 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4972dec-45e7-4242-9fbe-36f42b2c6e55 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:34.240210 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd23828-f501-464a-bf96-7b0b365e01cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:34.240830 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd23828-f501-464a-bf96-7b0b365e01cb admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:34.241116 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd23828-f501-464a-bf96-7b0b365e01cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:34.241394 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd23828-f501-464a-bf96-7b0b365e01cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:34.242214 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd23828-f501-464a-bf96-7b0b365e01cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:34.242522 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd23828-f501-464a-bf96-7b0b365e01cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:34.244053 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd23828-f501-464a-bf96-7b0b365e01cb admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:34.255355 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 585/1175] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:23:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:34.261288 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb447f46-d6c4-435f-9e27-5865e8b7a649 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:34.270933 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb447f46-d6c4-435f-9e27-5865e8b7a649 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:34.275638 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e789af3-28e9-40bb-97af-a38d2c031eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:34.276439 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e789af3-28e9-40bb-97af-a38d2c031eaa admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:34.276725 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e789af3-28e9-40bb-97af-a38d2c031eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:34.277008 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e789af3-28e9-40bb-97af-a38d2c031eaa admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:34.284967 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e789af3-28e9-40bb-97af-a38d2c031eaa admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:34.287101 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e789af3-28e9-40bb-97af-a38d2c031eaa admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:34.303221 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-4e789af3-28e9-40bb-97af-a38d2c031eaa admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 01:23:34.304426 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 591/1176] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:23:34 2021] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:23:34.310463 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd23828-f501-464a-bf96-7b0b365e01cb admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:34.319459 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd23828-f501-464a-bf96-7b0b365e01cb admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:34.323814 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df36e5-c2a2-47c9-95b5-c9c9cb3681a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:34.324444 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df36e5-c2a2-47c9-95b5-c9c9cb3681a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:34.324726 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df36e5-c2a2-47c9-95b5-c9c9cb3681a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:34.325000 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df36e5-c2a2-47c9-95b5-c9c9cb3681a3 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:34.325861 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df36e5-c2a2-47c9-95b5-c9c9cb3681a3 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:34.326170 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df36e5-c2a2-47c9-95b5-c9c9cb3681a3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:34.327938 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df36e5-c2a2-47c9-95b5-c9c9cb3681a3 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:34.344809 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 586/1177] 10.222.0.25 () {56 vars in 1164 bytes} [Wed Oct 27 01:23:34 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:34.360297 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e789af3-28e9-40bb-97af-a38d2c031eaa admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:34.369900 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e789af3-28e9-40bb-97af-a38d2c031eaa admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:34.374449 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af496c-3d6f-44a2-8ffc-1c874dcb569b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:34.375079 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af496c-3d6f-44a2-8ffc-1c874dcb569b admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:34.375395 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af496c-3d6f-44a2-8ffc-1c874dcb569b admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:34.375678 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af496c-3d6f-44a2-8ffc-1c874dcb569b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:34.383346 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af496c-3d6f-44a2-8ffc-1c874dcb569b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:34.385072 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af496c-3d6f-44a2-8ffc-1c874dcb569b admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:34.394200 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 592/1178] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Oct 27 01:23:34 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:23:34.400340 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df36e5-c2a2-47c9-95b5-c9c9cb3681a3 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:34.410339 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df36e5-c2a2-47c9-95b5-c9c9cb3681a3 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:34.414759 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a8a14-22bf-4c4b-8cb9-02f0d1dc30f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:34.415525 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a8a14-22bf-4c4b-8cb9-02f0d1dc30f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:34.415808 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a8a14-22bf-4c4b-8cb9-02f0d1dc30f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:34.416085 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a8a14-22bf-4c4b-8cb9-02f0d1dc30f6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:34.425854 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a8a14-22bf-4c4b-8cb9-02f0d1dc30f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:34.427626 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a8a14-22bf-4c4b-8cb9-02f0d1dc30f6 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:34.443789 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-980a8a14-22bf-4c4b-8cb9-02f0d1dc30f6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:23:34.444870 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 587/1179] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Oct 27 01:23:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:23:34.450748 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af496c-3d6f-44a2-8ffc-1c874dcb569b admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:34.459753 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af496c-3d6f-44a2-8ffc-1c874dcb569b admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:34.464248 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c60da-d84f-4944-a259-0d6ec679795f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:34.464880 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c60da-d84f-4944-a259-0d6ec679795f admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:34.465166 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c60da-d84f-4944-a259-0d6ec679795f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:34.465445 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c60da-d84f-4944-a259-0d6ec679795f admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:34.466213 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c60da-d84f-4944-a259-0d6ec679795f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:34.466519 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c60da-d84f-4944-a259-0d6ec679795f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:34.468051 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c60da-d84f-4944-a259-0d6ec679795f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:34.479766 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 593/1180] 10.222.0.25 () {56 vars in 1130 bytes} [Wed Oct 27 01:23:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:34.485301 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a8a14-22bf-4c4b-8cb9-02f0d1dc30f6 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:34.494848 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a8a14-22bf-4c4b-8cb9-02f0d1dc30f6 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:34.499233 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5dbda5-8eb5-447a-bb69-e898de2af342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:34.499977 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5dbda5-8eb5-447a-bb69-e898de2af342 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:34.500258 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5dbda5-8eb5-447a-bb69-e898de2af342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:34.500533 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5dbda5-8eb5-447a-bb69-e898de2af342 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:34.507101 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5dbda5-8eb5-447a-bb69-e898de2af342 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:34.508990 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5dbda5-8eb5-447a-bb69-e898de2af342 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:34.522010 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING keystone.server.flask.application [None req-bc5dbda5-8eb5-447a-bb69-e898de2af342 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:23:34.523080 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 588/1181] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Oct 27 01:23:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:23:34.529008 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c60da-d84f-4944-a259-0d6ec679795f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:34.538771 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c60da-d84f-4944-a259-0d6ec679795f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:34.543256 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52612256-d5c0-4d76-b908-02a3e08cf2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:34.543875 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52612256-d5c0-4d76-b908-02a3e08cf2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:34.544158 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52612256-d5c0-4d76-b908-02a3e08cf2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:34.544434 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52612256-d5c0-4d76-b908-02a3e08cf2a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:34.545213 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52612256-d5c0-4d76-b908-02a3e08cf2a4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:34.545553 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52612256-d5c0-4d76-b908-02a3e08cf2a4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:34.547331 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52612256-d5c0-4d76-b908-02a3e08cf2a4 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:34.559194 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 594/1182] 10.222.0.25 () {56 vars in 1169 bytes} [Wed Oct 27 01:23:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:34.565185 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5dbda5-8eb5-447a-bb69-e898de2af342 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:34.574887 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5dbda5-8eb5-447a-bb69-e898de2af342 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:34.579281 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24183a0-9300-43c7-ba5c-134782368929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:34.579880 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24183a0-9300-43c7-ba5c-134782368929 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:34.580160 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24183a0-9300-43c7-ba5c-134782368929 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:34.580433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24183a0-9300-43c7-ba5c-134782368929 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:34.581790 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24183a0-9300-43c7-ba5c-134782368929 admin admin] RBAC: Adding query filter params (role.id=df3a437e6ea14518a9c1b9a348e18c99, scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6, user.id=2ff82e315d8c42e49556ab67fbf53b32) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:34.582097 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24183a0-9300-43c7-ba5c-134782368929 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:34.583862 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24183a0-9300-43c7-ba5c-134782368929 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:34.589544 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 589/1183] 10.222.0.25 () {56 vars in 1395 bytes} [Wed Oct 27 01:23:34 2021] GET /identity/v3/role_assignments?user.id=2ff82e315d8c42e49556ab67fbf53b32&scope.project.id=2b95c6a455e74d9487ae73f44a9ba0e6&role.id=df3a437e6ea14518a9c1b9a348e18c99 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:36.885421 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e541d0-06c8-4c0f-889e-e9232bcf660b None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:36.885976 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e541d0-06c8-4c0f-889e-e9232bcf660b None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:36.886068 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e541d0-06c8-4c0f-889e-e9232bcf660b None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:36.887889 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 595/1184] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:23:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:23:36.893924 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34244f67-6644-42db-9cad-a548118d2128 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:36.894323 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34244f67-6644-42db-9cad-a548118d2128 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:36.894475 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34244f67-6644-42db-9cad-a548118d2128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:36.911403 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-34244f67-6644-42db-9cad-a548118d2128 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:36.912560 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-34244f67-6644-42db-9cad-a548118d2128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:36.919987 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 590/1185] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:23:36 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:36.943278 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e541d0-06c8-4c0f-889e-e9232bcf660b None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:36.955155 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e541d0-06c8-4c0f-889e-e9232bcf660b None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:36.959533 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55aceb-262c-479b-ad3d-96c14599b93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:36.960305 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55aceb-262c-479b-ad3d-96c14599b93b admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:36.960586 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55aceb-262c-479b-ad3d-96c14599b93b admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:36.960858 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55aceb-262c-479b-ad3d-96c14599b93b admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:36.961570 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55aceb-262c-479b-ad3d-96c14599b93b admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:36.963134 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55aceb-262c-479b-ad3d-96c14599b93b admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:36.974507 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-fd55aceb-262c-479b-ad3d-96c14599b93b admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 01:23:36.975624 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 596/1186] 10.222.0.25 () {56 vars in 1138 bytes} [Wed Oct 27 01:23:36 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:23:36.982042 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34244f67-6644-42db-9cad-a548118d2128 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:36.991276 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34244f67-6644-42db-9cad-a548118d2128 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:36.995784 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364fe51f-51b7-45c6-abcb-bb269990150f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:36.996437 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fe51f-51b7-45c6-abcb-bb269990150f admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:36.996724 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fe51f-51b7-45c6-abcb-bb269990150f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:36.997002 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fe51f-51b7-45c6-abcb-bb269990150f admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:36.997748 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364fe51f-51b7-45c6-abcb-bb269990150f admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:36.998057 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364fe51f-51b7-45c6-abcb-bb269990150f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:36.999638 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364fe51f-51b7-45c6-abcb-bb269990150f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:37.004276 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 591/1187] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Oct 27 01:23:36 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:23:37.010191 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55aceb-262c-479b-ad3d-96c14599b93b admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:37.019347 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55aceb-262c-479b-ad3d-96c14599b93b admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:37.023807 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bec216-773e-4702-943c-0b520c1496f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:37.024433 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bec216-773e-4702-943c-0b520c1496f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:37.024718 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bec216-773e-4702-943c-0b520c1496f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:37.024998 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bec216-773e-4702-943c-0b520c1496f7 admin admin] PATH_INFO: `/v3/services` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:37.025738 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bec216-773e-4702-943c-0b520c1496f7 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:37.026050 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bec216-773e-4702-943c-0b520c1496f7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:37.027597 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bec216-773e-4702-943c-0b520c1496f7 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:37.031821 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 597/1188] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Oct 27 01:23:37 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:23:39.299037 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400245c1-70f7-4395-bab8-aba1ce09ea21 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:39.299563 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400245c1-70f7-4395-bab8-aba1ce09ea21 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:39.299563 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400245c1-70f7-4395-bab8-aba1ce09ea21 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:39.301276 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 592/1189] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:23:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:23:39.307053 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30350c28-b6a2-4b98-95ae-28e7e2f1eab6 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:39.307731 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30350c28-b6a2-4b98-95ae-28e7e2f1eab6 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:39.307881 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30350c28-b6a2-4b98-95ae-28e7e2f1eab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:39.325730 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-30350c28-b6a2-4b98-95ae-28e7e2f1eab6 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:39.326913 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-30350c28-b6a2-4b98-95ae-28e7e2f1eab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:39.335317 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 598/1190] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:23:39 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:39.359567 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400245c1-70f7-4395-bab8-aba1ce09ea21 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:39.372114 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400245c1-70f7-4395-bab8-aba1ce09ea21 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:39.376453 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7e478-f306-4e82-8567-2b711da5c67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:39.377089 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7e478-f306-4e82-8567-2b711da5c67e admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:39.377378 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7e478-f306-4e82-8567-2b711da5c67e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:39.377731 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7e478-f306-4e82-8567-2b711da5c67e admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:39.378462 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e7e478-f306-4e82-8567-2b711da5c67e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:39.380025 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e7e478-f306-4e82-8567-2b711da5c67e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:39.392590 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 593/1191] 10.222.0.25 () {60 vars in 1162 bytes} [Wed Oct 27 01:23:39 2021] POST /identity/v3/services => generated 246 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:23:41.629219 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564728b7-6a52-43be-b31a-f781bdadcd0e None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:41.629807 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564728b7-6a52-43be-b31a-f781bdadcd0e None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:41.629807 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564728b7-6a52-43be-b31a-f781bdadcd0e None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:41.631595 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 599/1192] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:23:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:23:41.637328 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58bc19-27d3-49ec-ad4a-d0d7eb5b7343 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:41.637718 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58bc19-27d3-49ec-ad4a-d0d7eb5b7343 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:41.637919 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58bc19-27d3-49ec-ad4a-d0d7eb5b7343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:41.655003 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-5a58bc19-27d3-49ec-ad4a-d0d7eb5b7343 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:41.656176 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-5a58bc19-27d3-49ec-ad4a-d0d7eb5b7343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:41.672872 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 594/1193] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:23:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:41.696569 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564728b7-6a52-43be-b31a-f781bdadcd0e None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:41.708353 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564728b7-6a52-43be-b31a-f781bdadcd0e None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:41.712677 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34dceb-711e-434b-89ce-afb745cb50f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:41.713437 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34dceb-711e-434b-89ce-afb745cb50f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:41.713751 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34dceb-711e-434b-89ce-afb745cb50f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:41.714032 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34dceb-711e-434b-89ce-afb745cb50f3 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:41.714689 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34dceb-711e-434b-89ce-afb745cb50f3 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:41.716258 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34dceb-711e-434b-89ce-afb745cb50f3 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:41.730654 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-1e34dceb-711e-434b-89ce-afb745cb50f3 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 01:23:41.732414 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 600/1194] 10.222.0.25 () {56 vars in 1138 bytes} [Wed Oct 27 01:23:41 2021] GET /identity/v3/services/placement => generated 90 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:23:41.742193 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58bc19-27d3-49ec-ad4a-d0d7eb5b7343 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:41.755816 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58bc19-27d3-49ec-ad4a-d0d7eb5b7343 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:41.762848 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4eaa70-8383-4fb7-a736-5503cf70b5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:41.763698 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eaa70-8383-4fb7-a736-5503cf70b5ca admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:41.764224 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eaa70-8383-4fb7-a736-5503cf70b5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:41.764644 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eaa70-8383-4fb7-a736-5503cf70b5ca admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:41.765633 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4eaa70-8383-4fb7-a736-5503cf70b5ca admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:41.766098 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4eaa70-8383-4fb7-a736-5503cf70b5ca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:41.768448 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4eaa70-8383-4fb7-a736-5503cf70b5ca admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:41.775718 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 595/1195] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Oct 27 01:23:41 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:23:41.785280 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34dceb-711e-434b-89ce-afb745cb50f3 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:41.797194 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34dceb-711e-434b-89ce-afb745cb50f3 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:41.804027 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c312ef-7fe4-4e65-b877-2268f7bf76dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:41.804713 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c312ef-7fe4-4e65-b877-2268f7bf76dd admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:41.805009 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c312ef-7fe4-4e65-b877-2268f7bf76dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:41.805288 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c312ef-7fe4-4e65-b877-2268f7bf76dd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:41.806134 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c312ef-7fe4-4e65-b877-2268f7bf76dd admin admin] RBAC: Adding query filter params (interface=public, service_id=38e0de125fbe4e53b58aef8e34b593b0, region_id=RegionOne) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:41.806446 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c312ef-7fe4-4e65-b877-2268f7bf76dd admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:41.808286 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c312ef-7fe4-4e65-b877-2268f7bf76dd admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:41.813539 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 601/1196] 10.222.0.25 () {56 vars in 1272 bytes} [Wed Oct 27 01:23:41 2021] GET /identity/v3/endpoints?service_id=38e0de125fbe4e53b58aef8e34b593b0&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:23:41.819909 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4eaa70-8383-4fb7-a736-5503cf70b5ca admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:41.829439 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4eaa70-8383-4fb7-a736-5503cf70b5ca admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:41.834544 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff8f89-e005-49b1-839d-51d53e046a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:41.835179 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff8f89-e005-49b1-839d-51d53e046a84 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:41.835467 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff8f89-e005-49b1-839d-51d53e046a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:41.835746 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff8f89-e005-49b1-839d-51d53e046a84 admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:41.836428 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff8f89-e005-49b1-839d-51d53e046a84 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:41.838025 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff8f89-e005-49b1-839d-51d53e046a84 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:41.844679 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 596/1197] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Oct 27 01:23:41 2021] GET /identity/v3/services => generated 2191 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:23:44.069893 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10f3b6-0c80-4d91-9cd8-1d9027c277f0 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.070418 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10f3b6-0c80-4d91-9cd8-1d9027c277f0 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.070511 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10f3b6-0c80-4d91-9cd8-1d9027c277f0 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.072224 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 602/1198] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:23:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:23:44.078273 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e57bce-77b8-469c-b417-574aaddb0cec None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.078665 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e57bce-77b8-469c-b417-574aaddb0cec None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.078831 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e57bce-77b8-469c-b417-574aaddb0cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.097501 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-06e57bce-77b8-469c-b417-574aaddb0cec None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:44.098692 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-06e57bce-77b8-469c-b417-574aaddb0cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:44.106368 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 597/1199] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:23:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:44.130554 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10f3b6-0c80-4d91-9cd8-1d9027c277f0 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:44.142449 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10f3b6-0c80-4d91-9cd8-1d9027c277f0 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:44.147334 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0e6b0-026a-412a-ba54-82f712b63002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:44.148113 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0e6b0-026a-412a-ba54-82f712b63002 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.148399 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0e6b0-026a-412a-ba54-82f712b63002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.148678 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0e6b0-026a-412a-ba54-82f712b63002 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.149334 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0e6b0-026a-412a-ba54-82f712b63002 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:44.150947 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0e6b0-026a-412a-ba54-82f712b63002 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:44.162484 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING keystone.server.flask.application [None req-08a0e6b0-026a-412a-ba54-82f712b63002 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 01:23:44.163575 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 603/1200] 10.222.0.25 () {56 vars in 1138 bytes} [Wed Oct 27 01:23:44 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:23:44.169926 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e57bce-77b8-469c-b417-574aaddb0cec None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:44.178682 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e57bce-77b8-469c-b417-574aaddb0cec None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:44.183394 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89a208-00aa-4c3e-b2b6-39aee41ed4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:44.184037 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89a208-00aa-4c3e-b2b6-39aee41ed4be admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.184316 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89a208-00aa-4c3e-b2b6-39aee41ed4be admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.184588 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89a208-00aa-4c3e-b2b6-39aee41ed4be admin admin] PATH_INFO: `/v3/services` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.185292 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89a208-00aa-4c3e-b2b6-39aee41ed4be admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:23:44.185629 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89a208-00aa-4c3e-b2b6-39aee41ed4be admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:44.187173 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89a208-00aa-4c3e-b2b6-39aee41ed4be admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:44.192461 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 598/1201] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Oct 27 01:23:44 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:23:44.198461 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0e6b0-026a-412a-ba54-82f712b63002 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:44.208569 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0e6b0-026a-412a-ba54-82f712b63002 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:44.213016 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f33f31-15e0-461b-8bff-e39845f7b618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:44.213652 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f33f31-15e0-461b-8bff-e39845f7b618 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:44.213939 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f33f31-15e0-461b-8bff-e39845f7b618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:44.214217 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f33f31-15e0-461b-8bff-e39845f7b618 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:44.214954 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f33f31-15e0-461b-8bff-e39845f7b618 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:44.216469 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f33f31-15e0-461b-8bff-e39845f7b618 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:44.234393 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 604/1202] 10.222.0.25 () {60 vars in 1165 bytes} [Wed Oct 27 01:23:44 2021] POST /identity/v3/endpoints => generated 331 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:47.696399 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb465e75-b247-4107-a3da-ad49338ca248 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:47.697291 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb465e75-b247-4107-a3da-ad49338ca248 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:47.697663 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb465e75-b247-4107-a3da-ad49338ca248 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:47.699873 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 599/1203] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:24:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:24:47.706100 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101501b1-5f26-4d44-9df3-7ce0cc6784ce None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:47.706535 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101501b1-5f26-4d44-9df3-7ce0cc6784ce None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:47.706660 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101501b1-5f26-4d44-9df3-7ce0cc6784ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:47.789374 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-101501b1-5f26-4d44-9df3-7ce0cc6784ce None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:47.790981 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-101501b1-5f26-4d44-9df3-7ce0cc6784ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:47.905686 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 605/1204] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:24:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:47.929732 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb465e75-b247-4107-a3da-ad49338ca248 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:47.931590 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-fb465e75-b247-4107-a3da-ad49338ca248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:48.068082 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb465e75-b247-4107-a3da-ad49338ca248 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:48.163247 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c9232-878c-46e6-b530-92521b5b7418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:48.164294 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c9232-878c-46e6-b530-92521b5b7418 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:48.164794 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c9232-878c-46e6-b530-92521b5b7418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:48.165286 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c9232-878c-46e6-b530-92521b5b7418 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:48.166285 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c9232-878c-46e6-b530-92521b5b7418 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:48.168457 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c9232-878c-46e6-b530-92521b5b7418 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:48.189050 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 600/1205] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Oct 27 01:24:47 2021] GET /identity/v3/projects => generated 2553 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:50.536528 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd34d6-a43d-4b75-8c2f-032350ee7d64 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:50.537032 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd34d6-a43d-4b75-8c2f-032350ee7d64 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:50.537139 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd34d6-a43d-4b75-8c2f-032350ee7d64 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:50.538917 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 606/1206] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:24:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:24:50.544902 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe259c-4a34-47d5-bd37-ccac74082620 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:50.545332 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe259c-4a34-47d5-bd37-ccac74082620 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:50.545623 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe259c-4a34-47d5-bd37-ccac74082620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:50.623029 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-a7fe259c-4a34-47d5-bd37-ccac74082620 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:50.624232 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-a7fe259c-4a34-47d5-bd37-ccac74082620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:50.719283 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 601/1207] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:24:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:50.772972 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6be6e8-a624-4703-aea9-6d76bae626e1 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:50.773349 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6be6e8-a624-4703-aea9-6d76bae626e1 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:50.773722 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6be6e8-a624-4703-aea9-6d76bae626e1 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:50.775590 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 607/1208] 10.222.0.25 () {54 vars in 964 bytes} [Wed Oct 27 01:24:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:24:50.781799 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f3d92-12fe-4ecb-b891-9700db62e259 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:50.782086 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f3d92-12fe-4ecb-b891-9700db62e259 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:50.782363 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f3d92-12fe-4ecb-b891-9700db62e259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:50.853180 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-3e9f3d92-12fe-4ecb-b891-9700db62e259 None None] MFA Rules not processed for user `bff692322c68420186f2918d380ece98`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:50.854426 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-3e9f3d92-12fe-4ecb-b891-9700db62e259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:50.926307 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 602/1209] 10.222.0.25 () {58 vars in 1061 bytes} [Wed Oct 27 01:24:50 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:24:50.935853 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6be6e8-a624-4703-aea9-6d76bae626e1 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:50.937444 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-8b6be6e8-a624-4703-aea9-6d76bae626e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:51.036417 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6be6e8-a624-4703-aea9-6d76bae626e1 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:51.105615 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf96516-928a-4ce2-8c3d-62bc0a99b600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:51.106261 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf96516-928a-4ce2-8c3d-62bc0a99b600 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:51.106545 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf96516-928a-4ce2-8c3d-62bc0a99b600 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:51.106821 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf96516-928a-4ce2-8c3d-62bc0a99b600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:51.108448 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4bf96516-928a-4ce2-8c3d-62bc0a99b600 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:51.212394 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf96516-928a-4ce2-8c3d-62bc0a99b600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:51.213838 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf96516-928a-4ce2-8c3d-62bc0a99b600 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:51.231436 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 608/1210] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:24:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:53.790666 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a9799-6e13-400f-b846-f04c544cd1a9 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:53.791170 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a9799-6e13-400f-b846-f04c544cd1a9 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:53.791170 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a9799-6e13-400f-b846-f04c544cd1a9 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:53.792909 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 603/1211] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:24:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:24:53.798698 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc596f-f517-4482-92ea-738a82a28d68 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:53.799126 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc596f-f517-4482-92ea-738a82a28d68 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:53.799266 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc596f-f517-4482-92ea-738a82a28d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:53.865195 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-08dc596f-f517-4482-92ea-738a82a28d68 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:53.866477 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-08dc596f-f517-4482-92ea-738a82a28d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:53.960119 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 609/1212] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:24:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:54.000026 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a9799-6e13-400f-b846-f04c544cd1a9 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:54.002222 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-685a9799-6e13-400f-b846-f04c544cd1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:54.101551 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a9799-6e13-400f-b846-f04c544cd1a9 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:54.175619 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8f23a-eb48-4785-921f-e3825cd28e5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:54.176275 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8f23a-eb48-4785-921f-e3825cd28e5c service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:54.176556 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8f23a-eb48-4785-921f-e3825cd28e5c service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:54.176835 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8f23a-eb48-4785-921f-e3825cd28e5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:54.178493 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-6ad8f23a-eb48-4785-921f-e3825cd28e5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:54.281001 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8f23a-eb48-4785-921f-e3825cd28e5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:54.282998 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8f23a-eb48-4785-921f-e3825cd28e5c service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:54.301395 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 604/1213] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:24:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:56.835745 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5f691-2efe-4fda-825e-2f2e2ca161e2 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:56.836322 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5f691-2efe-4fda-825e-2f2e2ca161e2 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:56.836322 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5f691-2efe-4fda-825e-2f2e2ca161e2 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:56.838115 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 610/1214] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:24:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:24:56.844720 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b21726-a1a1-49df-b147-ec32b023dfcf None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:56.845207 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b21726-a1a1-49df-b147-ec32b023dfcf None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:56.845558 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b21726-a1a1-49df-b147-ec32b023dfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:56.910292 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-d8b21726-a1a1-49df-b147-ec32b023dfcf None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:56.911514 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-d8b21726-a1a1-49df-b147-ec32b023dfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:57.005601 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 605/1215] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:24:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:57.040535 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5f691-2efe-4fda-825e-2f2e2ca161e2 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:57.042062 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-56d5f691-2efe-4fda-825e-2f2e2ca161e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:57.163419 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5f691-2efe-4fda-825e-2f2e2ca161e2 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:57.252805 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b052f-2a54-45e8-8e5b-ecf27ed2f2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:57.253687 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b052f-2a54-45e8-8e5b-ecf27ed2f2bd admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:57.253972 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b052f-2a54-45e8-8e5b-ecf27ed2f2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:57.254248 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b052f-2a54-45e8-8e5b-ecf27ed2f2bd admin admin] PATH_INFO: `/v3/projects/f405caf5e07a413190b7459d3015b944` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:57.263866 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b052f-2a54-45e8-8e5b-ecf27ed2f2bd admin admin] RBAC: Authorizing `identity:get_project(project_id=f405caf5e07a413190b7459d3015b944)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:57.265980 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b052f-2a54-45e8-8e5b-ecf27ed2f2bd admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:57.267692 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 611/1216] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:24:57 2021] GET /identity/v3/projects/f405caf5e07a413190b7459d3015b944 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:24:57.280329 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b21726-a1a1-49df-b147-ec32b023dfcf None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:57.282116 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-d8b21726-a1a1-49df-b147-ec32b023dfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:57.367491 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b21726-a1a1-49df-b147-ec32b023dfcf None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:57.435615 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563bc9a-070a-4403-9667-914360c933b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:57.436183 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563bc9a-070a-4403-9667-914360c933b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:57.436470 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563bc9a-070a-4403-9667-914360c933b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:57.436750 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563bc9a-070a-4403-9667-914360c933b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:57.438700 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-0563bc9a-070a-4403-9667-914360c933b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:57.542284 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563bc9a-070a-4403-9667-914360c933b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:57.543695 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563bc9a-070a-4403-9667-914360c933b9 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:57.561660 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 606/1217] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:24:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:25:00.354198 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df1156-5b66-4bb1-9c22-1af2c9595e6c None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:00.354736 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df1156-5b66-4bb1-9c22-1af2c9595e6c None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:00.354736 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df1156-5b66-4bb1-9c22-1af2c9595e6c None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:00.356459 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 612/1218] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:25:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:25:00.362389 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65ac98-6fee-4dbf-a3a8-4c29a953f9aa None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:00.362831 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65ac98-6fee-4dbf-a3a8-4c29a953f9aa None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:00.362935 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65ac98-6fee-4dbf-a3a8-4c29a953f9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:00.425156 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-cf65ac98-6fee-4dbf-a3a8-4c29a953f9aa None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:00.426462 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-cf65ac98-6fee-4dbf-a3a8-4c29a953f9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:00.518930 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 607/1219] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:25:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:00.553124 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df1156-5b66-4bb1-9c22-1af2c9595e6c None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:00.554667 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-a4df1156-5b66-4bb1-9c22-1af2c9595e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:00.697816 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df1156-5b66-4bb1-9c22-1af2c9595e6c None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:00.796042 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469691ca-a175-4450-ada9-322a46f58112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:00.797420 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469691ca-a175-4450-ada9-322a46f58112 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:00.797747 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469691ca-a175-4450-ada9-322a46f58112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:00.798020 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469691ca-a175-4450-ada9-322a46f58112 admin admin] PATH_INFO: `/v3/projects/f405caf5e07a413190b7459d3015b944` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:00.808207 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469691ca-a175-4450-ada9-322a46f58112 admin admin] RBAC: Authorizing `identity:get_project(project_id=f405caf5e07a413190b7459d3015b944)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:00.810311 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469691ca-a175-4450-ada9-322a46f58112 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:00.812374 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 613/1220] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:25:00 2021] GET /identity/v3/projects/f405caf5e07a413190b7459d3015b944 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:25:00.825250 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65ac98-6fee-4dbf-a3a8-4c29a953f9aa None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:00.826536 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-cf65ac98-6fee-4dbf-a3a8-4c29a953f9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:00.919938 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65ac98-6fee-4dbf-a3a8-4c29a953f9aa None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:01.000767 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a3450-d47e-447a-b98d-660f77a53a12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:01.001417 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a3450-d47e-447a-b98d-660f77a53a12 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:01.001737 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a3450-d47e-447a-b98d-660f77a53a12 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:01.002021 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a3450-d47e-447a-b98d-660f77a53a12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:01.003646 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-913a3450-d47e-447a-b98d-660f77a53a12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:01.106640 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a3450-d47e-447a-b98d-660f77a53a12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:01.108061 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a3450-d47e-447a-b98d-660f77a53a12 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:01.126256 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 608/1221] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:04.061998 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab057336-79ad-4563-bd3b-9f04fa84b3d4 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:04.062569 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab057336-79ad-4563-bd3b-9f04fa84b3d4 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:04.062658 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab057336-79ad-4563-bd3b-9f04fa84b3d4 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:04.064496 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 614/1222] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:25:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:25:04.071002 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacd08b-eb0a-429b-b332-6a286b126e80 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:04.071539 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacd08b-eb0a-429b-b332-6a286b126e80 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:04.071539 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacd08b-eb0a-429b-b332-6a286b126e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:04.137431 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-8eacd08b-eb0a-429b-b332-6a286b126e80 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:04.138683 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-8eacd08b-eb0a-429b-b332-6a286b126e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:04.232813 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 609/1223] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:25:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:04.270167 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab057336-79ad-4563-bd3b-9f04fa84b3d4 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:04.271698 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-ab057336-79ad-4563-bd3b-9f04fa84b3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:04.370451 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab057336-79ad-4563-bd3b-9f04fa84b3d4 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:04.441475 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1f933-4ce4-4b69-868e-d76de295c07e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:04.442152 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1f933-4ce4-4b69-868e-d76de295c07e service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:04.442612 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1f933-4ce4-4b69-868e-d76de295c07e service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:04.442899 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1f933-4ce4-4b69-868e-d76de295c07e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:04.444539 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-20b1f933-4ce4-4b69-868e-d76de295c07e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:04.549229 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1f933-4ce4-4b69-868e-d76de295c07e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:04.550618 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1f933-4ce4-4b69-868e-d76de295c07e service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:04.568240 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 615/1224] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:06.857808 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d80849-cbcc-4a44-9b43-5287ef603496 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:06.858350 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d80849-cbcc-4a44-9b43-5287ef603496 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:06.858350 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d80849-cbcc-4a44-9b43-5287ef603496 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:06.860582 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 610/1225] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:25:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:25:06.866430 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b23bfd-e687-4c9a-8071-45d3cddeae2f None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:06.866872 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b23bfd-e687-4c9a-8071-45d3cddeae2f None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:06.866973 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b23bfd-e687-4c9a-8071-45d3cddeae2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:06.931066 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-06b23bfd-e687-4c9a-8071-45d3cddeae2f None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:06.932542 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-06b23bfd-e687-4c9a-8071-45d3cddeae2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:07.026833 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 616/1226] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:25:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:07.064268 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d80849-cbcc-4a44-9b43-5287ef603496 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:07.065860 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-67d80849-cbcc-4a44-9b43-5287ef603496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:07.164800 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d80849-cbcc-4a44-9b43-5287ef603496 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:07.235038 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefbc6f-1c8b-4a54-9573-9d78bf91944a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:07.250629 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefbc6f-1c8b-4a54-9573-9d78bf91944a service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:07.251155 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefbc6f-1c8b-4a54-9573-9d78bf91944a service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:07.251436 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefbc6f-1c8b-4a54-9573-9d78bf91944a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:07.253271 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-3cefbc6f-1c8b-4a54-9573-9d78bf91944a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:07.364194 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cefbc6f-1c8b-4a54-9573-9d78bf91944a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:07.365647 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cefbc6f-1c8b-4a54-9573-9d78bf91944a service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:07.383567 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 611/1227] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:09.696942 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f29bc2-c300-4bb4-aadc-8a7004790575 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:09.697519 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f29bc2-c300-4bb4-aadc-8a7004790575 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:09.697519 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f29bc2-c300-4bb4-aadc-8a7004790575 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:09.699307 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 617/1228] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:25:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:25:09.705242 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fe311-fe9b-4c81-b9b4-a7a97b81433c None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:09.705660 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fe311-fe9b-4c81-b9b4-a7a97b81433c None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:09.705836 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fe311-fe9b-4c81-b9b4-a7a97b81433c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:09.774653 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-740fe311-fe9b-4c81-b9b4-a7a97b81433c None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:09.775767 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-740fe311-fe9b-4c81-b9b4-a7a97b81433c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:09.868569 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 612/1229] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:25:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:09.902247 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f29bc2-c300-4bb4-aadc-8a7004790575 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:09.903761 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-e1f29bc2-c300-4bb4-aadc-8a7004790575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:10.025404 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f29bc2-c300-4bb4-aadc-8a7004790575 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:10.113408 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de835a-b693-4e20-9c76-221b86a1cb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:10.114287 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de835a-b693-4e20-9c76-221b86a1cb90 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:10.114570 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de835a-b693-4e20-9c76-221b86a1cb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:10.114846 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de835a-b693-4e20-9c76-221b86a1cb90 admin admin] PATH_INFO: `/v3/projects/f405caf5e07a413190b7459d3015b944` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:10.124291 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de835a-b693-4e20-9c76-221b86a1cb90 admin admin] RBAC: Authorizing `identity:get_project(project_id=f405caf5e07a413190b7459d3015b944)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:10.126914 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de835a-b693-4e20-9c76-221b86a1cb90 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:10.128613 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 618/1230] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:25:09 2021] GET /identity/v3/projects/f405caf5e07a413190b7459d3015b944 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:25:10.141415 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fe311-fe9b-4c81-b9b4-a7a97b81433c None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:10.142638 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-740fe311-fe9b-4c81-b9b4-a7a97b81433c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:10.229496 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fe311-fe9b-4c81-b9b4-a7a97b81433c None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:10.302495 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208dd7e-9f84-48ac-aa85-b417f24ef265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:10.303148 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208dd7e-9f84-48ac-aa85-b417f24ef265 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:10.303436 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208dd7e-9f84-48ac-aa85-b417f24ef265 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:10.303716 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208dd7e-9f84-48ac-aa85-b417f24ef265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:10.305347 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-e208dd7e-9f84-48ac-aa85-b417f24ef265 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:10.410152 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208dd7e-9f84-48ac-aa85-b417f24ef265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:10.411573 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208dd7e-9f84-48ac-aa85-b417f24ef265 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:10.429573 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 613/1231] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:12.920095 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84ea27-a722-42fe-82d3-71ad998d68f9 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:12.920662 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84ea27-a722-42fe-82d3-71ad998d68f9 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:12.920662 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84ea27-a722-42fe-82d3-71ad998d68f9 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:12.922495 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 619/1232] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:25:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:25:12.928710 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7093638-1b1b-414b-9971-a869d551343e None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:12.929088 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7093638-1b1b-414b-9971-a869d551343e None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:12.929271 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7093638-1b1b-414b-9971-a869d551343e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:12.992275 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-c7093638-1b1b-414b-9971-a869d551343e None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:12.993512 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-c7093638-1b1b-414b-9971-a869d551343e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:13.085543 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 614/1233] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:25:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:13.122253 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84ea27-a722-42fe-82d3-71ad998d68f9 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:13.123752 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-8d84ea27-a722-42fe-82d3-71ad998d68f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:13.224071 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84ea27-a722-42fe-82d3-71ad998d68f9 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:13.292648 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd52f1-3d85-46c7-ab3a-1aa242cfb60f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:13.293290 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd52f1-3d85-46c7-ab3a-1aa242cfb60f service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:13.293614 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd52f1-3d85-46c7-ab3a-1aa242cfb60f service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:13.293894 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd52f1-3d85-46c7-ab3a-1aa242cfb60f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:13.295505 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-29cd52f1-3d85-46c7-ab3a-1aa242cfb60f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:13.401085 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd52f1-3d85-46c7-ab3a-1aa242cfb60f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:13.402539 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd52f1-3d85-46c7-ab3a-1aa242cfb60f service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:13.419654 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 620/1234] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:15.735966 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb3a4e-925d-487c-a3b9-e5b0ad8bd158 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:15.736514 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb3a4e-925d-487c-a3b9-e5b0ad8bd158 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:15.736514 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb3a4e-925d-487c-a3b9-e5b0ad8bd158 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:15.738353 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 615/1235] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:25:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:25:15.744467 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23b26d-c4b7-4379-8965-f51a95d0f4b0 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:15.744899 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23b26d-c4b7-4379-8965-f51a95d0f4b0 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:15.745032 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23b26d-c4b7-4379-8965-f51a95d0f4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:15.807513 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-fe23b26d-c4b7-4379-8965-f51a95d0f4b0 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:15.808701 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-fe23b26d-c4b7-4379-8965-f51a95d0f4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:15.900403 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 621/1236] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:25:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:25:15.942729 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb3a4e-925d-487c-a3b9-e5b0ad8bd158 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:15.944262 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-64bb3a4e-925d-487c-a3b9-e5b0ad8bd158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:16.043373 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb3a4e-925d-487c-a3b9-e5b0ad8bd158 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:16.113139 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f67c8-a397-4e1a-a035-703482a36128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:16.113810 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f67c8-a397-4e1a-a035-703482a36128 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:16.114102 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f67c8-a397-4e1a-a035-703482a36128 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:16.114384 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f67c8-a397-4e1a-a035-703482a36128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:16.116025 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-aa5f67c8-a397-4e1a-a035-703482a36128 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:16.220615 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f67c8-a397-4e1a-a035-703482a36128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:16.222477 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f67c8-a397-4e1a-a035-703482a36128 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:16.240542 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 616/1237] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:18.795770 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585610ff-fac6-4d11-ada0-ff5f5d02a8cb None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:18.796342 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585610ff-fac6-4d11-ada0-ff5f5d02a8cb None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:18.796342 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585610ff-fac6-4d11-ada0-ff5f5d02a8cb None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:18.798172 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 622/1238] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:25:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:25:18.804094 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62203606-de4e-4f77-a090-cca7fea84a80 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:18.804520 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62203606-de4e-4f77-a090-cca7fea84a80 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:18.804662 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62203606-de4e-4f77-a090-cca7fea84a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:18.872768 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-62203606-de4e-4f77-a090-cca7fea84a80 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:18.874013 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-62203606-de4e-4f77-a090-cca7fea84a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:18.974346 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 617/1239] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:25:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:19.024953 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7250c7-9ec3-4963-b7aa-37846ed1a7e3 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:19.025241 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7250c7-9ec3-4963-b7aa-37846ed1a7e3 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:19.025556 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7250c7-9ec3-4963-b7aa-37846ed1a7e3 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:19.027332 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 623/1240] 10.222.0.25 () {54 vars in 964 bytes} [Wed Oct 27 01:25:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:25:19.033242 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9624772-9208-43bd-97d0-ccacb5b7a35f None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:19.033563 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9624772-9208-43bd-97d0-ccacb5b7a35f None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:19.033847 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9624772-9208-43bd-97d0-ccacb5b7a35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:19.098445 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-a9624772-9208-43bd-97d0-ccacb5b7a35f None None] MFA Rules not processed for user `bff692322c68420186f2918d380ece98`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:19.099561 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-a9624772-9208-43bd-97d0-ccacb5b7a35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:19.172952 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 618/1241] 10.222.0.25 () {58 vars in 1061 bytes} [Wed Oct 27 01:25:19 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:25:19.183154 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7250c7-9ec3-4963-b7aa-37846ed1a7e3 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:19.195142 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7250c7-9ec3-4963-b7aa-37846ed1a7e3 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:19.198659 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25839d2a-2117-4d72-a813-fcf2e42a5103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:19.199291 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25839d2a-2117-4d72-a813-fcf2e42a5103 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:19.199576 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25839d2a-2117-4d72-a813-fcf2e42a5103 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:19.199855 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25839d2a-2117-4d72-a813-fcf2e42a5103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:19.209315 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25839d2a-2117-4d72-a813-fcf2e42a5103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:19.210775 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25839d2a-2117-4d72-a813-fcf2e42a5103 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:19.219913 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 624/1242] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:24.001478 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0532fd-e737-412b-aa1f-fa597c2a43db None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:24.002058 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0532fd-e737-412b-aa1f-fa597c2a43db None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:24.002058 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0532fd-e737-412b-aa1f-fa597c2a43db None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:24.003867 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 619/1243] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:25:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:25:24.009873 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e38c6e-fd97-47e9-a6f6-cf5052240de5 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:24.010313 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e38c6e-fd97-47e9-a6f6-cf5052240de5 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:24.010434 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e38c6e-fd97-47e9-a6f6-cf5052240de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:24.027630 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-59e38c6e-fd97-47e9-a6f6-cf5052240de5 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:24.028811 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-59e38c6e-fd97-47e9-a6f6-cf5052240de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:24.036490 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 625/1244] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:25:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:24.078063 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0532fd-e737-412b-aa1f-fa597c2a43db None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:24.088364 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0532fd-e737-412b-aa1f-fa597c2a43db None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:24.091840 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fe4b8-6725-4981-b028-ed4f96ec8f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:24.092467 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fe4b8-6725-4981-b028-ed4f96ec8f22 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:24.092753 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fe4b8-6725-4981-b028-ed4f96ec8f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:24.093063 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fe4b8-6725-4981-b028-ed4f96ec8f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:24.101838 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17fe4b8-6725-4981-b028-ed4f96ec8f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:24.103261 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17fe4b8-6725-4981-b028-ed4f96ec8f22 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:24.113354 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 620/1245] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:25:27.001175 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e662b-f37a-4515-8fd5-99377ebe7210 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:27.001736 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e662b-f37a-4515-8fd5-99377ebe7210 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:27.001736 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e662b-f37a-4515-8fd5-99377ebe7210 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:27.003514 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 626/1246] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:25:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:25:27.009742 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d765568-df10-4354-b3c7-21fb69390f0b None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:27.010142 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d765568-df10-4354-b3c7-21fb69390f0b None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:27.010307 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d765568-df10-4354-b3c7-21fb69390f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:27.028264 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-7d765568-df10-4354-b3c7-21fb69390f0b None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:27.029449 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-7d765568-df10-4354-b3c7-21fb69390f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:27.037231 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 621/1247] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:25:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:27.087501 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e662b-f37a-4515-8fd5-99377ebe7210 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:27.097989 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e662b-f37a-4515-8fd5-99377ebe7210 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:27.101534 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6550913-8e5e-4cf4-9744-e6d414784dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:27.102171 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6550913-8e5e-4cf4-9744-e6d414784dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:27.102452 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6550913-8e5e-4cf4-9744-e6d414784dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:27.102726 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6550913-8e5e-4cf4-9744-e6d414784dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:27.111920 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6550913-8e5e-4cf4-9744-e6d414784dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:27.113329 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6550913-8e5e-4cf4-9744-e6d414784dc0 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:27.122565 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 627/1248] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:31.336138 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845929a8-aedb-4cdf-a958-0116ff7361e1 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:31.336702 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845929a8-aedb-4cdf-a958-0116ff7361e1 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:31.336702 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845929a8-aedb-4cdf-a958-0116ff7361e1 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:31.338454 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 622/1249] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:25:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:25:31.344514 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ff634-805e-4777-9bbc-09c9e30a6f0e None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:31.344979 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ff634-805e-4777-9bbc-09c9e30a6f0e None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:31.345101 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ff634-805e-4777-9bbc-09c9e30a6f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:31.363052 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-0f8ff634-805e-4777-9bbc-09c9e30a6f0e None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:31.364249 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-0f8ff634-805e-4777-9bbc-09c9e30a6f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:31.372004 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 628/1250] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:25:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:31.416610 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845929a8-aedb-4cdf-a958-0116ff7361e1 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:31.427498 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845929a8-aedb-4cdf-a958-0116ff7361e1 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:31.432336 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70636ea2-e8db-4016-b949-5ba89fbc785e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:31.432336 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70636ea2-e8db-4016-b949-5ba89fbc785e service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:31.432336 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70636ea2-e8db-4016-b949-5ba89fbc785e service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:31.432635 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70636ea2-e8db-4016-b949-5ba89fbc785e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:31.441014 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70636ea2-e8db-4016-b949-5ba89fbc785e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:31.442447 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70636ea2-e8db-4016-b949-5ba89fbc785e service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:31.451884 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 623/1251] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:36.522418 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3827c-d060-4d25-abb4-2ce084885ae4 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:36.522866 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3827c-d060-4d25-abb4-2ce084885ae4 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:36.522963 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3827c-d060-4d25-abb4-2ce084885ae4 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:36.525152 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 629/1252] 10.222.0.25 () {54 vars in 921 bytes} [Wed Oct 27 01:25:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:25:36.530304 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8cfc4-6a24-4e01-9c22-97caabb8dc3f None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:36.530707 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8cfc4-6a24-4e01-9c22-97caabb8dc3f None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:36.530869 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8cfc4-6a24-4e01-9c22-97caabb8dc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:36.587835 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-18c8cfc4-6a24-4e01-9c22-97caabb8dc3f None None] MFA Rules not processed for user `2ff82e315d8c42e49556ab67fbf53b32`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:36.589468 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-18c8cfc4-6a24-4e01-9c22-97caabb8dc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:36.692135 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 624/1253] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Oct 27 01:25:36 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:41.356438 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df07719-e137-44e9-bcd0-39ced0f687ec None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:41.357265 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df07719-e137-44e9-bcd0-39ced0f687ec None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:41.357751 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df07719-e137-44e9-bcd0-39ced0f687ec None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:41.359725 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 630/1254] 10.222.0.25 () {54 vars in 921 bytes} [Wed Oct 27 01:25:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:25:41.364919 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cfdcf-5e76-4e89-882d-f35f32c7896f None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:41.365338 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cfdcf-5e76-4e89-882d-f35f32c7896f None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:41.365574 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cfdcf-5e76-4e89-882d-f35f32c7896f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:41.383881 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-d68cfdcf-5e76-4e89-882d-f35f32c7896f None None] MFA Rules not processed for user `2ff82e315d8c42e49556ab67fbf53b32`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:41.385070 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-d68cfdcf-5e76-4e89-882d-f35f32c7896f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:41.394202 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 625/1255] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Oct 27 01:25:41 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:42.552607 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232fdf4-41f2-4b69-b8ae-8a5cab64ac59 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:42.553114 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232fdf4-41f2-4b69-b8ae-8a5cab64ac59 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:42.553114 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232fdf4-41f2-4b69-b8ae-8a5cab64ac59 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:42.554865 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 631/1256] 10.222.0.25 () {54 vars in 921 bytes} [Wed Oct 27 01:25:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:25:42.560473 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2eb8cb-18e8-4650-977a-a3567b2a0560 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:42.560896 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2eb8cb-18e8-4650-977a-a3567b2a0560 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:42.561038 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2eb8cb-18e8-4650-977a-a3567b2a0560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:42.579308 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-3d2eb8cb-18e8-4650-977a-a3567b2a0560 None None] MFA Rules not processed for user `2ff82e315d8c42e49556ab67fbf53b32`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:42.580488 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-3d2eb8cb-18e8-4650-977a-a3567b2a0560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:42.588897 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 626/1257] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Oct 27 01:25:42 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:46.490094 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacb967-7a5d-4578-856e-3ac03e8e7281 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:46.490623 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacb967-7a5d-4578-856e-3ac03e8e7281 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:46.490722 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacb967-7a5d-4578-856e-3ac03e8e7281 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:46.492576 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 632/1258] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:25:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:25:46.498191 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d1ca8-65d5-43d8-a043-41578a48ead6 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:46.499175 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d1ca8-65d5-43d8-a043-41578a48ead6 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:46.499320 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d1ca8-65d5-43d8-a043-41578a48ead6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:46.517278 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-c67d1ca8-65d5-43d8-a043-41578a48ead6 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:46.518497 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-c67d1ca8-65d5-43d8-a043-41578a48ead6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:46.526701 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 627/1259] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:25:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:46.578441 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f0d7b-42f7-4c08-92b2-ea3922fcdf65 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:46.578766 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f0d7b-42f7-4c08-92b2-ea3922fcdf65 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:46.579015 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f0d7b-42f7-4c08-92b2-ea3922fcdf65 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:46.580948 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 633/1260] 10.222.0.25 () {54 vars in 960 bytes} [Wed Oct 27 01:25:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:25:46.586791 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8c9ce-0632-4784-a861-4458aef07add None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:46.587185 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8c9ce-0632-4784-a861-4458aef07add None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:46.587566 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8c9ce-0632-4784-a861-4458aef07add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:46.641798 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-84d8c9ce-0632-4784-a861-4458aef07add None None] MFA Rules not processed for user `b2f8304b85b64dc4ac58523897306660`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:46.643123 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-84d8c9ce-0632-4784-a861-4458aef07add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:46.728074 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 628/1261] 10.222.0.25 () {58 vars in 1057 bytes} [Wed Oct 27 01:25:46 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:46.736203 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f0d7b-42f7-4c08-92b2-ea3922fcdf65 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:46.751642 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f0d7b-42f7-4c08-92b2-ea3922fcdf65 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:46.757953 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14026aa1-794d-4408-8cd4-a3cf8a7024ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:46.758782 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14026aa1-794d-4408-8cd4-a3cf8a7024ab service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:46.759214 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14026aa1-794d-4408-8cd4-a3cf8a7024ab service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:46.759637 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14026aa1-794d-4408-8cd4-a3cf8a7024ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:46.768882 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14026aa1-794d-4408-8cd4-a3cf8a7024ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:46.770668 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14026aa1-794d-4408-8cd4-a3cf8a7024ab service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:46.781671 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 634/1262] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:25:49.280785 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb93f3-39ed-42ce-81c5-3d2d17303eca None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:49.281290 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb93f3-39ed-42ce-81c5-3d2d17303eca None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:49.281396 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb93f3-39ed-42ce-81c5-3d2d17303eca None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:49.283177 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 629/1263] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:25:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:25:49.289043 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bc47b-2df1-4d39-9c5d-cea4b65adbf4 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:49.289522 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bc47b-2df1-4d39-9c5d-cea4b65adbf4 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:49.289656 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bc47b-2df1-4d39-9c5d-cea4b65adbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:49.308319 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-f10bc47b-2df1-4d39-9c5d-cea4b65adbf4 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:49.309457 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-f10bc47b-2df1-4d39-9c5d-cea4b65adbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:49.318431 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 635/1264] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:25:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:49.365031 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb93f3-39ed-42ce-81c5-3d2d17303eca None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:49.380144 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb93f3-39ed-42ce-81c5-3d2d17303eca None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:49.385825 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10628e4-fecb-494f-a114-14f7ab012ec2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:49.386457 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10628e4-fecb-494f-a114-14f7ab012ec2 service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:49.386746 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10628e4-fecb-494f-a114-14f7ab012ec2 service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:49.387029 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10628e4-fecb-494f-a114-14f7ab012ec2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:49.395279 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10628e4-fecb-494f-a114-14f7ab012ec2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:49.396905 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10628e4-fecb-494f-a114-14f7ab012ec2 service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:49.406374 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 630/1265] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:51.964729 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8b4b9-a32e-4791-a8ce-2df6a4eb7064 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:51.965734 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8b4b9-a32e-4791-a8ce-2df6a4eb7064 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:51.966207 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8b4b9-a32e-4791-a8ce-2df6a4eb7064 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:51.969430 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 636/1266] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:25:51 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:25:51.975455 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8500842-0a6d-4611-96b1-1ee7e9079225 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:51.975901 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8500842-0a6d-4611-96b1-1ee7e9079225 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:51.976113 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8500842-0a6d-4611-96b1-1ee7e9079225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:51.995698 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-c8500842-0a6d-4611-96b1-1ee7e9079225 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:51.996901 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-c8500842-0a6d-4611-96b1-1ee7e9079225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:52.006203 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 631/1267] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:25:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:25:52.055605 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42decb2c-a26d-4cff-9e99-de7ad1520a7e None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:52.056230 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42decb2c-a26d-4cff-9e99-de7ad1520a7e None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:52.056627 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42decb2c-a26d-4cff-9e99-de7ad1520a7e None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:52.058858 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 637/1268] 10.222.0.25 () {54 vars in 960 bytes} [Wed Oct 27 01:25:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:25:52.064703 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded010a8-61a1-4956-888a-681269931f84 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:52.064994 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded010a8-61a1-4956-888a-681269931f84 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:52.065278 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded010a8-61a1-4956-888a-681269931f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:52.086449 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-ded010a8-61a1-4956-888a-681269931f84 None None] MFA Rules not processed for user `b2f8304b85b64dc4ac58523897306660`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:52.087913 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-ded010a8-61a1-4956-888a-681269931f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:52.098316 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 632/1269] 10.222.0.25 () {58 vars in 1057 bytes} [Wed Oct 27 01:25:52 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:52.106790 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42decb2c-a26d-4cff-9e99-de7ad1520a7e None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:52.123155 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42decb2c-a26d-4cff-9e99-de7ad1520a7e None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:52.132618 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413c476-9582-4780-8776-3a97c77f6fe6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:52.133425 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413c476-9582-4780-8776-3a97c77f6fe6 service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:52.133931 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413c476-9582-4780-8776-3a97c77f6fe6 service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:52.134449 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413c476-9582-4780-8776-3a97c77f6fe6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:52.146578 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413c476-9582-4780-8776-3a97c77f6fe6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:52.148262 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413c476-9582-4780-8776-3a97c77f6fe6 service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:52.159218 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 638/1270] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:54.339112 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa68dc-23c5-4a52-9b40-a691888e0bf1 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:54.339652 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa68dc-23c5-4a52-9b40-a691888e0bf1 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:54.339652 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa68dc-23c5-4a52-9b40-a691888e0bf1 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:54.341440 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 633/1271] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:25:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:25:54.348744 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24044bd-677c-45f1-8e40-8087cc9b805e None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:54.349276 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24044bd-677c-45f1-8e40-8087cc9b805e None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:54.349276 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24044bd-677c-45f1-8e40-8087cc9b805e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:54.369577 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-c24044bd-677c-45f1-8e40-8087cc9b805e None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:54.371060 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-c24044bd-677c-45f1-8e40-8087cc9b805e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:54.379685 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 639/1272] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:25:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:54.434343 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316ed81-6171-4f71-8fc1-9cbd3b897853 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:54.435005 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316ed81-6171-4f71-8fc1-9cbd3b897853 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:54.435296 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316ed81-6171-4f71-8fc1-9cbd3b897853 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:54.437570 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 634/1273] 10.222.0.25 () {54 vars in 962 bytes} [Wed Oct 27 01:25:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:25:54.443436 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc120453-5c99-4560-936e-d51cc4bf81c3 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:54.443795 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc120453-5c99-4560-936e-d51cc4bf81c3 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:54.444006 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc120453-5c99-4560-936e-d51cc4bf81c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:54.495452 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b313ff-0e74-435b-b93a-cc41498eb458 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:54.495792 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b313ff-0e74-435b-b93a-cc41498eb458 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:54.496012 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b313ff-0e74-435b-b93a-cc41498eb458 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:54.497866 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 635/1274] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:25:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:25:54.500524 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-bc120453-5c99-4560-936e-d51cc4bf81c3 None None] MFA Rules not processed for user `1819142aab4743fbb9e056ba61e3d474`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:54.501760 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-bc120453-5c99-4560-936e-d51cc4bf81c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:54.504047 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616a537-1b9f-42c8-90d4-72085fc41d1f None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:54.504343 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616a537-1b9f-42c8-90d4-72085fc41d1f None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:54.504629 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616a537-1b9f-42c8-90d4-72085fc41d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:54.521887 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-4616a537-1b9f-42c8-90d4-72085fc41d1f None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:54.523080 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-4616a537-1b9f-42c8-90d4-72085fc41d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:54.531469 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 636/1275] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:25:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:25:54.562438 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 640/1276] 10.222.0.25 () {58 vars in 1059 bytes} [Wed Oct 27 01:25:54 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:54.570389 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616a537-1b9f-42c8-90d4-72085fc41d1f None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:54.578895 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc120453-5c99-4560-936e-d51cc4bf81c3 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:54.580685 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616a537-1b9f-42c8-90d4-72085fc41d1f None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:54.584237 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c050f-41f4-4de6-8d45-13dbedf9afa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:54.585516 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c050f-41f4-4de6-8d45-13dbedf9afa2 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:54.585516 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c050f-41f4-4de6-8d45-13dbedf9afa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:54.585516 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c050f-41f4-4de6-8d45-13dbedf9afa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:54.591574 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc120453-5c99-4560-936e-d51cc4bf81c3 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:54.597159 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c050f-41f4-4de6-8d45-13dbedf9afa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:54.598231 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c8418-3966-4a49-ac9a-660294baff43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:54.598876 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c8418-3966-4a49-ac9a-660294baff43 service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:54.598982 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c050f-41f4-4de6-8d45-13dbedf9afa2 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:54.599164 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c8418-3966-4a49-ac9a-660294baff43 service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:54.599445 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c8418-3966-4a49-ac9a-660294baff43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:54.608144 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c8418-3966-4a49-ac9a-660294baff43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:54.609257 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 637/1277] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:54.609837 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c8418-3966-4a49-ac9a-660294baff43 service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:54.619612 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 641/1278] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:25:56.962192 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17acef-f244-491b-a4a1-d61c6eae1bbb None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:56.962708 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17acef-f244-491b-a4a1-d61c6eae1bbb None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:56.962708 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17acef-f244-491b-a4a1-d61c6eae1bbb None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:56.964817 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 638/1279] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:25:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:25:56.971634 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f090f4c-e247-4dfb-9421-1df8c988fa5c None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:56.972062 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f090f4c-e247-4dfb-9421-1df8c988fa5c None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:56.972189 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f090f4c-e247-4dfb-9421-1df8c988fa5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:56.989557 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-4f090f4c-e247-4dfb-9421-1df8c988fa5c None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:56.990746 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4f090f4c-e247-4dfb-9421-1df8c988fa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:56.998464 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 642/1280] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:25:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:57.045266 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17acef-f244-491b-a4a1-d61c6eae1bbb None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:57.059731 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17acef-f244-491b-a4a1-d61c6eae1bbb None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:57.065050 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0dc0b-8788-4d36-ba9b-a02e895a799c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:57.065708 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0dc0b-8788-4d36-ba9b-a02e895a799c service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:57.066011 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0dc0b-8788-4d36-ba9b-a02e895a799c service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:57.066287 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0dc0b-8788-4d36-ba9b-a02e895a799c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:57.074244 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0dc0b-8788-4d36-ba9b-a02e895a799c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:57.076116 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0dc0b-8788-4d36-ba9b-a02e895a799c service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:57.086124 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 639/1281] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:59.381038 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7122cb-f24c-4391-8750-3b52d39411f4 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:59.381629 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7122cb-f24c-4391-8750-3b52d39411f4 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:59.381735 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7122cb-f24c-4391-8750-3b52d39411f4 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:59.384048 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 643/1282] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:25:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:25:59.390033 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8f68a-f6ad-4ca2-9e7b-5575905a6585 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:59.390512 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8f68a-f6ad-4ca2-9e7b-5575905a6585 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:59.390622 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8f68a-f6ad-4ca2-9e7b-5575905a6585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:59.408927 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-12b8f68a-f6ad-4ca2-9e7b-5575905a6585 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:59.410134 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-12b8f68a-f6ad-4ca2-9e7b-5575905a6585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:59.418308 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 640/1283] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:25:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:59.464407 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7122cb-f24c-4391-8750-3b52d39411f4 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:59.478875 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7122cb-f24c-4391-8750-3b52d39411f4 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:59.485667 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccddb21b-7854-4ef5-9da0-68b98fdd1620 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:59.486312 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddb21b-7854-4ef5-9da0-68b98fdd1620 service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:59.486590 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddb21b-7854-4ef5-9da0-68b98fdd1620 service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:59.486861 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddb21b-7854-4ef5-9da0-68b98fdd1620 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:59.495378 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccddb21b-7854-4ef5-9da0-68b98fdd1620 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:59.496938 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccddb21b-7854-4ef5-9da0-68b98fdd1620 service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:59.506851 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 644/1284] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:01.837022 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e6161-f7dc-43b9-a771-726f9cffebad None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:01.837568 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e6161-f7dc-43b9-a771-726f9cffebad None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:01.837568 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e6161-f7dc-43b9-a771-726f9cffebad None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:01.839344 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 641/1285] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:26:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:26:01.845917 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278b121-194c-4ceb-b145-e1ecbdc6676a None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:01.846393 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278b121-194c-4ceb-b145-e1ecbdc6676a None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:01.846509 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278b121-194c-4ceb-b145-e1ecbdc6676a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:01.865143 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-5278b121-194c-4ceb-b145-e1ecbdc6676a None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:01.866377 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-5278b121-194c-4ceb-b145-e1ecbdc6676a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:01.876114 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 645/1286] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:26:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:01.920686 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e6161-f7dc-43b9-a771-726f9cffebad None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:01.939436 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e6161-f7dc-43b9-a771-726f9cffebad None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:01.945990 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d49bca-36d6-4522-8065-566686060a5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:01.946635 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d49bca-36d6-4522-8065-566686060a5c service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:01.946925 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d49bca-36d6-4522-8065-566686060a5c service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:01.947211 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d49bca-36d6-4522-8065-566686060a5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:01.955841 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d49bca-36d6-4522-8065-566686060a5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:01.958102 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d49bca-36d6-4522-8065-566686060a5c service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:01.972396 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 642/1287] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:04.254437 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6dac45-0116-4bea-82a2-dfdfebf9b30a None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:04.254992 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6dac45-0116-4bea-82a2-dfdfebf9b30a None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:04.255190 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6dac45-0116-4bea-82a2-dfdfebf9b30a None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:04.256988 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 646/1288] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:26:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:26:04.262959 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba6eef-d486-4efc-968e-d5046dfcc793 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:04.264186 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba6eef-d486-4efc-968e-d5046dfcc793 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:04.264186 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba6eef-d486-4efc-968e-d5046dfcc793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:04.282036 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-f1ba6eef-d486-4efc-968e-d5046dfcc793 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:04.283303 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-f1ba6eef-d486-4efc-968e-d5046dfcc793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:04.291220 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 643/1289] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:26:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:04.339270 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6dac45-0116-4bea-82a2-dfdfebf9b30a None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:04.357890 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6dac45-0116-4bea-82a2-dfdfebf9b30a None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:04.363288 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feced848-76e8-448b-9146-628083eb2117 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:04.363915 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feced848-76e8-448b-9146-628083eb2117 service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:04.364196 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feced848-76e8-448b-9146-628083eb2117 service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:04.364477 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feced848-76e8-448b-9146-628083eb2117 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:04.372406 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feced848-76e8-448b-9146-628083eb2117 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:04.374599 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feced848-76e8-448b-9146-628083eb2117 service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:04.383710 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 647/1290] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:06.679053 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd513a-4e52-4af4-86c9-cbe7cd563681 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:06.679613 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd513a-4e52-4af4-86c9-cbe7cd563681 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:06.679613 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd513a-4e52-4af4-86c9-cbe7cd563681 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:06.681388 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 644/1291] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:26:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:26:06.687635 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5408b0-0263-465a-9b30-855b4096ef7e None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:06.688066 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5408b0-0263-465a-9b30-855b4096ef7e None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:06.688184 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5408b0-0263-465a-9b30-855b4096ef7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:06.706102 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-3d5408b0-0263-465a-9b30-855b4096ef7e None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:06.707349 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3d5408b0-0263-465a-9b30-855b4096ef7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:06.715393 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 648/1292] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:26:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:26:06.762023 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd513a-4e52-4af4-86c9-cbe7cd563681 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:06.776737 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd513a-4e52-4af4-86c9-cbe7cd563681 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:06.782473 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b74f8-9656-4a65-a934-5856a7ba8f66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:06.783093 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b74f8-9656-4a65-a934-5856a7ba8f66 service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:06.783373 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b74f8-9656-4a65-a934-5856a7ba8f66 service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:06.783664 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b74f8-9656-4a65-a934-5856a7ba8f66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:06.792357 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b74f8-9656-4a65-a934-5856a7ba8f66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:06.795301 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b74f8-9656-4a65-a934-5856a7ba8f66 service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:06.809029 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 645/1293] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:09.109269 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc95c6-95b9-4484-b222-6a4aa2fe745d None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:09.109905 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc95c6-95b9-4484-b222-6a4aa2fe745d None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:09.109905 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc95c6-95b9-4484-b222-6a4aa2fe745d None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:09.111648 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 649/1294] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:26:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:26:09.117539 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914d3c0-4b70-4237-8a0c-2e786ee4fde1 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:09.117982 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914d3c0-4b70-4237-8a0c-2e786ee4fde1 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:09.118084 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914d3c0-4b70-4237-8a0c-2e786ee4fde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:09.136751 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-4914d3c0-4b70-4237-8a0c-2e786ee4fde1 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:09.137952 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-4914d3c0-4b70-4237-8a0c-2e786ee4fde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:09.145988 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 646/1295] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:26:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:09.192414 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc95c6-95b9-4484-b222-6a4aa2fe745d None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:09.206501 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc95c6-95b9-4484-b222-6a4aa2fe745d None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:09.211927 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392b57b-9d75-4c57-b7e7-f545b9b44854 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:09.212570 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392b57b-9d75-4c57-b7e7-f545b9b44854 service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:09.212857 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392b57b-9d75-4c57-b7e7-f545b9b44854 service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:09.213140 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392b57b-9d75-4c57-b7e7-f545b9b44854 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:09.222094 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392b57b-9d75-4c57-b7e7-f545b9b44854 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:09.223602 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392b57b-9d75-4c57-b7e7-f545b9b44854 service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:09.232831 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 650/1296] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:09.539262 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132252d5-daa8-4b1f-bcae-379bf78f57b7 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:09.539548 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132252d5-daa8-4b1f-bcae-379bf78f57b7 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:09.539839 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132252d5-daa8-4b1f-bcae-379bf78f57b7 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:09.541678 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 647/1297] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:26:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:26:09.548235 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86462571-1009-4da0-bd22-7e006e3cf797 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:09.548552 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86462571-1009-4da0-bd22-7e006e3cf797 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:09.548833 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86462571-1009-4da0-bd22-7e006e3cf797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:09.566634 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-86462571-1009-4da0-bd22-7e006e3cf797 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:09.567806 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-86462571-1009-4da0-bd22-7e006e3cf797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:09.576464 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 651/1298] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:26:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:09.635856 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67ff57-0415-41c0-8577-35726d786396 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:09.636224 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67ff57-0415-41c0-8577-35726d786396 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:09.636579 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67ff57-0415-41c0-8577-35726d786396 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:09.639080 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 648/1299] 10.222.0.25 () {54 vars in 962 bytes} [Wed Oct 27 01:26:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:26:09.644565 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388905b-8a50-4c2e-9d59-8a1cd612d6cc None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:09.644853 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388905b-8a50-4c2e-9d59-8a1cd612d6cc None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:09.645135 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388905b-8a50-4c2e-9d59-8a1cd612d6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:09.691611 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-2388905b-8a50-4c2e-9d59-8a1cd612d6cc None None] MFA Rules not processed for user `32003a40693246d08640bc7ec45adfc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:09.692781 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-2388905b-8a50-4c2e-9d59-8a1cd612d6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:09.750650 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 652/1300] 10.222.0.25 () {58 vars in 1059 bytes} [Wed Oct 27 01:26:09 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:09.758794 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67ff57-0415-41c0-8577-35726d786396 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:09.769544 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67ff57-0415-41c0-8577-35726d786396 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:09.772897 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1468d-f0e3-45a2-a8d6-31df9908b61d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32003a40693246d08640bc7ec45adfc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:09.773541 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1468d-f0e3-45a2-a8d6-31df9908b61d service glance] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:09.773825 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1468d-f0e3-45a2-a8d6-31df9908b61d service glance] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:09.774101 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1468d-f0e3-45a2-a8d6-31df9908b61d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:09.783251 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1468d-f0e3-45a2-a8d6-31df9908b61d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:09.784647 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1468d-f0e3-45a2-a8d6-31df9908b61d service glance] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:09.795036 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 649/1301] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:26:10.238649 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08d750-1dad-41fa-a9eb-8785faca00b3 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:10.239131 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08d750-1dad-41fa-a9eb-8785faca00b3 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:10.239333 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08d750-1dad-41fa-a9eb-8785faca00b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:10.286442 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-8d08d750-1dad-41fa-a9eb-8785faca00b3 None None] MFA Rules not processed for user `56895529b11b4236bccb5956a8ccb5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:10.287677 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-8d08d750-1dad-41fa-a9eb-8785faca00b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:10.350413 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 653/1302] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Oct 27 01:26:10 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:10.392827 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f96cf-9ad3-4f83-9aca-db8822de9926 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:10.393326 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f96cf-9ad3-4f83-9aca-db8822de9926 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:10.393423 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f96cf-9ad3-4f83-9aca-db8822de9926 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:10.395293 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 650/1303] 10.222.0.25 () {54 vars in 942 bytes} [Wed Oct 27 01:26:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:26:10.401979 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4c63a-93cc-471d-95bf-3fed4b10abbe None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:10.402342 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4c63a-93cc-471d-95bf-3fed4b10abbe None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:10.402693 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4c63a-93cc-471d-95bf-3fed4b10abbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:10.452731 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-b2e4c63a-93cc-471d-95bf-3fed4b10abbe None None] MFA Rules not processed for user `f386f358fdb241f5a529a2cf3d839201`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:10.454006 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-b2e4c63a-93cc-471d-95bf-3fed4b10abbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:10.523858 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 654/1304] 10.222.0.25 () {58 vars in 1039 bytes} [Wed Oct 27 01:26:10 2021] POST /identity/v3/auth/tokens => generated 3447 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:10.533556 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f96cf-9ad3-4f83-9aca-db8822de9926 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:10.547892 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f96cf-9ad3-4f83-9aca-db8822de9926 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:10.553164 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baccf49-b2d1-4358-8ddf-a6b2b142a6fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f386f358fdb241f5a529a2cf3d839201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:10.553899 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baccf49-b2d1-4358-8ddf-a6b2b142a6fa service swift] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:10.554205 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baccf49-b2d1-4358-8ddf-a6b2b142a6fa service swift] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:10.554489 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baccf49-b2d1-4358-8ddf-a6b2b142a6fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:10.563756 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baccf49-b2d1-4358-8ddf-a6b2b142a6fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:10.565319 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baccf49-b2d1-4358-8ddf-a6b2b142a6fa service swift] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:10.573237 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 651/1305] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Oct 27 01:26:10 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:26:11.550664 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f97f95-c4d4-4e94-bb68-80de8586f998 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:11.551223 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f97f95-c4d4-4e94-bb68-80de8586f998 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:11.551223 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f97f95-c4d4-4e94-bb68-80de8586f998 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:11.552967 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 655/1306] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:26:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:26:11.559299 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61b3bb-7ea1-4e13-a29f-ff6f836e37fd None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:11.559753 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61b3bb-7ea1-4e13-a29f-ff6f836e37fd None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:11.559875 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61b3bb-7ea1-4e13-a29f-ff6f836e37fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:11.579359 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-ba61b3bb-7ea1-4e13-a29f-ff6f836e37fd None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:11.580815 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-ba61b3bb-7ea1-4e13-a29f-ff6f836e37fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:11.588939 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 652/1307] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:26:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:26:11.637554 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f97f95-c4d4-4e94-bb68-80de8586f998 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:11.652710 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f97f95-c4d4-4e94-bb68-80de8586f998 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:11.658835 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13f649-deb3-4372-8096-b4e285ceaa71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:11.659551 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13f649-deb3-4372-8096-b4e285ceaa71 service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:11.659907 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13f649-deb3-4372-8096-b4e285ceaa71 service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:11.660284 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13f649-deb3-4372-8096-b4e285ceaa71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:11.668634 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13f649-deb3-4372-8096-b4e285ceaa71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:11.670890 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13f649-deb3-4372-8096-b4e285ceaa71 service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:11.680514 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 656/1308] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:14.018536 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d029a81-3370-4c9e-b4e4-f798673e41c2 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:14.019091 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d029a81-3370-4c9e-b4e4-f798673e41c2 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:14.019091 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d029a81-3370-4c9e-b4e4-f798673e41c2 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:14.020869 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 653/1309] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:26:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:26:14.026928 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdf2bf-9943-48a0-97b9-d411855cdf6c None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:14.027378 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdf2bf-9943-48a0-97b9-d411855cdf6c None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:14.027506 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdf2bf-9943-48a0-97b9-d411855cdf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:14.048511 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-d0cdf2bf-9943-48a0-97b9-d411855cdf6c None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:14.049754 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-d0cdf2bf-9943-48a0-97b9-d411855cdf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:14.058165 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 657/1310] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:26:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:14.105165 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d029a81-3370-4c9e-b4e4-f798673e41c2 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:14.120665 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d029a81-3370-4c9e-b4e4-f798673e41c2 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:14.130384 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e07d0-1a2b-4b3c-9126-4551d699a3de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:14.131049 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e07d0-1a2b-4b3c-9126-4551d699a3de service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:14.131337 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e07d0-1a2b-4b3c-9126-4551d699a3de service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:14.131616 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e07d0-1a2b-4b3c-9126-4551d699a3de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:14.140565 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e07d0-1a2b-4b3c-9126-4551d699a3de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:14.142296 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e07d0-1a2b-4b3c-9126-4551d699a3de service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:14.152670 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 654/1311] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:28.402692 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0238168-d07b-4936-868c-277686570066 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:28.403260 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0238168-d07b-4936-868c-277686570066 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:28.403260 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0238168-d07b-4936-868c-277686570066 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:28.405007 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 658/1312] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:26:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:26:28.410960 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4bb4c-f26c-42e9-9502-2bfa25dda98e None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:28.411418 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4bb4c-f26c-42e9-9502-2bfa25dda98e None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:28.411518 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4bb4c-f26c-42e9-9502-2bfa25dda98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:28.429407 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-f5d4bb4c-f26c-42e9-9502-2bfa25dda98e None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:28.430625 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-f5d4bb4c-f26c-42e9-9502-2bfa25dda98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:28.439517 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 655/1313] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:26:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:26:28.463733 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0238168-d07b-4936-868c-277686570066 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:28.475930 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0238168-d07b-4936-868c-277686570066 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:28.480392 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803a0f1-55dd-46ee-b46b-555010191faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:28.481027 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803a0f1-55dd-46ee-b46b-555010191faa admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:28.481309 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803a0f1-55dd-46ee-b46b-555010191faa admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:28.482119 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803a0f1-55dd-46ee-b46b-555010191faa admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:28.482842 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803a0f1-55dd-46ee-b46b-555010191faa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:28.484660 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803a0f1-55dd-46ee-b46b-555010191faa admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:28.503663 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 659/1314] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Oct 27 01:26:28 2021] GET /identity/v3/projects => generated 2553 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:26:30.690464 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b89f59-1214-4c77-b771-1594832ed90a None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:30.691312 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b89f59-1214-4c77-b771-1594832ed90a None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:30.691493 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b89f59-1214-4c77-b771-1594832ed90a None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:30.693424 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 656/1315] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:26:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:26:30.699423 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe726c-55b5-40d8-b4dd-7c395521f1cb None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:30.699870 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe726c-55b5-40d8-b4dd-7c395521f1cb None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:30.699982 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe726c-55b5-40d8-b4dd-7c395521f1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:30.717450 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-86fe726c-55b5-40d8-b4dd-7c395521f1cb None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:30.718689 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-86fe726c-55b5-40d8-b4dd-7c395521f1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:30.726379 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 660/1316] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:26:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:30.751990 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b89f59-1214-4c77-b771-1594832ed90a None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:30.764035 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b89f59-1214-4c77-b771-1594832ed90a None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:30.768368 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce594c-dc94-412a-9df0-0d9a3f8b82b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:30.769192 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce594c-dc94-412a-9df0-0d9a3f8b82b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:30.769473 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce594c-dc94-412a-9df0-0d9a3f8b82b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:30.769779 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce594c-dc94-412a-9df0-0d9a3f8b82b2 admin admin] PATH_INFO: `/v3/projects/1c2561d46a214d4e90408d58a46cf8d8` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:30.779911 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce594c-dc94-412a-9df0-0d9a3f8b82b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=1c2561d46a214d4e90408d58a46cf8d8)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:30.781978 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce594c-dc94-412a-9df0-0d9a3f8b82b2 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:30.783675 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 657/1317] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:26:30 2021] GET /identity/v3/projects/1c2561d46a214d4e90408d58a46cf8d8 => generated 311 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:26:30.790156 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe726c-55b5-40d8-b4dd-7c395521f1cb None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:30.799483 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe726c-55b5-40d8-b4dd-7c395521f1cb None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:30.804041 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ad3a9-abc8-444f-af67-18b5076697e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:30.804679 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ad3a9-abc8-444f-af67-18b5076697e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:30.804966 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ad3a9-abc8-444f-af67-18b5076697e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:30.805248 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ad3a9-abc8-444f-af67-18b5076697e0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:30.806064 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ad3a9-abc8-444f-af67-18b5076697e0 admin admin] RBAC: Adding query filter params (scope.project.id=1c2561d46a214d4e90408d58a46cf8d8) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:26:30.806376 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ad3a9-abc8-444f-af67-18b5076697e0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:30.808466 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ad3a9-abc8-444f-af67-18b5076697e0 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:30.815412 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 661/1318] 10.222.0.25 () {56 vars in 1231 bytes} [Wed Oct 27 01:26:30 2021] GET /identity/v3/role_assignments?scope.project.id=1c2561d46a214d4e90408d58a46cf8d8 => generated 526 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:26:30.821453 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce594c-dc94-412a-9df0-0d9a3f8b82b2 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:30.830901 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce594c-dc94-412a-9df0-0d9a3f8b82b2 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:30.835342 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efaf544-d193-4413-a2ae-7f12cd65d3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:30.836176 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efaf544-d193-4413-a2ae-7f12cd65d3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:30.836456 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efaf544-d193-4413-a2ae-7f12cd65d3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:30.836729 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efaf544-d193-4413-a2ae-7f12cd65d3e9 admin admin] PATH_INFO: `/v3/users/e286c2e89b884ab3ad3bd157a549016f` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:30.849507 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efaf544-d193-4413-a2ae-7f12cd65d3e9 admin admin] RBAC: Authorizing `identity:get_user(user_id=e286c2e89b884ab3ad3bd157a549016f)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:30.851603 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efaf544-d193-4413-a2ae-7f12cd65d3e9 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:30.853173 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 658/1319] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:26:30 2021] GET /identity/v3/users/e286c2e89b884ab3ad3bd157a549016f => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:26:33.118063 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49528321-3c51-4ac7-a18b-012b7b692616 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:33.118637 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49528321-3c51-4ac7-a18b-012b7b692616 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:33.118637 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49528321-3c51-4ac7-a18b-012b7b692616 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:33.120460 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 662/1320] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:26:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:26:33.126243 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31d95d-d8b1-486a-b647-c80646768ecd None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:33.126678 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31d95d-d8b1-486a-b647-c80646768ecd None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:33.126813 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31d95d-d8b1-486a-b647-c80646768ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:33.144346 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-fe31d95d-d8b1-486a-b647-c80646768ecd None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:33.145570 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-fe31d95d-d8b1-486a-b647-c80646768ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:33.153945 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 659/1321] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:26:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:33.177026 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49528321-3c51-4ac7-a18b-012b7b692616 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:33.189403 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49528321-3c51-4ac7-a18b-012b7b692616 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:33.193811 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cb659-4b97-48a3-8a81-b33a949cb866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:33.194645 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cb659-4b97-48a3-8a81-b33a949cb866 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:33.194923 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cb659-4b97-48a3-8a81-b33a949cb866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:33.195196 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cb659-4b97-48a3-8a81-b33a949cb866 admin admin] PATH_INFO: `/v3/projects/2de0e1d9ce084c8abbb7235e6f290e29` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:33.206109 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4cb659-4b97-48a3-8a81-b33a949cb866 admin admin] RBAC: Authorizing `identity:get_project(project_id=2de0e1d9ce084c8abbb7235e6f290e29)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:33.208127 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4cb659-4b97-48a3-8a81-b33a949cb866 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:33.209798 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 663/1322] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:26:33 2021] GET /identity/v3/projects/2de0e1d9ce084c8abbb7235e6f290e29 => generated 312 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:26:33.216800 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31d95d-d8b1-486a-b647-c80646768ecd None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:33.225868 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31d95d-d8b1-486a-b647-c80646768ecd None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:33.230400 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92c4bd-9c13-4da5-918b-46cc8bca5d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:33.231041 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92c4bd-9c13-4da5-918b-46cc8bca5d27 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:33.231326 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92c4bd-9c13-4da5-918b-46cc8bca5d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:33.231607 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92c4bd-9c13-4da5-918b-46cc8bca5d27 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:33.232378 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92c4bd-9c13-4da5-918b-46cc8bca5d27 admin admin] RBAC: Adding query filter params (scope.project.id=2de0e1d9ce084c8abbb7235e6f290e29) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:26:33.232691 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92c4bd-9c13-4da5-918b-46cc8bca5d27 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:33.234557 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92c4bd-9c13-4da5-918b-46cc8bca5d27 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:33.240943 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 660/1323] 10.222.0.25 () {56 vars in 1231 bytes} [Wed Oct 27 01:26:33 2021] GET /identity/v3/role_assignments?scope.project.id=2de0e1d9ce084c8abbb7235e6f290e29 => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:26:33.247737 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cb659-4b97-48a3-8a81-b33a949cb866 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:33.257209 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cb659-4b97-48a3-8a81-b33a949cb866 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:33.261749 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f7121-1766-4ed0-bf04-89c3a6d35000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:33.262597 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f7121-1766-4ed0-bf04-89c3a6d35000 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:33.263516 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f7121-1766-4ed0-bf04-89c3a6d35000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:33.263791 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f7121-1766-4ed0-bf04-89c3a6d35000 admin admin] PATH_INFO: `/v3/users/ec851783eb6e47d286a7d11681c3f75a` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:33.277087 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f7121-1766-4ed0-bf04-89c3a6d35000 admin admin] RBAC: Authorizing `identity:get_user(user_id=ec851783eb6e47d286a7d11681c3f75a)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:33.279272 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f7121-1766-4ed0-bf04-89c3a6d35000 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:33.280896 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 664/1324] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:26:33 2021] GET /identity/v3/users/ec851783eb6e47d286a7d11681c3f75a => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:26:35.546900 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c53174-51ad-48f0-ac5e-e1c5f1c5c85e None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:35.547344 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c53174-51ad-48f0-ac5e-e1c5f1c5c85e None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:35.547446 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c53174-51ad-48f0-ac5e-e1c5f1c5c85e None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:35.549237 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 661/1325] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:26:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:26:35.555146 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5b458-4b49-4595-94c1-89a81539378c None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:35.555563 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5b458-4b49-4595-94c1-89a81539378c None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:35.555693 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5b458-4b49-4595-94c1-89a81539378c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:35.573774 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-9ed5b458-4b49-4595-94c1-89a81539378c None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:35.574992 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-9ed5b458-4b49-4595-94c1-89a81539378c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:35.583281 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 665/1326] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:26:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:35.607055 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c53174-51ad-48f0-ac5e-e1c5f1c5c85e None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:35.619022 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c53174-51ad-48f0-ac5e-e1c5f1c5c85e None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:35.623909 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b33a0-785a-470f-bfa9-d7e47f9edd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:35.624743 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b33a0-785a-470f-bfa9-d7e47f9edd7b admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:35.625030 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b33a0-785a-470f-bfa9-d7e47f9edd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:35.625310 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b33a0-785a-470f-bfa9-d7e47f9edd7b admin admin] PATH_INFO: `/v3/projects/34499f5a2c02434b979288e28f14fe69` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:35.636075 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b33a0-785a-470f-bfa9-d7e47f9edd7b admin admin] RBAC: Authorizing `identity:get_project(project_id=34499f5a2c02434b979288e28f14fe69)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:35.638781 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b33a0-785a-470f-bfa9-d7e47f9edd7b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:35.640450 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 662/1327] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:26:35 2021] GET /identity/v3/projects/34499f5a2c02434b979288e28f14fe69 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:26:35.646936 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5b458-4b49-4595-94c1-89a81539378c None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:35.655647 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5b458-4b49-4595-94c1-89a81539378c None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:35.660422 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958932a4-81fe-48a1-b580-6bda5dc35674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:35.661068 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958932a4-81fe-48a1-b580-6bda5dc35674 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:35.661349 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958932a4-81fe-48a1-b580-6bda5dc35674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:35.661669 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958932a4-81fe-48a1-b580-6bda5dc35674 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:35.662442 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958932a4-81fe-48a1-b580-6bda5dc35674 admin admin] RBAC: Adding query filter params (scope.project.id=34499f5a2c02434b979288e28f14fe69) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:26:35.662751 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958932a4-81fe-48a1-b580-6bda5dc35674 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:35.664702 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958932a4-81fe-48a1-b580-6bda5dc35674 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:35.671389 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 666/1328] 10.222.0.25 () {56 vars in 1231 bytes} [Wed Oct 27 01:26:35 2021] GET /identity/v3/role_assignments?scope.project.id=34499f5a2c02434b979288e28f14fe69 => generated 1934 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:26:35.677578 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b33a0-785a-470f-bfa9-d7e47f9edd7b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:35.690856 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b33a0-785a-470f-bfa9-d7e47f9edd7b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:35.695649 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63d34f-a9fc-42a8-951a-dc040fdc8d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:35.696517 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63d34f-a9fc-42a8-951a-dc040fdc8d93 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:35.696807 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63d34f-a9fc-42a8-951a-dc040fdc8d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:35.697088 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63d34f-a9fc-42a8-951a-dc040fdc8d93 admin admin] PATH_INFO: `/v3/users/f4e70afd8b1544f39207d23608348872` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:35.711140 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63d34f-a9fc-42a8-951a-dc040fdc8d93 admin admin] RBAC: Authorizing `identity:get_user(user_id=f4e70afd8b1544f39207d23608348872)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:35.713244 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63d34f-a9fc-42a8-951a-dc040fdc8d93 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:35.714921 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 663/1329] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:26:35 2021] GET /identity/v3/users/f4e70afd8b1544f39207d23608348872 => generated 283 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:26:35.721622 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958932a4-81fe-48a1-b580-6bda5dc35674 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:35.731147 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958932a4-81fe-48a1-b580-6bda5dc35674 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:35.735687 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f9dbc-5080-492c-81f3-1ebc2e297417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:35.736531 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f9dbc-5080-492c-81f3-1ebc2e297417 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:35.736814 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f9dbc-5080-492c-81f3-1ebc2e297417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:35.737121 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f9dbc-5080-492c-81f3-1ebc2e297417 admin admin] PATH_INFO: `/v3/users/d48900f443894ac798508f952478760c` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:35.738353 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f9dbc-5080-492c-81f3-1ebc2e297417 admin admin] RBAC: Authorizing `identity:get_user(user_id=d48900f443894ac798508f952478760c)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:35.740131 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f9dbc-5080-492c-81f3-1ebc2e297417 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:35.741744 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 667/1330] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:26:35 2021] GET /identity/v3/users/d48900f443894ac798508f952478760c => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:26:38.021111 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85721b3a-3f97-492a-9911-8c241ceb590d None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:38.021658 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85721b3a-3f97-492a-9911-8c241ceb590d None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:38.021769 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85721b3a-3f97-492a-9911-8c241ceb590d None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:38.023491 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 664/1331] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:26:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:26:38.029586 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cacd2-2d43-4f91-9651-ae84ad51c519 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:38.029981 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cacd2-2d43-4f91-9651-ae84ad51c519 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:38.030147 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cacd2-2d43-4f91-9651-ae84ad51c519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:38.047984 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-7f8cacd2-2d43-4f91-9651-ae84ad51c519 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:38.049191 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-7f8cacd2-2d43-4f91-9651-ae84ad51c519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:38.057284 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 668/1332] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:26:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:38.081861 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85721b3a-3f97-492a-9911-8c241ceb590d None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:38.093854 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85721b3a-3f97-492a-9911-8c241ceb590d None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:38.098266 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe259188-8d77-4114-847e-de59dbc20b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:38.099101 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe259188-8d77-4114-847e-de59dbc20b0d admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:38.099386 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe259188-8d77-4114-847e-de59dbc20b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:38.099662 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe259188-8d77-4114-847e-de59dbc20b0d admin admin] PATH_INFO: `/v3/projects/38379d318e5c49acaf4683887f433419` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:38.100839 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe259188-8d77-4114-847e-de59dbc20b0d admin admin] RBAC: Authorizing `identity:get_project(project_id=38379d318e5c49acaf4683887f433419)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:38.102657 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe259188-8d77-4114-847e-de59dbc20b0d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:38.104287 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 665/1333] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:26:38 2021] GET /identity/v3/projects/38379d318e5c49acaf4683887f433419 => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:26:38.111214 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8cacd2-2d43-4f91-9651-ae84ad51c519 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:38.119985 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8cacd2-2d43-4f91-9651-ae84ad51c519 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:38.125062 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343839a6-3be2-4e02-aef9-ef5c4252f45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:38.125715 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343839a6-3be2-4e02-aef9-ef5c4252f45a admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:38.125998 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343839a6-3be2-4e02-aef9-ef5c4252f45a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:38.126274 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343839a6-3be2-4e02-aef9-ef5c4252f45a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:38.127036 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343839a6-3be2-4e02-aef9-ef5c4252f45a admin admin] RBAC: Adding query filter params (scope.project.id=38379d318e5c49acaf4683887f433419) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:26:38.127339 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343839a6-3be2-4e02-aef9-ef5c4252f45a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:38.129155 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343839a6-3be2-4e02-aef9-ef5c4252f45a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:38.134702 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 669/1334] 10.222.0.25 () {56 vars in 1231 bytes} [Wed Oct 27 01:26:38 2021] GET /identity/v3/role_assignments?scope.project.id=38379d318e5c49acaf4683887f433419 => generated 879 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:26:38.140842 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe259188-8d77-4114-847e-de59dbc20b0d admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:38.150388 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe259188-8d77-4114-847e-de59dbc20b0d admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:38.154955 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c615ff-ae15-46f4-a17c-aace33a5f6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:38.155784 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c615ff-ae15-46f4-a17c-aace33a5f6ab admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:38.156072 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c615ff-ae15-46f4-a17c-aace33a5f6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:38.156354 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c615ff-ae15-46f4-a17c-aace33a5f6ab admin admin] PATH_INFO: `/v3/users/d48900f443894ac798508f952478760c` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:38.157569 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c615ff-ae15-46f4-a17c-aace33a5f6ab admin admin] RBAC: Authorizing `identity:get_user(user_id=d48900f443894ac798508f952478760c)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:38.159352 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c615ff-ae15-46f4-a17c-aace33a5f6ab admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:38.160914 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 666/1335] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:26:38 2021] GET /identity/v3/users/d48900f443894ac798508f952478760c => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:26:40.416263 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e4a69-cf9c-4148-9393-a67eda6063d3 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:40.416825 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e4a69-cf9c-4148-9393-a67eda6063d3 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:40.416825 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e4a69-cf9c-4148-9393-a67eda6063d3 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:40.419485 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 670/1336] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:26:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:26:40.425434 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fce77-113f-446b-8310-16e0352e1b23 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:40.425877 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fce77-113f-446b-8310-16e0352e1b23 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:40.426036 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fce77-113f-446b-8310-16e0352e1b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:40.444083 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-d05fce77-113f-446b-8310-16e0352e1b23 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:40.445279 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-d05fce77-113f-446b-8310-16e0352e1b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:40.452970 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 667/1337] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:26:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:40.476724 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e4a69-cf9c-4148-9393-a67eda6063d3 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:40.489715 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e4a69-cf9c-4148-9393-a67eda6063d3 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:40.494196 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187372f-100f-45b1-92ce-3564ffbda4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:40.495037 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187372f-100f-45b1-92ce-3564ffbda4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:40.495319 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187372f-100f-45b1-92ce-3564ffbda4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:40.495613 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187372f-100f-45b1-92ce-3564ffbda4a3 admin admin] PATH_INFO: `/v3/projects/6def349c5d5f4766a9afeced44a5b6e1` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:40.506699 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187372f-100f-45b1-92ce-3564ffbda4a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=6def349c5d5f4766a9afeced44a5b6e1)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:40.508732 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187372f-100f-45b1-92ce-3564ffbda4a3 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:40.510508 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 671/1338] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:26:40 2021] GET /identity/v3/projects/6def349c5d5f4766a9afeced44a5b6e1 => generated 361 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:26:40.517069 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fce77-113f-446b-8310-16e0352e1b23 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:40.526173 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fce77-113f-446b-8310-16e0352e1b23 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:40.530772 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073316d-db72-47c2-9fb7-9a3c80e71208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:40.531406 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073316d-db72-47c2-9fb7-9a3c80e71208 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:40.531718 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073316d-db72-47c2-9fb7-9a3c80e71208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:40.531990 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073316d-db72-47c2-9fb7-9a3c80e71208 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:40.532753 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073316d-db72-47c2-9fb7-9a3c80e71208 admin admin] RBAC: Adding query filter params (scope.project.id=6def349c5d5f4766a9afeced44a5b6e1) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:26:40.533055 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073316d-db72-47c2-9fb7-9a3c80e71208 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:40.534902 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073316d-db72-47c2-9fb7-9a3c80e71208 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:40.540379 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 668/1339] 10.222.0.25 () {56 vars in 1231 bytes} [Wed Oct 27 01:26:40 2021] GET /identity/v3/role_assignments?scope.project.id=6def349c5d5f4766a9afeced44a5b6e1 => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:26:40.546805 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187372f-100f-45b1-92ce-3564ffbda4a3 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:40.556207 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187372f-100f-45b1-92ce-3564ffbda4a3 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:40.561634 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cca1b5-b191-44af-a09b-5802eb50106d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:40.562476 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cca1b5-b191-44af-a09b-5802eb50106d admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:40.562760 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cca1b5-b191-44af-a09b-5802eb50106d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:40.563039 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cca1b5-b191-44af-a09b-5802eb50106d admin admin] PATH_INFO: `/v3/users/b4c2d9702593486480adc70622a855d0` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:40.575992 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cca1b5-b191-44af-a09b-5802eb50106d admin admin] RBAC: Authorizing `identity:get_user(user_id=b4c2d9702593486480adc70622a855d0)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:40.578152 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cca1b5-b191-44af-a09b-5802eb50106d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:40.579778 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 672/1340] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:26:40 2021] GET /identity/v3/users/b4c2d9702593486480adc70622a855d0 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:26:42.836866 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df367442-9c37-4059-bb41-671cbf176016 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:42.837437 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df367442-9c37-4059-bb41-671cbf176016 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:42.837437 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df367442-9c37-4059-bb41-671cbf176016 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:42.839242 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 669/1341] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:26:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:26:42.845307 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb93e2-e495-4ee3-b037-53f6bebaffd7 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:42.845795 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb93e2-e495-4ee3-b037-53f6bebaffd7 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:42.846018 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb93e2-e495-4ee3-b037-53f6bebaffd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:42.864039 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-4ecb93e2-e495-4ee3-b037-53f6bebaffd7 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:42.865229 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4ecb93e2-e495-4ee3-b037-53f6bebaffd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:42.873691 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 673/1342] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:26:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:42.896904 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df367442-9c37-4059-bb41-671cbf176016 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:42.909060 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df367442-9c37-4059-bb41-671cbf176016 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:42.913558 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5f16f-3d87-4897-bfca-7451e3003d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:42.914389 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5f16f-3d87-4897-bfca-7451e3003d88 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:42.914674 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5f16f-3d87-4897-bfca-7451e3003d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:42.914948 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5f16f-3d87-4897-bfca-7451e3003d88 admin admin] PATH_INFO: `/v3/projects/cd7d86467c28467780adb2bb32bc22a8` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:42.925806 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5f16f-3d87-4897-bfca-7451e3003d88 admin admin] RBAC: Authorizing `identity:get_project(project_id=cd7d86467c28467780adb2bb32bc22a8)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:42.927846 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5f16f-3d87-4897-bfca-7451e3003d88 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:42.929506 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 670/1343] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:26:42 2021] GET /identity/v3/projects/cd7d86467c28467780adb2bb32bc22a8 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:26:42.936704 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb93e2-e495-4ee3-b037-53f6bebaffd7 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:42.945505 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb93e2-e495-4ee3-b037-53f6bebaffd7 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:42.950264 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91073d-948c-4aa2-879c-d66865d42e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:42.950900 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91073d-948c-4aa2-879c-d66865d42e11 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:42.951188 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91073d-948c-4aa2-879c-d66865d42e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:42.951469 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91073d-948c-4aa2-879c-d66865d42e11 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:42.952245 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91073d-948c-4aa2-879c-d66865d42e11 admin admin] RBAC: Adding query filter params (scope.project.id=cd7d86467c28467780adb2bb32bc22a8) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:26:42.952555 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91073d-948c-4aa2-879c-d66865d42e11 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:42.954500 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91073d-948c-4aa2-879c-d66865d42e11 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:42.960592 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 674/1344] 10.222.0.25 () {56 vars in 1231 bytes} [Wed Oct 27 01:26:42 2021] GET /identity/v3/role_assignments?scope.project.id=cd7d86467c28467780adb2bb32bc22a8 => generated 877 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:26:42.967353 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5f16f-3d87-4897-bfca-7451e3003d88 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:42.977137 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5f16f-3d87-4897-bfca-7451e3003d88 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:42.982301 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2c217-bac0-4cdc-b436-b727bf09ca62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:42.983148 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2c217-bac0-4cdc-b436-b727bf09ca62 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:42.983433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2c217-bac0-4cdc-b436-b727bf09ca62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:42.983712 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2c217-bac0-4cdc-b436-b727bf09ca62 admin admin] PATH_INFO: `/v3/users/0e415f6d85464dac8814d9c6c7655c70` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:42.996871 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2c217-bac0-4cdc-b436-b727bf09ca62 admin admin] RBAC: Authorizing `identity:get_user(user_id=0e415f6d85464dac8814d9c6c7655c70)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:42.998995 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2c217-bac0-4cdc-b436-b727bf09ca62 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:43.000595 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 671/1345] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:26:42 2021] GET /identity/v3/users/0e415f6d85464dac8814d9c6c7655c70 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:26:43.006799 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91073d-948c-4aa2-879c-d66865d42e11 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:43.016207 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91073d-948c-4aa2-879c-d66865d42e11 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:43.020912 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69127e49-72c3-4dcb-a4b4-7bdbaf85eab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:43.021893 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69127e49-72c3-4dcb-a4b4-7bdbaf85eab0 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:43.022180 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69127e49-72c3-4dcb-a4b4-7bdbaf85eab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:43.022458 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69127e49-72c3-4dcb-a4b4-7bdbaf85eab0 admin admin] PATH_INFO: `/v3/users/4f748b378f634b44968b1b8be340c983` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:43.035831 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69127e49-72c3-4dcb-a4b4-7bdbaf85eab0 admin admin] RBAC: Authorizing `identity:get_user(user_id=4f748b378f634b44968b1b8be340c983)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:43.037998 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69127e49-72c3-4dcb-a4b4-7bdbaf85eab0 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:43.039600 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 675/1346] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:26:43 2021] GET /identity/v3/users/4f748b378f634b44968b1b8be340c983 => generated 285 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:26:45.369766 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bf6a4-34b2-40d0-b021-01f2ff209c5f None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:45.370294 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bf6a4-34b2-40d0-b021-01f2ff209c5f None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:45.370294 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bf6a4-34b2-40d0-b021-01f2ff209c5f None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:45.372101 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 672/1347] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:26:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:26:45.377987 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0642a8-47db-44e5-b398-7732d9848b10 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:45.378386 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0642a8-47db-44e5-b398-7732d9848b10 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:45.378550 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0642a8-47db-44e5-b398-7732d9848b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:45.396822 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-7e0642a8-47db-44e5-b398-7732d9848b10 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:45.398784 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-7e0642a8-47db-44e5-b398-7732d9848b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:45.407146 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 676/1348] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:26:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:45.430446 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bf6a4-34b2-40d0-b021-01f2ff209c5f None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:45.442856 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bf6a4-34b2-40d0-b021-01f2ff209c5f None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:45.447306 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b197eb5-9717-4136-98a9-2819be271c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:45.448141 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b197eb5-9717-4136-98a9-2819be271c4c admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:45.448429 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b197eb5-9717-4136-98a9-2819be271c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:45.448710 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b197eb5-9717-4136-98a9-2819be271c4c admin admin] PATH_INFO: `/v3/projects/f405caf5e07a413190b7459d3015b944` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:45.459093 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b197eb5-9717-4136-98a9-2819be271c4c admin admin] RBAC: Authorizing `identity:get_project(project_id=f405caf5e07a413190b7459d3015b944)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:45.461119 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b197eb5-9717-4136-98a9-2819be271c4c admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:45.462843 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 673/1349] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Oct 27 01:26:45 2021] GET /identity/v3/projects/f405caf5e07a413190b7459d3015b944 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:26:45.469965 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0642a8-47db-44e5-b398-7732d9848b10 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:45.478968 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0642a8-47db-44e5-b398-7732d9848b10 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:45.484078 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980a236-4a04-4a21-b9d2-955dd80d5977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:45.484715 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980a236-4a04-4a21-b9d2-955dd80d5977 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:45.485002 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980a236-4a04-4a21-b9d2-955dd80d5977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:45.485279 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980a236-4a04-4a21-b9d2-955dd80d5977 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:45.486083 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980a236-4a04-4a21-b9d2-955dd80d5977 admin admin] RBAC: Adding query filter params (scope.project.id=f405caf5e07a413190b7459d3015b944) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:26:45.486391 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980a236-4a04-4a21-b9d2-955dd80d5977 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:45.488203 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980a236-4a04-4a21-b9d2-955dd80d5977 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:45.494751 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 677/1350] 10.222.0.25 () {56 vars in 1231 bytes} [Wed Oct 27 01:26:45 2021] GET /identity/v3/role_assignments?scope.project.id=f405caf5e07a413190b7459d3015b944 => generated 1934 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:26:45.500736 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b197eb5-9717-4136-98a9-2819be271c4c admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:45.510386 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b197eb5-9717-4136-98a9-2819be271c4c admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:45.514983 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa2a6b-cfde-49a4-bea4-a50b39f7e607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:45.515826 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa2a6b-cfde-49a4-bea4-a50b39f7e607 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:45.516111 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa2a6b-cfde-49a4-bea4-a50b39f7e607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:45.516389 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa2a6b-cfde-49a4-bea4-a50b39f7e607 admin admin] PATH_INFO: `/v3/users/d48900f443894ac798508f952478760c` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:45.517611 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa2a6b-cfde-49a4-bea4-a50b39f7e607 admin admin] RBAC: Authorizing `identity:get_user(user_id=d48900f443894ac798508f952478760c)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:45.519369 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa2a6b-cfde-49a4-bea4-a50b39f7e607 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:45.520925 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 674/1351] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:26:45 2021] GET /identity/v3/users/d48900f443894ac798508f952478760c => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:26:45.527002 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980a236-4a04-4a21-b9d2-955dd80d5977 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:45.536938 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980a236-4a04-4a21-b9d2-955dd80d5977 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:45.541382 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb261f9-4bee-4cf8-b5c4-6b80ce9102e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:45.542262 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb261f9-4bee-4cf8-b5c4-6b80ce9102e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:45.542545 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb261f9-4bee-4cf8-b5c4-6b80ce9102e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:45.542824 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb261f9-4bee-4cf8-b5c4-6b80ce9102e3 admin admin] PATH_INFO: `/v3/users/ec851783eb6e47d286a7d11681c3f75a` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:45.544635 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb261f9-4bee-4cf8-b5c4-6b80ce9102e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=ec851783eb6e47d286a7d11681c3f75a)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:45.546747 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb261f9-4bee-4cf8-b5c4-6b80ce9102e3 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:45.548307 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 678/1352] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Oct 27 01:26:45 2021] GET /identity/v3/users/ec851783eb6e47d286a7d11681c3f75a => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:26:50.859558 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6995d34-b14a-4271-86e8-ecd05b659bf2 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:50.860069 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6995d34-b14a-4271-86e8-ecd05b659bf2 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:50.860069 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6995d34-b14a-4271-86e8-ecd05b659bf2 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:50.861853 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 675/1353] 10.222.0.25 () {54 vars in 918 bytes} [Wed Oct 27 01:26:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:26:50.867736 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d80c04-4485-48bb-b96c-04a69370f74f None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:50.868167 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d80c04-4485-48bb-b96c-04a69370f74f None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:50.868276 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d80c04-4485-48bb-b96c-04a69370f74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:50.886389 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-f9d80c04-4485-48bb-b96c-04a69370f74f None None] MFA Rules not processed for user `2ff82e315d8c42e49556ab67fbf53b32`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:50.887567 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-f9d80c04-4485-48bb-b96c-04a69370f74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:50.895838 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 679/1354] 10.222.0.25 () {58 vars in 1015 bytes} [Wed Oct 27 01:26:50 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:50.910843 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce13638-3010-47c9-b09d-757c13120382 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:50.911139 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce13638-3010-47c9-b09d-757c13120382 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:50.911424 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce13638-3010-47c9-b09d-757c13120382 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:50.913169 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 676/1355] 10.222.0.25 () {54 vars in 918 bytes} [Wed Oct 27 01:26:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:26:50.918802 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee569f2f-5ba0-4899-9268-593101b39591 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:50.919091 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee569f2f-5ba0-4899-9268-593101b39591 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:50.919371 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee569f2f-5ba0-4899-9268-593101b39591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:50.937139 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-ee569f2f-5ba0-4899-9268-593101b39591 None None] MFA Rules not processed for user `b2f8304b85b64dc4ac58523897306660`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:50.938329 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-ee569f2f-5ba0-4899-9268-593101b39591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:50.947279 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 680/1356] 10.222.0.25 () {58 vars in 1015 bytes} [Wed Oct 27 01:26:50 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:53.802008 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3446a-624e-44e5-a9dc-c6b5604734c6 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:53.802516 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3446a-624e-44e5-a9dc-c6b5604734c6 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:53.802516 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3446a-624e-44e5-a9dc-c6b5604734c6 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:53.804290 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 677/1357] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:26:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:26:53.810505 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946bb20-37b8-4a88-9166-5509881ff5da None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:53.810931 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946bb20-37b8-4a88-9166-5509881ff5da None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:53.811063 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946bb20-37b8-4a88-9166-5509881ff5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:53.829071 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-8946bb20-37b8-4a88-9166-5509881ff5da None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:53.830281 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-8946bb20-37b8-4a88-9166-5509881ff5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:53.837869 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 681/1358] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:26:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:53.880809 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3446a-624e-44e5-a9dc-c6b5604734c6 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:53.900074 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3446a-624e-44e5-a9dc-c6b5604734c6 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:53.906030 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8751dd-122d-496a-9eff-f4ff320d4567 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:53.906661 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8751dd-122d-496a-9eff-f4ff320d4567 service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:53.906945 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8751dd-122d-496a-9eff-f4ff320d4567 service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:53.907222 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8751dd-122d-496a-9eff-f4ff320d4567 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:53.915142 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8751dd-122d-496a-9eff-f4ff320d4567 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:53.916693 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8751dd-122d-496a-9eff-f4ff320d4567 service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:53.925821 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 678/1359] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:55.472663 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6275c5-0946-42bc-a4c4-c14cc1ddab22 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:55.473249 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6275c5-0946-42bc-a4c4-c14cc1ddab22 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:55.473249 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6275c5-0946-42bc-a4c4-c14cc1ddab22 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:55.475079 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 682/1360] 10.222.0.25 () {54 vars in 911 bytes} [Wed Oct 27 01:26:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:26:55.481169 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9c5b8-0848-4831-a243-4c4fb54908dd None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:55.481598 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9c5b8-0848-4831-a243-4c4fb54908dd None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:55.481780 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9c5b8-0848-4831-a243-4c4fb54908dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:55.499760 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-70b9c5b8-0848-4831-a243-4c4fb54908dd None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:55.500948 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-70b9c5b8-0848-4831-a243-4c4fb54908dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:55.508653 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 679/1361] 10.222.0.25 () {58 vars in 1008 bytes} [Wed Oct 27 01:26:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:55.659172 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6275c5-0946-42bc-a4c4-c14cc1ddab22 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:55.673607 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6275c5-0946-42bc-a4c4-c14cc1ddab22 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:55.678990 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013cbd9-a38b-412d-9f32-2b1d39018487 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:55.679619 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013cbd9-a38b-412d-9f32-2b1d39018487 service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:55.679902 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013cbd9-a38b-412d-9f32-2b1d39018487 service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:55.680177 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013cbd9-a38b-412d-9f32-2b1d39018487 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:55.689027 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e013cbd9-a38b-412d-9f32-2b1d39018487 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:55.690658 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e013cbd9-a38b-412d-9f32-2b1d39018487 service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:55.699608 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 683/1362] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:57.147423 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456e130-f6df-4234-a451-39963859ac6b None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:57.147950 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456e130-f6df-4234-a451-39963859ac6b None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:57.148040 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456e130-f6df-4234-a451-39963859ac6b None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:57.149811 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 680/1363] 10.222.0.25 () {54 vars in 911 bytes} [Wed Oct 27 01:26:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:26:57.156348 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89962eda-5b43-41d1-b364-5be93c246752 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:57.156751 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89962eda-5b43-41d1-b364-5be93c246752 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:57.156897 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89962eda-5b43-41d1-b364-5be93c246752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:57.174117 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-89962eda-5b43-41d1-b364-5be93c246752 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:57.175308 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-89962eda-5b43-41d1-b364-5be93c246752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:57.183299 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 684/1364] 10.222.0.25 () {58 vars in 1008 bytes} [Wed Oct 27 01:26:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:57.334594 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456e130-f6df-4234-a451-39963859ac6b None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:57.348609 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456e130-f6df-4234-a451-39963859ac6b None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:57.353958 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d472d-8c4b-4413-9f6b-6755b78cbe26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:57.354696 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d472d-8c4b-4413-9f6b-6755b78cbe26 service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:57.354883 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d472d-8c4b-4413-9f6b-6755b78cbe26 service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:57.355163 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d472d-8c4b-4413-9f6b-6755b78cbe26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:57.363066 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d472d-8c4b-4413-9f6b-6755b78cbe26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:57.364624 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d472d-8c4b-4413-9f6b-6755b78cbe26 service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:57.374661 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 681/1365] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:58.825575 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7829ccc-c988-45b2-8176-dcc6ca60ab89 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:58.826126 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7829ccc-c988-45b2-8176-dcc6ca60ab89 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:58.826126 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7829ccc-c988-45b2-8176-dcc6ca60ab89 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:58.827919 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 685/1366] 10.222.0.25 () {54 vars in 911 bytes} [Wed Oct 27 01:26:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:26:58.833477 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c7ee7-ddf0-43cf-9fc1-1bbdac02ca01 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:58.834081 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c7ee7-ddf0-43cf-9fc1-1bbdac02ca01 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:58.834401 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c7ee7-ddf0-43cf-9fc1-1bbdac02ca01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:58.853861 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-df0c7ee7-ddf0-43cf-9fc1-1bbdac02ca01 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:58.855052 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-df0c7ee7-ddf0-43cf-9fc1-1bbdac02ca01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:58.863356 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 682/1367] 10.222.0.25 () {58 vars in 1008 bytes} [Wed Oct 27 01:26:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:59.017221 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7829ccc-c988-45b2-8176-dcc6ca60ab89 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:59.032269 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7829ccc-c988-45b2-8176-dcc6ca60ab89 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:59.037710 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c8671-cdf2-4028-9470-56b656ee8796 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:59.038352 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c8671-cdf2-4028-9470-56b656ee8796 service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:59.038635 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c8671-cdf2-4028-9470-56b656ee8796 service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:59.038913 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c8671-cdf2-4028-9470-56b656ee8796 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:59.047535 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c8671-cdf2-4028-9470-56b656ee8796 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:59.049101 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c8671-cdf2-4028-9470-56b656ee8796 service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:59.058893 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 686/1368] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:27:00.491827 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b80ad-c35e-4e14-85cc-a56cb62ef246 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:00.492365 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b80ad-c35e-4e14-85cc-a56cb62ef246 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:00.492365 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b80ad-c35e-4e14-85cc-a56cb62ef246 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:00.494184 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 683/1369] 10.222.0.25 () {54 vars in 911 bytes} [Wed Oct 27 01:27:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:27:00.499694 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc07c6-7056-473e-9937-32f0d51f1c74 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:00.500125 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc07c6-7056-473e-9937-32f0d51f1c74 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:00.500326 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc07c6-7056-473e-9937-32f0d51f1c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:00.517830 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-d7bc07c6-7056-473e-9937-32f0d51f1c74 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:00.519337 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-d7bc07c6-7056-473e-9937-32f0d51f1c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:00.527093 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 687/1370] 10.222.0.25 () {58 vars in 1008 bytes} [Wed Oct 27 01:27:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:00.678975 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b80ad-c35e-4e14-85cc-a56cb62ef246 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:00.693144 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b80ad-c35e-4e14-85cc-a56cb62ef246 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:00.698456 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe798e-581d-4bcf-a45c-dd61329e0885 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:00.699087 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe798e-581d-4bcf-a45c-dd61329e0885 service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:00.699873 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe798e-581d-4bcf-a45c-dd61329e0885 service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:00.700154 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe798e-581d-4bcf-a45c-dd61329e0885 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:00.708001 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe798e-581d-4bcf-a45c-dd61329e0885 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:00.709659 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe798e-581d-4bcf-a45c-dd61329e0885 service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:00.719322 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 684/1371] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:27:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:27:02.120323 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725754b0-ef5a-4d1e-80a3-6de155721ebe None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:02.120869 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725754b0-ef5a-4d1e-80a3-6de155721ebe None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:02.120869 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725754b0-ef5a-4d1e-80a3-6de155721ebe None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:02.123266 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 688/1372] 10.222.0.25 () {54 vars in 911 bytes} [Wed Oct 27 01:27:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:27:02.128636 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d0d34-efea-4613-8aac-8e6e956c47fc None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:02.129013 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d0d34-efea-4613-8aac-8e6e956c47fc None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:02.129204 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d0d34-efea-4613-8aac-8e6e956c47fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:02.146688 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-728d0d34-efea-4613-8aac-8e6e956c47fc None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:02.147906 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-728d0d34-efea-4613-8aac-8e6e956c47fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:02.155658 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 685/1373] 10.222.0.25 () {58 vars in 1008 bytes} [Wed Oct 27 01:27:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:02.309394 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725754b0-ef5a-4d1e-80a3-6de155721ebe None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:02.322938 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725754b0-ef5a-4d1e-80a3-6de155721ebe None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:02.328147 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461aef95-a4d1-4d5d-bbc5-fffb5579dd82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:02.328765 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aef95-a4d1-4d5d-bbc5-fffb5579dd82 service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:02.329046 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aef95-a4d1-4d5d-bbc5-fffb5579dd82 service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:02.329325 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aef95-a4d1-4d5d-bbc5-fffb5579dd82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:02.337084 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461aef95-a4d1-4d5d-bbc5-fffb5579dd82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:02.338922 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461aef95-a4d1-4d5d-bbc5-fffb5579dd82 service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:02.347834 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 689/1374] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:27:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:27:03.741283 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b23855-473a-4560-81b6-c25f43a4f09f None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:03.741934 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b23855-473a-4560-81b6-c25f43a4f09f None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:03.741934 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b23855-473a-4560-81b6-c25f43a4f09f None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:03.743659 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 686/1375] 10.222.0.25 () {54 vars in 911 bytes} [Wed Oct 27 01:27:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:27:03.750212 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26f2d8-c7cc-45da-9803-fc9a3d979da7 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:03.750655 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26f2d8-c7cc-45da-9803-fc9a3d979da7 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:03.750752 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26f2d8-c7cc-45da-9803-fc9a3d979da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:03.768572 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-df26f2d8-c7cc-45da-9803-fc9a3d979da7 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:03.769792 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-df26f2d8-c7cc-45da-9803-fc9a3d979da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:03.777376 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 690/1376] 10.222.0.25 () {58 vars in 1008 bytes} [Wed Oct 27 01:27:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:03.929755 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b23855-473a-4560-81b6-c25f43a4f09f None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:03.944552 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b23855-473a-4560-81b6-c25f43a4f09f None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:03.949897 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c9d94-1a64-465f-b4b8-2ee10e12055b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:03.950520 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c9d94-1a64-465f-b4b8-2ee10e12055b service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:03.950821 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c9d94-1a64-465f-b4b8-2ee10e12055b service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:03.951080 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c9d94-1a64-465f-b4b8-2ee10e12055b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:03.959082 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c9d94-1a64-465f-b4b8-2ee10e12055b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:03.960639 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c9d94-1a64-465f-b4b8-2ee10e12055b service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:03.970968 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 687/1377] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:27:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:27:05.363855 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27c603-370c-4a40-bff2-c27591259c59 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:05.364382 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27c603-370c-4a40-bff2-c27591259c59 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:05.364382 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27c603-370c-4a40-bff2-c27591259c59 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:05.366152 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 691/1378] 10.222.0.25 () {54 vars in 911 bytes} [Wed Oct 27 01:27:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:27:05.372116 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a772e9-e46a-4f17-b9f4-90dc30c5529e None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:05.372497 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a772e9-e46a-4f17-b9f4-90dc30c5529e None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:05.372708 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a772e9-e46a-4f17-b9f4-90dc30c5529e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:05.390182 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-99a772e9-e46a-4f17-b9f4-90dc30c5529e None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:05.391404 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-99a772e9-e46a-4f17-b9f4-90dc30c5529e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:05.398989 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 688/1379] 10.222.0.25 () {58 vars in 1008 bytes} [Wed Oct 27 01:27:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:05.550807 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27c603-370c-4a40-bff2-c27591259c59 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:05.564848 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27c603-370c-4a40-bff2-c27591259c59 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:05.570289 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31903899-4865-4224-8131-17982a518d03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:05.570913 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31903899-4865-4224-8131-17982a518d03 service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:05.571196 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31903899-4865-4224-8131-17982a518d03 service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:05.571474 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31903899-4865-4224-8131-17982a518d03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:05.579355 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31903899-4865-4224-8131-17982a518d03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:05.580940 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31903899-4865-4224-8131-17982a518d03 service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:05.590751 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 692/1380] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:27:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:27:07.016234 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686537d-37a3-40f7-9ce1-5503feb654a1 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:07.016736 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686537d-37a3-40f7-9ce1-5503feb654a1 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:07.016839 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686537d-37a3-40f7-9ce1-5503feb654a1 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:07.018647 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 689/1381] 10.222.0.25 () {54 vars in 911 bytes} [Wed Oct 27 01:27:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:27:07.024168 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e7b5c-b18b-4009-a5a5-cf47c7a13421 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:07.024598 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e7b5c-b18b-4009-a5a5-cf47c7a13421 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:07.024725 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e7b5c-b18b-4009-a5a5-cf47c7a13421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:07.041993 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-728e7b5c-b18b-4009-a5a5-cf47c7a13421 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:07.043173 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-728e7b5c-b18b-4009-a5a5-cf47c7a13421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:07.050824 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 693/1382] 10.222.0.25 () {58 vars in 1008 bytes} [Wed Oct 27 01:27:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:07.204519 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686537d-37a3-40f7-9ce1-5503feb654a1 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:07.218609 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686537d-37a3-40f7-9ce1-5503feb654a1 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:07.224038 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027aafe2-6eba-4506-ae4d-79af1006dae0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:07.224717 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027aafe2-6eba-4506-ae4d-79af1006dae0 service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:07.225031 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027aafe2-6eba-4506-ae4d-79af1006dae0 service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:07.225314 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027aafe2-6eba-4506-ae4d-79af1006dae0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:07.233527 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027aafe2-6eba-4506-ae4d-79af1006dae0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:07.235091 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027aafe2-6eba-4506-ae4d-79af1006dae0 service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:07.244465 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 690/1383] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:27:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:27:09.368027 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1d784-30c3-497e-9555-97bfa1b950e9 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:09.368559 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1d784-30c3-497e-9555-97bfa1b950e9 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:09.368559 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1d784-30c3-497e-9555-97bfa1b950e9 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:09.370304 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 694/1384] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:27:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:27:09.376165 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae2107-7679-4680-a3e6-3dc49023b5f7 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:09.376573 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae2107-7679-4680-a3e6-3dc49023b5f7 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:09.376729 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae2107-7679-4680-a3e6-3dc49023b5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:09.395116 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-caae2107-7679-4680-a3e6-3dc49023b5f7 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:09.396295 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-caae2107-7679-4680-a3e6-3dc49023b5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:09.404644 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 691/1385] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:27:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:09.444607 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1d784-30c3-497e-9555-97bfa1b950e9 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:09.454942 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1d784-30c3-497e-9555-97bfa1b950e9 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:09.458442 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7afbd2a-cd71-4969-b58d-31839bda2733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:09.459069 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afbd2a-cd71-4969-b58d-31839bda2733 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:09.459346 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afbd2a-cd71-4969-b58d-31839bda2733 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:09.459618 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afbd2a-cd71-4969-b58d-31839bda2733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:09.468578 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7afbd2a-cd71-4969-b58d-31839bda2733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:09.470021 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7afbd2a-cd71-4969-b58d-31839bda2733 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:09.478852 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 695/1386] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:27:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:27:11.860010 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4bb7a-a1cc-4010-bb56-1b408f6dea5d None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:11.860538 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4bb7a-a1cc-4010-bb56-1b408f6dea5d None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:11.860538 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4bb7a-a1cc-4010-bb56-1b408f6dea5d None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:11.862283 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 692/1387] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:27:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:27:11.868327 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63cda3-f967-4bbf-bdd7-77c05677c13e None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:11.868738 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63cda3-f967-4bbf-bdd7-77c05677c13e None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:11.868894 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63cda3-f967-4bbf-bdd7-77c05677c13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:11.886982 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-fc63cda3-f967-4bbf-bdd7-77c05677c13e None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:11.888158 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-fc63cda3-f967-4bbf-bdd7-77c05677c13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:11.895856 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 696/1388] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:27:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:11.936455 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4bb7a-a1cc-4010-bb56-1b408f6dea5d None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:11.938136 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-b4d4bb7a-a1cc-4010-bb56-1b408f6dea5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:11.950813 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4bb7a-a1cc-4010-bb56-1b408f6dea5d None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:11.954528 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f62701-8e7a-42eb-a657-4c1a1560b690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:11.955164 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f62701-8e7a-42eb-a657-4c1a1560b690 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:11.955448 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f62701-8e7a-42eb-a657-4c1a1560b690 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:11.955726 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f62701-8e7a-42eb-a657-4c1a1560b690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:11.965132 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f62701-8e7a-42eb-a657-4c1a1560b690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:11.966583 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f62701-8e7a-42eb-a657-4c1a1560b690 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:11.975872 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 693/1389] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:27:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:27:14.534693 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed3419-0b60-47d9-9fe2-e5f5d1fa671e None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:14.535291 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed3419-0b60-47d9-9fe2-e5f5d1fa671e None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:14.535291 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed3419-0b60-47d9-9fe2-e5f5d1fa671e None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:14.537100 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 697/1390] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:27:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:27:14.543034 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37faa27-3db5-4ad6-b172-a3db8b23b21c None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:14.543435 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37faa27-3db5-4ad6-b172-a3db8b23b21c None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:14.543597 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37faa27-3db5-4ad6-b172-a3db8b23b21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:14.561635 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-e37faa27-3db5-4ad6-b172-a3db8b23b21c None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:14.562818 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-e37faa27-3db5-4ad6-b172-a3db8b23b21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:14.570433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 694/1391] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:27:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:14.609770 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed3419-0b60-47d9-9fe2-e5f5d1fa671e None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:14.620251 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed3419-0b60-47d9-9fe2-e5f5d1fa671e None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:14.624347 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64e143-9d18-4165-9515-653abfa02d8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:14.624974 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64e143-9d18-4165-9515-653abfa02d8f service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:14.625261 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64e143-9d18-4165-9515-653abfa02d8f service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:14.625582 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64e143-9d18-4165-9515-653abfa02d8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:14.634222 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64e143-9d18-4165-9515-653abfa02d8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:14.635639 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64e143-9d18-4165-9515-653abfa02d8f service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:14.645372 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 698/1392] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:27:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:27:16.986799 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a4efc-83bb-4390-9712-6921219df9d4 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:16.987284 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a4efc-83bb-4390-9712-6921219df9d4 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:16.987398 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a4efc-83bb-4390-9712-6921219df9d4 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:16.989218 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 695/1393] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:27:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:27:16.994993 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b4827-7af6-4a8f-9c94-dabb10aa272a None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:16.995416 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b4827-7af6-4a8f-9c94-dabb10aa272a None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:16.996111 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b4827-7af6-4a8f-9c94-dabb10aa272a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:17.013312 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-c91b4827-7af6-4a8f-9c94-dabb10aa272a None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:17.018402 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-c91b4827-7af6-4a8f-9c94-dabb10aa272a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:17.027083 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 699/1394] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:27:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:17.073098 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a4efc-83bb-4390-9712-6921219df9d4 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:17.084358 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a4efc-83bb-4390-9712-6921219df9d4 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:17.088224 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dec7c6-aece-4ea0-965a-bcb1a9279604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:17.088859 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dec7c6-aece-4ea0-965a-bcb1a9279604 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:17.089144 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dec7c6-aece-4ea0-965a-bcb1a9279604 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:17.089429 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dec7c6-aece-4ea0-965a-bcb1a9279604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:17.098378 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dec7c6-aece-4ea0-965a-bcb1a9279604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:17.099785 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dec7c6-aece-4ea0-965a-bcb1a9279604 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:17.109393 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 696/1395] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:27:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:27:19.453331 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53435dd9-642b-4e71-ad3e-1a90484beddb None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:19.453931 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53435dd9-642b-4e71-ad3e-1a90484beddb None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:19.453931 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53435dd9-642b-4e71-ad3e-1a90484beddb None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:19.455727 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 700/1396] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:27:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:27:19.461803 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efde197-053d-4e35-bc84-d21f13d761d3 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:19.462215 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efde197-053d-4e35-bc84-d21f13d761d3 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:19.462373 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efde197-053d-4e35-bc84-d21f13d761d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:19.480720 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-0efde197-053d-4e35-bc84-d21f13d761d3 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:19.481953 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-0efde197-053d-4e35-bc84-d21f13d761d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:19.490952 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 697/1397] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:27:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:19.530247 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53435dd9-642b-4e71-ad3e-1a90484beddb None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:19.540824 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53435dd9-642b-4e71-ad3e-1a90484beddb None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:19.544415 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27eea2e-a346-4022-b957-5130a9777f0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:19.545048 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27eea2e-a346-4022-b957-5130a9777f0b service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:19.545335 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27eea2e-a346-4022-b957-5130a9777f0b service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:19.545652 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27eea2e-a346-4022-b957-5130a9777f0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:19.554749 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27eea2e-a346-4022-b957-5130a9777f0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:19.556166 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27eea2e-a346-4022-b957-5130a9777f0b service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:19.565676 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 701/1398] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:27:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:27:21.911782 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bbedc-4cfe-4f23-a41d-2d150b242179 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:21.912332 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bbedc-4cfe-4f23-a41d-2d150b242179 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:21.912332 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bbedc-4cfe-4f23-a41d-2d150b242179 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:21.914166 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 698/1399] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:27:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:27:21.920206 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e116701-f9bc-4f31-9c44-e55823294317 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:21.920594 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e116701-f9bc-4f31-9c44-e55823294317 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:21.920768 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e116701-f9bc-4f31-9c44-e55823294317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:21.938286 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-9e116701-f9bc-4f31-9c44-e55823294317 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:21.939457 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-9e116701-f9bc-4f31-9c44-e55823294317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:21.947036 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 702/1400] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:27:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:21.986892 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bbedc-4cfe-4f23-a41d-2d150b242179 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:21.997798 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bbedc-4cfe-4f23-a41d-2d150b242179 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:22.001219 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0e731-df22-4ec4-8903-a229b0ad3eef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:22.001869 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0e731-df22-4ec4-8903-a229b0ad3eef service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:22.002151 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0e731-df22-4ec4-8903-a229b0ad3eef service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:22.002420 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0e731-df22-4ec4-8903-a229b0ad3eef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:22.010873 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0e731-df22-4ec4-8903-a229b0ad3eef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:22.012907 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0e731-df22-4ec4-8903-a229b0ad3eef service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:22.021912 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 699/1401] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:27:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:27:24.304559 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d8be9-bf2b-4aa8-aaef-0fc72ef23a44 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:24.305070 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d8be9-bf2b-4aa8-aaef-0fc72ef23a44 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:24.305070 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d8be9-bf2b-4aa8-aaef-0fc72ef23a44 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:24.307111 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 703/1402] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:27:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:27:24.313475 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c505e-7877-4161-ba73-6ba659384329 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:24.313895 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c505e-7877-4161-ba73-6ba659384329 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:24.314063 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c505e-7877-4161-ba73-6ba659384329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:24.331808 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-3a2c505e-7877-4161-ba73-6ba659384329 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:24.332981 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-3a2c505e-7877-4161-ba73-6ba659384329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:24.340567 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 700/1403] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:27:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:27:24.379171 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d8be9-bf2b-4aa8-aaef-0fc72ef23a44 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:24.390330 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d8be9-bf2b-4aa8-aaef-0fc72ef23a44 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:24.393859 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98ffc4-a652-4179-a999-1dc996307045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:24.394492 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98ffc4-a652-4179-a999-1dc996307045 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:24.394776 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98ffc4-a652-4179-a999-1dc996307045 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:24.395054 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98ffc4-a652-4179-a999-1dc996307045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:24.403754 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98ffc4-a652-4179-a999-1dc996307045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:24.405174 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98ffc4-a652-4179-a999-1dc996307045 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:24.414260 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 704/1404] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:27:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:27:26.835253 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1a088-87d9-4587-8691-0f4e17a76a82 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:26.835859 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1a088-87d9-4587-8691-0f4e17a76a82 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:26.835859 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1a088-87d9-4587-8691-0f4e17a76a82 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:26.837627 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 701/1405] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:27:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:27:26.844154 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72c6d7-ced0-4dc3-b31a-69d756de413c None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:26.844610 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72c6d7-ced0-4dc3-b31a-69d756de413c None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:26.844714 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72c6d7-ced0-4dc3-b31a-69d756de413c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:26.862333 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-9e72c6d7-ced0-4dc3-b31a-69d756de413c None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:26.863526 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-9e72c6d7-ced0-4dc3-b31a-69d756de413c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:26.871332 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 705/1406] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:27:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:26.910691 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1a088-87d9-4587-8691-0f4e17a76a82 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:26.921362 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1a088-87d9-4587-8691-0f4e17a76a82 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:26.925000 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3f75d-b284-4248-bba6-9a139a5134df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:26.925699 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3f75d-b284-4248-bba6-9a139a5134df service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:26.926016 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3f75d-b284-4248-bba6-9a139a5134df service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:26.926293 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3f75d-b284-4248-bba6-9a139a5134df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:26.935603 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3f75d-b284-4248-bba6-9a139a5134df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:26.937106 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3f75d-b284-4248-bba6-9a139a5134df service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:26.946587 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 702/1407] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:27:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:27:29.201627 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25e0a5-585a-46c2-867a-8223fe0f3a6d None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:29.202184 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25e0a5-585a-46c2-867a-8223fe0f3a6d None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:29.202184 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25e0a5-585a-46c2-867a-8223fe0f3a6d None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:29.203947 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 706/1408] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:27:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:27:29.209984 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f13ce6-5c09-408b-a7fe-2a4f4da29f88 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:29.210415 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f13ce6-5c09-408b-a7fe-2a4f4da29f88 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:29.210558 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f13ce6-5c09-408b-a7fe-2a4f4da29f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:29.228356 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-05f13ce6-5c09-408b-a7fe-2a4f4da29f88 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:29.230001 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-05f13ce6-5c09-408b-a7fe-2a4f4da29f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:29.237899 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 703/1409] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:27:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:29.275451 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25e0a5-585a-46c2-867a-8223fe0f3a6d None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:29.285805 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25e0a5-585a-46c2-867a-8223fe0f3a6d None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:29.289253 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6158acc-d127-4950-a028-31ded76a0cca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:29.289904 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6158acc-d127-4950-a028-31ded76a0cca service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:29.290186 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6158acc-d127-4950-a028-31ded76a0cca service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:29.290457 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6158acc-d127-4950-a028-31ded76a0cca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:29.299480 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6158acc-d127-4950-a028-31ded76a0cca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:29.300880 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6158acc-d127-4950-a028-31ded76a0cca service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:29.310703 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 707/1410] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:27:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:27:31.541145 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e1553-e1e4-4a1d-b92b-b239197d4bfe None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:31.541773 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e1553-e1e4-4a1d-b92b-b239197d4bfe None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:31.541773 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e1553-e1e4-4a1d-b92b-b239197d4bfe None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:31.543530 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 704/1411] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:27:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:27:31.549539 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfac999-6826-47c5-b99d-0b5c17da1ea0 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:31.549970 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfac999-6826-47c5-b99d-0b5c17da1ea0 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:31.550192 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfac999-6826-47c5-b99d-0b5c17da1ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:31.569015 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-fcfac999-6826-47c5-b99d-0b5c17da1ea0 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:31.570253 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-fcfac999-6826-47c5-b99d-0b5c17da1ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:31.578494 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 708/1412] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:27:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:31.616434 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e1553-e1e4-4a1d-b92b-b239197d4bfe None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:31.626671 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e1553-e1e4-4a1d-b92b-b239197d4bfe None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:31.630119 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a3a5a-f5e4-45b7-8ae5-e6db920b6b40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:31.630740 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a3a5a-f5e4-45b7-8ae5-e6db920b6b40 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:31.631020 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a3a5a-f5e4-45b7-8ae5-e6db920b6b40 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:31.631293 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a3a5a-f5e4-45b7-8ae5-e6db920b6b40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:31.640377 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a3a5a-f5e4-45b7-8ae5-e6db920b6b40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:31.641814 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a3a5a-f5e4-45b7-8ae5-e6db920b6b40 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:31.650988 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 705/1413] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:27:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:27:48.492708 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454f1d5-c5ec-43f6-ae4e-ad36c6a15391 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:48.493274 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454f1d5-c5ec-43f6-ae4e-ad36c6a15391 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:48.493274 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454f1d5-c5ec-43f6-ae4e-ad36c6a15391 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:48.495098 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 709/1414] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:27:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:27:48.500950 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de981c-6464-4cc2-9064-4e1b17445c51 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:48.501339 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de981c-6464-4cc2-9064-4e1b17445c51 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:48.501561 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de981c-6464-4cc2-9064-4e1b17445c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:48.519415 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-32de981c-6464-4cc2-9064-4e1b17445c51 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:48.520600 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-32de981c-6464-4cc2-9064-4e1b17445c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:48.528817 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 706/1415] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:27:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:48.578594 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf902cc-da56-4ef6-82a9-93704571b33a None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:48.578884 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf902cc-da56-4ef6-82a9-93704571b33a None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:48.579166 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf902cc-da56-4ef6-82a9-93704571b33a None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:48.580909 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 710/1416] 10.222.0.25 () {54 vars in 962 bytes} [Wed Oct 27 01:27:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:27:48.586093 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a745b9-0775-4a02-8a11-cfd23f8052a9 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:48.586386 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a745b9-0775-4a02-8a11-cfd23f8052a9 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:48.586669 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a745b9-0775-4a02-8a11-cfd23f8052a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:48.605094 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-b0a745b9-0775-4a02-8a11-cfd23f8052a9 None None] MFA Rules not processed for user `32003a40693246d08640bc7ec45adfc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:48.606321 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-b0a745b9-0775-4a02-8a11-cfd23f8052a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:48.613801 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 707/1417] 10.222.0.25 () {58 vars in 1059 bytes} [Wed Oct 27 01:27:48 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:48.621925 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf902cc-da56-4ef6-82a9-93704571b33a None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:48.632166 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf902cc-da56-4ef6-82a9-93704571b33a None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:48.636266 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775620b-e5fc-43ca-b827-e3e1ea14d386 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32003a40693246d08640bc7ec45adfc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:48.636887 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775620b-e5fc-43ca-b827-e3e1ea14d386 service glance] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:48.637171 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775620b-e5fc-43ca-b827-e3e1ea14d386 service glance] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:48.637452 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775620b-e5fc-43ca-b827-e3e1ea14d386 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:48.646166 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775620b-e5fc-43ca-b827-e3e1ea14d386 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:48.647563 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775620b-e5fc-43ca-b827-e3e1ea14d386 service glance] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:48.656604 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 711/1418] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:27:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:27:51.147407 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50fb5d-da1e-4c83-a22c-7a776cbfa74d None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:51.147962 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50fb5d-da1e-4c83-a22c-7a776cbfa74d None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:51.147962 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50fb5d-da1e-4c83-a22c-7a776cbfa74d None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:51.149796 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 708/1419] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:27:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:27:51.155631 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e84095-32f4-4611-b142-58360df4b5f2 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:51.156064 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e84095-32f4-4611-b142-58360df4b5f2 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:51.156189 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e84095-32f4-4611-b142-58360df4b5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:51.173508 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-f9e84095-32f4-4611-b142-58360df4b5f2 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:51.174723 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-f9e84095-32f4-4611-b142-58360df4b5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:51.183204 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 712/1420] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:27:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:51.207497 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50fb5d-da1e-4c83-a22c-7a776cbfa74d None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:51.219741 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50fb5d-da1e-4c83-a22c-7a776cbfa74d None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:51.224081 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73535b41-209a-4f74-9ad0-3cc833f82204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:51.224717 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73535b41-209a-4f74-9ad0-3cc833f82204 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:51.224998 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73535b41-209a-4f74-9ad0-3cc833f82204 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:51.225273 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73535b41-209a-4f74-9ad0-3cc833f82204 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:51.226041 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73535b41-209a-4f74-9ad0-3cc833f82204 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:51.227876 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73535b41-209a-4f74-9ad0-3cc833f82204 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:51.241602 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 709/1421] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Oct 27 01:27:51 2021] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:27:53.506372 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62815a8-1d79-49ba-b4d1-eec0946cf789 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:53.506941 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62815a8-1d79-49ba-b4d1-eec0946cf789 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:53.507055 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62815a8-1d79-49ba-b4d1-eec0946cf789 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:53.508777 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 713/1422] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:27:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:27:53.515344 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbba18f-b917-416a-af49-e8e88a69fc0a None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:53.515783 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbba18f-b917-416a-af49-e8e88a69fc0a None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:53.515901 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbba18f-b917-416a-af49-e8e88a69fc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:53.533996 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-0bbba18f-b917-416a-af49-e8e88a69fc0a None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:53.535186 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-0bbba18f-b917-416a-af49-e8e88a69fc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:53.542930 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 710/1423] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:27:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:53.586788 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62815a8-1d79-49ba-b4d1-eec0946cf789 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:53.601422 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62815a8-1d79-49ba-b4d1-eec0946cf789 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:53.606841 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e51892-8ee8-4ed4-91f1-fbefededc4e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:53.607466 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e51892-8ee8-4ed4-91f1-fbefededc4e8 service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:53.607751 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e51892-8ee8-4ed4-91f1-fbefededc4e8 service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:53.608031 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e51892-8ee8-4ed4-91f1-fbefededc4e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:53.615909 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e51892-8ee8-4ed4-91f1-fbefededc4e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:53.617508 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e51892-8ee8-4ed4-91f1-fbefededc4e8 service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:53.626917 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 714/1424] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:27:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:27:56.078179 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f665349-c1d9-488d-a7bb-f2a9f1b3f8ec None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:56.078767 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f665349-c1d9-488d-a7bb-f2a9f1b3f8ec None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:56.078767 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f665349-c1d9-488d-a7bb-f2a9f1b3f8ec None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:56.080557 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 711/1425] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:27:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:27:56.086382 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220a7fd-84bf-48b0-8d9c-cf95453109c3 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:56.086803 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220a7fd-84bf-48b0-8d9c-cf95453109c3 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:56.086947 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220a7fd-84bf-48b0-8d9c-cf95453109c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:56.105414 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-a220a7fd-84bf-48b0-8d9c-cf95453109c3 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:56.106784 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-a220a7fd-84bf-48b0-8d9c-cf95453109c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:56.115673 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 715/1426] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:27:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:56.155036 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f665349-c1d9-488d-a7bb-f2a9f1b3f8ec None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:56.165428 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f665349-c1d9-488d-a7bb-f2a9f1b3f8ec None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:56.168996 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04f686-2fbe-433b-9b39-b91555e46cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:56.169676 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04f686-2fbe-433b-9b39-b91555e46cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:56.169962 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04f686-2fbe-433b-9b39-b91555e46cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:56.170238 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04f686-2fbe-433b-9b39-b91555e46cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:56.179122 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04f686-2fbe-433b-9b39-b91555e46cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:56.180538 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04f686-2fbe-433b-9b39-b91555e46cc2 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:56.190387 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 712/1427] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:27:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:27:58.477721 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8904e2c-02ab-4b1c-bbc9-badc2d04c56d None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:58.478281 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8904e2c-02ab-4b1c-bbc9-badc2d04c56d None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:58.478281 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8904e2c-02ab-4b1c-bbc9-badc2d04c56d None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:58.480661 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 716/1428] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:27:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:27:58.486471 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af8036-f820-41bc-9217-0f4b7d0e8d34 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:58.486906 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af8036-f820-41bc-9217-0f4b7d0e8d34 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:58.487041 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af8036-f820-41bc-9217-0f4b7d0e8d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:58.504255 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-95af8036-f820-41bc-9217-0f4b7d0e8d34 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:58.505422 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-95af8036-f820-41bc-9217-0f4b7d0e8d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:58.512947 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 713/1429] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:27:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:58.552827 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8904e2c-02ab-4b1c-bbc9-badc2d04c56d None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:58.563738 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8904e2c-02ab-4b1c-bbc9-badc2d04c56d None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:58.567231 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9433717-6a45-4166-a774-2fc0c66d17ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:58.567993 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9433717-6a45-4166-a774-2fc0c66d17ea service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:58.568320 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9433717-6a45-4166-a774-2fc0c66d17ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:58.568622 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9433717-6a45-4166-a774-2fc0c66d17ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:58.577238 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9433717-6a45-4166-a774-2fc0c66d17ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:58.578681 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9433717-6a45-4166-a774-2fc0c66d17ea service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:58.587569 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 717/1430] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:27:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:28:00.930990 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e178a5-8ff9-41c4-9097-430c3e1209ed None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:00.931542 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e178a5-8ff9-41c4-9097-430c3e1209ed None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:00.931915 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e178a5-8ff9-41c4-9097-430c3e1209ed None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:00.933651 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 714/1431] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:28:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:28:00.939564 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28053c-db23-408e-ac50-af22a81bc4b8 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:00.939967 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28053c-db23-408e-ac50-af22a81bc4b8 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:00.940130 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28053c-db23-408e-ac50-af22a81bc4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:00.957903 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-ee28053c-db23-408e-ac50-af22a81bc4b8 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:28:00.959127 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-ee28053c-db23-408e-ac50-af22a81bc4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:28:00.967432 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 718/1432] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:28:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:28:01.026230 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e178a5-8ff9-41c4-9097-430c3e1209ed None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:28:01.037324 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e178a5-8ff9-41c4-9097-430c3e1209ed None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:28:01.040870 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311c288-0373-4c9e-8a02-ac22845e8ecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:28:01.041534 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311c288-0373-4c9e-8a02-ac22845e8ecc service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:01.041828 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311c288-0373-4c9e-8a02-ac22845e8ecc service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:01.042106 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311c288-0373-4c9e-8a02-ac22845e8ecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:01.050827 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311c288-0373-4c9e-8a02-ac22845e8ecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:28:01.052227 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311c288-0373-4c9e-8a02-ac22845e8ecc service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:28:01.061582 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 715/1433] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:28:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:28:03.538669 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047316e-5c1e-43c8-a0e8-529c9b46557e None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:03.539209 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047316e-5c1e-43c8-a0e8-529c9b46557e None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:03.539332 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047316e-5c1e-43c8-a0e8-529c9b46557e None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:03.541645 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 719/1434] 10.222.0.25 () {54 vars in 926 bytes} [Wed Oct 27 01:28:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:28:03.547433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9b24b-104a-4457-815e-1864a72fc2f7 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:03.547876 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9b24b-104a-4457-815e-1864a72fc2f7 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:03.547974 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9b24b-104a-4457-815e-1864a72fc2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:03.566218 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-24c9b24b-104a-4457-815e-1864a72fc2f7 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:28:03.567399 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-24c9b24b-104a-4457-815e-1864a72fc2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:28:03.575155 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 716/1435] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Oct 27 01:28:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:28:03.615393 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047316e-5c1e-43c8-a0e8-529c9b46557e None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:28:03.626557 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047316e-5c1e-43c8-a0e8-529c9b46557e None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:28:03.630069 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05249588-3ffd-4331-87f9-73dd24d87d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:28:03.630700 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05249588-3ffd-4331-87f9-73dd24d87d0c service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:03.630983 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05249588-3ffd-4331-87f9-73dd24d87d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:03.631262 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05249588-3ffd-4331-87f9-73dd24d87d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:03.639880 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05249588-3ffd-4331-87f9-73dd24d87d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:28:03.641296 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05249588-3ffd-4331-87f9-73dd24d87d0c service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:28:03.650872 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 720/1436] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:28:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:12.123166 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f18da7-a356-47ec-8067-6bfcb79d632c None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:12.123770 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f18da7-a356-47ec-8067-6bfcb79d632c None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:12.123770 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f18da7-a356-47ec-8067-6bfcb79d632c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:12.142740 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-57f18da7-a356-47ec-8067-6bfcb79d632c None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:12.143923 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-57f18da7-a356-47ec-8067-6bfcb79d632c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:12.152099 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 717/1437] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:29:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:12.160065 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d820c7-790e-4a33-883c-98609bc9bfed None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:12.160541 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d820c7-790e-4a33-883c-98609bc9bfed None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:12.160678 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d820c7-790e-4a33-883c-98609bc9bfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:12.178356 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-36d820c7-790e-4a33-883c-98609bc9bfed None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:12.179665 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-36d820c7-790e-4a33-883c-98609bc9bfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:12.187658 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 721/1438] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:29:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:12.192002 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f18da7-a356-47ec-8067-6bfcb79d632c None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:12.201549 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f18da7-a356-47ec-8067-6bfcb79d632c None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:12.206023 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e5966-a4d2-4b4b-af9f-2c52dd7f9e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:12.206669 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e5966-a4d2-4b4b-af9f-2c52dd7f9e23 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:12.206957 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e5966-a4d2-4b4b-af9f-2c52dd7f9e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:12.207238 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e5966-a4d2-4b4b-af9f-2c52dd7f9e23 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:12.207962 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e5966-a4d2-4b4b-af9f-2c52dd7f9e23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:29:12.208272 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e5966-a4d2-4b4b-af9f-2c52dd7f9e23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:12.209873 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e5966-a4d2-4b4b-af9f-2c52dd7f9e23 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:12.221472 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 718/1439] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:29:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:29:12.229761 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d820c7-790e-4a33-883c-98609bc9bfed None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:12.238637 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d820c7-790e-4a33-883c-98609bc9bfed None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:12.243240 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970d1dc-e9e1-4eae-af15-cd4b19778018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:12.243882 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970d1dc-e9e1-4eae-af15-cd4b19778018 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:12.244166 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970d1dc-e9e1-4eae-af15-cd4b19778018 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:12.244442 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970d1dc-e9e1-4eae-af15-cd4b19778018 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:12.245144 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970d1dc-e9e1-4eae-af15-cd4b19778018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:12.247065 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970d1dc-e9e1-4eae-af15-cd4b19778018 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:12.283787 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 722/1440] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:29:12 2021] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:29:12.287923 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e5966-a4d2-4b4b-af9f-2c52dd7f9e23 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:12.297454 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e5966-a4d2-4b4b-af9f-2c52dd7f9e23 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:12.350762 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958161c-3a0c-4900-9d76-8f1300442506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:12.351446 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958161c-3a0c-4900-9d76-8f1300442506 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:12.351732 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958161c-3a0c-4900-9d76-8f1300442506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:12.352013 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958161c-3a0c-4900-9d76-8f1300442506 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:12.352709 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958161c-3a0c-4900-9d76-8f1300442506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:12.354810 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958161c-3a0c-4900-9d76-8f1300442506 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:12.373778 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 719/1441] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:29:12 2021] POST /identity/v3/users => generated 290 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:29:12.377664 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970d1dc-e9e1-4eae-af15-cd4b19778018 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:12.388163 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970d1dc-e9e1-4eae-af15-cd4b19778018 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:12.392632 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91501925-e3a1-46b3-ad11-7050738f3e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:12.393286 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91501925-e3a1-46b3-ad11-7050738f3e8d admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:12.393597 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91501925-e3a1-46b3-ad11-7050738f3e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:12.393878 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91501925-e3a1-46b3-ad11-7050738f3e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:12.394608 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91501925-e3a1-46b3-ad11-7050738f3e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:12.396174 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91501925-e3a1-46b3-ad11-7050738f3e8d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:12.409605 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 723/1442] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:29:12 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:12.413602 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958161c-3a0c-4900-9d76-8f1300442506 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:12.423281 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958161c-3a0c-4900-9d76-8f1300442506 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:12.428804 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a321f66-10c6-4e1d-8a80-b4415623e25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:12.429471 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a321f66-10c6-4e1d-8a80-b4415623e25f admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:12.429801 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a321f66-10c6-4e1d-8a80-b4415623e25f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:12.430066 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a321f66-10c6-4e1d-8a80-b4415623e25f admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:12.430804 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a321f66-10c6-4e1d-8a80-b4415623e25f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:12.432650 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a321f66-10c6-4e1d-8a80-b4415623e25f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:12.447495 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 720/1443] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:29:12 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:12.451619 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91501925-e3a1-46b3-ad11-7050738f3e8d admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:12.461855 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91501925-e3a1-46b3-ad11-7050738f3e8d admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:12.466363 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91cc9a-ec4c-4672-9083-8d45cd7e3714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:12.467228 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91cc9a-ec4c-4672-9083-8d45cd7e3714 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:12.467510 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91cc9a-ec4c-4672-9083-8d45cd7e3714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:12.467813 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91cc9a-ec4c-4672-9083-8d45cd7e3714 admin admin] PATH_INFO: `/v3/projects/194f150be22b44f3bf60a3fc9dc73ecd/users/f0f367649eff4203b4815c42a4170f2d/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:12.481619 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91cc9a-ec4c-4672-9083-8d45cd7e3714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=194f150be22b44f3bf60a3fc9dc73ecd, user_id=f0f367649eff4203b4815c42a4170f2d, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:12.484187 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91cc9a-ec4c-4672-9083-8d45cd7e3714 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:12.497599 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 724/1444] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:29:12 2021] PUT /identity/v3/projects/194f150be22b44f3bf60a3fc9dc73ecd/users/f0f367649eff4203b4815c42a4170f2d/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:29:12.510287 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73775891-10aa-4c46-902d-ce2700272f93 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:12.510679 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73775891-10aa-4c46-902d-ce2700272f93 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:12.511060 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73775891-10aa-4c46-902d-ce2700272f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:12.537152 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-73775891-10aa-4c46-902d-ce2700272f93 None None] MFA Rules not processed for user `f0f367649eff4203b4815c42a4170f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:12.538399 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-73775891-10aa-4c46-902d-ce2700272f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:12.599671 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 721/1445] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:29:12 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:12.610886 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91cc9a-ec4c-4672-9083-8d45cd7e3714 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:12.676748 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91cc9a-ec4c-4672-9083-8d45cd7e3714 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:12.682979 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9376e8a-2e07-4efd-9666-24167b756af1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:12.683618 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9376e8a-2e07-4efd-9666-24167b756af1 service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:12.683904 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9376e8a-2e07-4efd-9666-24167b756af1 service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:12.684183 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9376e8a-2e07-4efd-9666-24167b756af1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:12.691621 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9376e8a-2e07-4efd-9666-24167b756af1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:12.693190 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9376e8a-2e07-4efd-9666-24167b756af1 service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:12.702185 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 725/1446] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:29:12 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:12.770378 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97fe05-6316-4f33-a9c0-9b8afca18bf4 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:12.770783 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97fe05-6316-4f33-a9c0-9b8afca18bf4 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:12.771240 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97fe05-6316-4f33-a9c0-9b8afca18bf4 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:12.773506 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 722/1447] 10.222.0.25 () {52 vars in 829 bytes} [Wed Oct 27 01:29:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:29:12.777619 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9376e8a-2e07-4efd-9666-24167b756af1 service nova] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:12.837033 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9376e8a-2e07-4efd-9666-24167b756af1 service nova] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:12.841621 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c2615-7387-4b00-882f-d6372ed60dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:12.842476 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c2615-7387-4b00-882f-d6372ed60dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:12.842759 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c2615-7387-4b00-882f-d6372ed60dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:12.843038 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c2615-7387-4b00-882f-d6372ed60dbd admin admin] PATH_INFO: `/v3/users/f0f367649eff4203b4815c42a4170f2d` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:12.844229 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c2615-7387-4b00-882f-d6372ed60dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0f367649eff4203b4815c42a4170f2d)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:12.845236 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING py.warnings [None req-262c2615-7387-4b00-882f-d6372ed60dbd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:29:12.845236 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: warnings.warn(msg) Oct 27 01:29:12.845236 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: Oct 27 01:29:12.846484 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c2615-7387-4b00-882f-d6372ed60dbd admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:12.911601 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-262c2615-7387-4b00-882f-d6372ed60dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0f367649eff4203b4815c42a4170f2d'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:12.922777 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-262c2615-7387-4b00-882f-d6372ed60dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0f367649eff4203b4815c42a4170f2d'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:12.923431 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-262c2615-7387-4b00-882f-d6372ed60dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0f367649eff4203b4815c42a4170f2d'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:12.943020 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-262c2615-7387-4b00-882f-d6372ed60dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0f367649eff4203b4815c42a4170f2d'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:12.953396 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-262c2615-7387-4b00-882f-d6372ed60dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0f367649eff4203b4815c42a4170f2d'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:12.959413 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 726/1448] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:29:12 2021] DELETE /identity/v3/users/f0f367649eff4203b4815c42a4170f2d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:12.964030 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac0d36-4441-495a-846f-80df27d1eed4 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:12.964443 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac0d36-4441-495a-846f-80df27d1eed4 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:12.964945 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac0d36-4441-495a-846f-80df27d1eed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:12.982694 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-94ac0d36-4441-495a-846f-80df27d1eed4 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:12.983942 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-94ac0d36-4441-495a-846f-80df27d1eed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:13.040498 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 723/1449] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:29:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:29:13.050498 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c2615-7387-4b00-882f-d6372ed60dbd admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:13.051916 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-262c2615-7387-4b00-882f-d6372ed60dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:13.106276 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c2615-7387-4b00-882f-d6372ed60dbd admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:13.109879 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df14e7-930f-4ec8-ae4e-8d6a21136a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:13.110522 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df14e7-930f-4ec8-ae4e-8d6a21136a00 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:13.110812 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df14e7-930f-4ec8-ae4e-8d6a21136a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:13.111093 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df14e7-930f-4ec8-ae4e-8d6a21136a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:13.119738 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df14e7-930f-4ec8-ae4e-8d6a21136a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:13.121151 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df14e7-930f-4ec8-ae4e-8d6a21136a00 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:13.130223 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 727/1450] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:29:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:13.463964 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac0d36-4441-495a-846f-80df27d1eed4 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:13.465449 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-94ac0d36-4441-495a-846f-80df27d1eed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:13.477562 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac0d36-4441-495a-846f-80df27d1eed4 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:13.482317 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799b52f-0d58-47ca-a0d7-e7099cf911fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:13.483411 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799b52f-0d58-47ca-a0d7-e7099cf911fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:13.483697 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799b52f-0d58-47ca-a0d7-e7099cf911fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:13.483976 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799b52f-0d58-47ca-a0d7-e7099cf911fb admin admin] PATH_INFO: `/v3/projects/194f150be22b44f3bf60a3fc9dc73ecd` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:13.485280 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799b52f-0d58-47ca-a0d7-e7099cf911fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=194f150be22b44f3bf60a3fc9dc73ecd)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:13.486337 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING py.warnings [None req-8799b52f-0d58-47ca-a0d7-e7099cf911fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:29:13.486337 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: warnings.warn(msg) Oct 27 01:29:13.486337 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: Oct 27 01:29:13.487522 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799b52f-0d58-47ca-a0d7-e7099cf911fb admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:13.545949 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-8799b52f-0d58-47ca-a0d7-e7099cf911fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '194f150be22b44f3bf60a3fc9dc73ecd', 'request_id': 'req-8799b52f-0d58-47ca-a0d7-e7099cf911fb'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:13.551546 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-8799b52f-0d58-47ca-a0d7-e7099cf911fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '194f150be22b44f3bf60a3fc9dc73ecd', 'request_id': 'req-8799b52f-0d58-47ca-a0d7-e7099cf911fb'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:13.561475 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-8799b52f-0d58-47ca-a0d7-e7099cf911fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '194f150be22b44f3bf60a3fc9dc73ecd', 'request_id': 'req-8799b52f-0d58-47ca-a0d7-e7099cf911fb'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:13.579779 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-8799b52f-0d58-47ca-a0d7-e7099cf911fb admin admin] The token cache is being invalidate because project 194f150be22b44f3bf60a3fc9dc73ecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:29:13.580065 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-8799b52f-0d58-47ca-a0d7-e7099cf911fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:13.580702 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-8799b52f-0d58-47ca-a0d7-e7099cf911fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:13.582339 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 724/1451] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:29:13 2021] DELETE /identity/v3/projects/194f150be22b44f3bf60a3fc9dc73ecd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:43.327185 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf662d-e381-47c4-b901-c157edef54c3 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:43.327748 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf662d-e381-47c4-b901-c157edef54c3 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:43.327748 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf662d-e381-47c4-b901-c157edef54c3 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:43.329425 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 728/1452] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 27 01:30:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:30:43.334757 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f05637-e9c3-45d9-9fdb-08f6059802f8 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:43.335711 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f05637-e9c3-45d9-9fdb-08f6059802f8 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:43.335880 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f05637-e9c3-45d9-9fdb-08f6059802f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:43.354385 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-a8f05637-e9c3-45d9-9fdb-08f6059802f8 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:43.355603 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-a8f05637-e9c3-45d9-9fdb-08f6059802f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:43.411370 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 725/1453] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 27 01:30:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:43.567745 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf662d-e381-47c4-b901-c157edef54c3 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:43.570048 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-9fbf662d-e381-47c4-b901-c157edef54c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:43.640798 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf662d-e381-47c4-b901-c157edef54c3 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:43.646216 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea8e72-5607-45ae-9d61-a56a23a882bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:43.646849 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea8e72-5607-45ae-9d61-a56a23a882bf service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:43.647135 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea8e72-5607-45ae-9d61-a56a23a882bf service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:43.647413 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea8e72-5607-45ae-9d61-a56a23a882bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:43.655356 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea8e72-5607-45ae-9d61-a56a23a882bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:43.656941 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea8e72-5607-45ae-9d61-a56a23a882bf service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:43.666798 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 729/1454] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:30:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:30:44.519459 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234beaf-d387-4a8e-b167-687771320d1c None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:44.520037 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234beaf-d387-4a8e-b167-687771320d1c None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:44.520037 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234beaf-d387-4a8e-b167-687771320d1c None None] PATH_INFO: `/v3` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:44.521309 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 726/1455] 10.222.0.15 () {54 vars in 925 bytes} [Wed Oct 27 01:30:44 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:30:44.530578 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7c56e-fcc3-48a8-bb9b-2f37e4db6b93 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:44.530984 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7c56e-fcc3-48a8-bb9b-2f37e4db6b93 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:44.531283 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7c56e-fcc3-48a8-bb9b-2f37e4db6b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:44.550118 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-1da7c56e-fcc3-48a8-bb9b-2f37e4db6b93 None None] MFA Rules not processed for user `2ff82e315d8c42e49556ab67fbf53b32`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:44.551317 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-1da7c56e-fcc3-48a8-bb9b-2f37e4db6b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:44.612148 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 730/1456] 10.222.0.15 () {58 vars in 1015 bytes} [Wed Oct 27 01:30:44 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:45.102621 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42223cde-f2b0-46e2-a166-5c1eea2966c1 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:45.102909 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42223cde-f2b0-46e2-a166-5c1eea2966c1 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:45.103188 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42223cde-f2b0-46e2-a166-5c1eea2966c1 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:45.104996 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 727/1457] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 27 01:30:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:30:45.110422 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79111f5f-1334-46a0-8d82-fe0712b64c47 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:45.110715 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79111f5f-1334-46a0-8d82-fe0712b64c47 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:45.110994 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79111f5f-1334-46a0-8d82-fe0712b64c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:45.128444 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-79111f5f-1334-46a0-8d82-fe0712b64c47 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:45.129670 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-79111f5f-1334-46a0-8d82-fe0712b64c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:45.137703 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 731/1458] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 27 01:30:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:45.292066 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42223cde-f2b0-46e2-a166-5c1eea2966c1 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:45.305895 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42223cde-f2b0-46e2-a166-5c1eea2966c1 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:45.311445 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff566b58-f1aa-4b56-be4d-5dd58f29747c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:45.312072 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff566b58-f1aa-4b56-be4d-5dd58f29747c service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:45.312352 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff566b58-f1aa-4b56-be4d-5dd58f29747c service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:45.312628 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff566b58-f1aa-4b56-be4d-5dd58f29747c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:45.320885 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff566b58-f1aa-4b56-be4d-5dd58f29747c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:45.322494 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff566b58-f1aa-4b56-be4d-5dd58f29747c service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:45.331444 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 728/1459] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:30:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:30:48.621469 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ee709-de98-4f32-a5ec-a0a5915cead2 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:48.621918 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ee709-de98-4f32-a5ec-a0a5915cead2 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:48.622059 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ee709-de98-4f32-a5ec-a0a5915cead2 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:48.623857 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 732/1460] 10.222.0.25 () {54 vars in 960 bytes} [Wed Oct 27 01:30:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:30:48.629385 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d33d1-b4c0-414e-9999-383d1cc9af64 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:48.629851 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d33d1-b4c0-414e-9999-383d1cc9af64 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:48.630003 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d33d1-b4c0-414e-9999-383d1cc9af64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:48.648281 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-ee9d33d1-b4c0-414e-9999-383d1cc9af64 None None] MFA Rules not processed for user `2ff82e315d8c42e49556ab67fbf53b32`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:48.649516 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-ee9d33d1-b4c0-414e-9999-383d1cc9af64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:48.657808 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 729/1461] 10.222.0.25 () {58 vars in 1057 bytes} [Wed Oct 27 01:30:48 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:48.665513 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ee709-de98-4f32-a5ec-a0a5915cead2 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:48.679095 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ee709-de98-4f32-a5ec-a0a5915cead2 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:48.684393 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1aaecf-ae8f-4002-abd9-1ae40cbfd4c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff82e315d8c42e49556ab67fbf53b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:48.685027 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1aaecf-ae8f-4002-abd9-1ae40cbfd4c3 service placement] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:48.685316 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1aaecf-ae8f-4002-abd9-1ae40cbfd4c3 service placement] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:48.685634 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1aaecf-ae8f-4002-abd9-1ae40cbfd4c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:48.694868 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1aaecf-ae8f-4002-abd9-1ae40cbfd4c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:48.696527 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1aaecf-ae8f-4002-abd9-1ae40cbfd4c3 service placement] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:48.705918 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 733/1462] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:30:48 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:30:57.198197 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2d039-24fb-40dc-a93d-3a65265b4a4c None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:57.198761 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2d039-24fb-40dc-a93d-3a65265b4a4c None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:57.198761 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2d039-24fb-40dc-a93d-3a65265b4a4c None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:57.200501 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 730/1463] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 27 01:30:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:30:57.205860 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e805d-ad3c-4b80-b834-870aa73228cc None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:57.206292 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e805d-ad3c-4b80-b834-870aa73228cc None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:57.206428 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e805d-ad3c-4b80-b834-870aa73228cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:57.224342 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-e29e805d-ad3c-4b80-b834-870aa73228cc None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:57.226042 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-e29e805d-ad3c-4b80-b834-870aa73228cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:57.233937 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 734/1464] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 27 01:30:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:57.386471 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2d039-24fb-40dc-a93d-3a65265b4a4c None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:57.400696 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2d039-24fb-40dc-a93d-3a65265b4a4c None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:57.406140 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ee0d4-318a-4946-8914-8e09d128272c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:57.406773 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ee0d4-318a-4946-8914-8e09d128272c service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:57.407063 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ee0d4-318a-4946-8914-8e09d128272c service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:57.407344 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ee0d4-318a-4946-8914-8e09d128272c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:57.416014 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ee0d4-318a-4946-8914-8e09d128272c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:57.417681 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ee0d4-318a-4946-8914-8e09d128272c service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:57.426920 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 731/1465] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:30:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:30:58.844800 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ceca2-49f9-497e-a637-6c16a92ab2d1 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:58.845396 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ceca2-49f9-497e-a637-6c16a92ab2d1 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:58.845396 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ceca2-49f9-497e-a637-6c16a92ab2d1 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:58.847187 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 735/1466] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 27 01:30:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:30:58.852894 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d021e-1cd2-4332-b810-473e7f390d99 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:58.853340 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d021e-1cd2-4332-b810-473e7f390d99 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:58.853448 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d021e-1cd2-4332-b810-473e7f390d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:58.873289 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-e36d021e-1cd2-4332-b810-473e7f390d99 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:58.874520 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-e36d021e-1cd2-4332-b810-473e7f390d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:58.882269 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 732/1467] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 27 01:30:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:59.035777 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ceca2-49f9-497e-a637-6c16a92ab2d1 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:59.050469 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ceca2-49f9-497e-a637-6c16a92ab2d1 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:59.056727 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62226e02-adf7-4788-b507-8e2d6cc5266b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:59.057357 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62226e02-adf7-4788-b507-8e2d6cc5266b service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:59.057677 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62226e02-adf7-4788-b507-8e2d6cc5266b service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:59.057961 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62226e02-adf7-4788-b507-8e2d6cc5266b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:59.065824 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62226e02-adf7-4788-b507-8e2d6cc5266b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:59.067414 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62226e02-adf7-4788-b507-8e2d6cc5266b service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:59.076505 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 736/1468] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:30:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:31:03.175084 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1645b41-09cc-4107-9baa-4b3731ca8650 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:03.175703 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1645b41-09cc-4107-9baa-4b3731ca8650 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:03.175703 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1645b41-09cc-4107-9baa-4b3731ca8650 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:03.177539 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 733/1469] 127.0.0.1 () {54 vars in 916 bytes} [Wed Oct 27 01:31:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:31:03.184376 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faee761-24ca-416f-9780-a39af8023673 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:03.184943 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faee761-24ca-416f-9780-a39af8023673 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:03.184943 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faee761-24ca-416f-9780-a39af8023673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:03.204300 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-9faee761-24ca-416f-9780-a39af8023673 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:31:03.205571 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-9faee761-24ca-416f-9780-a39af8023673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:31:03.214289 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 737/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Oct 27 01:31:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:31:03.252802 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1645b41-09cc-4107-9baa-4b3731ca8650 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:31:03.254572 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-b1645b41-09cc-4107-9baa-4b3731ca8650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:31:03.310423 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1645b41-09cc-4107-9baa-4b3731ca8650 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:31:03.313993 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b2ae6-6f10-4df7-9ba8-3fe1ff3e99dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:31:03.314631 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b2ae6-6f10-4df7-9ba8-3fe1ff3e99dd service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:03.314918 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b2ae6-6f10-4df7-9ba8-3fe1ff3e99dd service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:03.315232 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b2ae6-6f10-4df7-9ba8-3fe1ff3e99dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:03.324466 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b2ae6-6f10-4df7-9ba8-3fe1ff3e99dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:31:03.325931 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b2ae6-6f10-4df7-9ba8-3fe1ff3e99dd service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:31:03.335720 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 734/1471] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:31:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:31:05.567697 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e564a3-1199-4440-b942-171b65c3b2eb None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:05.568262 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e564a3-1199-4440-b942-171b65c3b2eb None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:05.568262 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e564a3-1199-4440-b942-171b65c3b2eb None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:05.570111 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 738/1472] 127.0.0.1 () {54 vars in 916 bytes} [Wed Oct 27 01:31:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:31:05.575759 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334dbe54-530e-42cb-a8b5-04efd8f43fd9 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:05.576214 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334dbe54-530e-42cb-a8b5-04efd8f43fd9 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:05.576319 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334dbe54-530e-42cb-a8b5-04efd8f43fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:05.593987 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-334dbe54-530e-42cb-a8b5-04efd8f43fd9 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:31:05.595172 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-334dbe54-530e-42cb-a8b5-04efd8f43fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:31:05.603340 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 735/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Oct 27 01:31:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:31:05.640133 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e564a3-1199-4440-b942-171b65c3b2eb None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:31:05.650636 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e564a3-1199-4440-b942-171b65c3b2eb None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:31:05.654243 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42862a81-3c1e-45ea-af10-6ff5a49ed3c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:31:05.654867 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42862a81-3c1e-45ea-af10-6ff5a49ed3c5 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:05.655155 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42862a81-3c1e-45ea-af10-6ff5a49ed3c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:05.655433 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42862a81-3c1e-45ea-af10-6ff5a49ed3c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:05.664544 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42862a81-3c1e-45ea-af10-6ff5a49ed3c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:31:05.666011 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42862a81-3c1e-45ea-af10-6ff5a49ed3c5 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:31:05.675504 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 739/1474] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:31:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:31:09.347742 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc7d01-31dc-4634-9fb2-71f068360a76 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:09.348298 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc7d01-31dc-4634-9fb2-71f068360a76 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:09.348298 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc7d01-31dc-4634-9fb2-71f068360a76 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:09.350627 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 736/1475] 127.0.0.1 () {54 vars in 916 bytes} [Wed Oct 27 01:31:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:31:09.356278 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59251ca-7e97-419f-9591-366c784980ca None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:09.356687 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59251ca-7e97-419f-9591-366c784980ca None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:09.356837 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59251ca-7e97-419f-9591-366c784980ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:09.375184 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-b59251ca-7e97-419f-9591-366c784980ca None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:31:09.376369 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-b59251ca-7e97-419f-9591-366c784980ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:31:09.384757 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 740/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Oct 27 01:31:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:31:09.436343 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc7d01-31dc-4634-9fb2-71f068360a76 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:31:09.438030 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-1bdc7d01-31dc-4634-9fb2-71f068360a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:31:09.492707 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc7d01-31dc-4634-9fb2-71f068360a76 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:31:09.496204 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebfb34-6c69-44fe-bc24-d78c6dd01a97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:31:09.496840 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebfb34-6c69-44fe-bc24-d78c6dd01a97 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:09.497125 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebfb34-6c69-44fe-bc24-d78c6dd01a97 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:09.497403 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebfb34-6c69-44fe-bc24-d78c6dd01a97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:09.505958 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebfb34-6c69-44fe-bc24-d78c6dd01a97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:31:09.507360 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebfb34-6c69-44fe-bc24-d78c6dd01a97 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:31:09.516328 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 737/1477] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:31:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:31:11.768174 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44d233-2713-4277-857a-5a64d73b6e46 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:11.768736 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44d233-2713-4277-857a-5a64d73b6e46 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:11.768736 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44d233-2713-4277-857a-5a64d73b6e46 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:11.770861 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 741/1478] 127.0.0.1 () {54 vars in 916 bytes} [Wed Oct 27 01:31:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:31:11.777936 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277e01e-3295-44d7-8156-3d446a9c2522 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:11.778443 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277e01e-3295-44d7-8156-3d446a9c2522 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:11.778616 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277e01e-3295-44d7-8156-3d446a9c2522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:11.796663 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-6277e01e-3295-44d7-8156-3d446a9c2522 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:31:11.797889 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-6277e01e-3295-44d7-8156-3d446a9c2522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:31:11.806743 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 738/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Oct 27 01:31:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:31:11.858222 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb923e5-b341-4162-8b4f-c6b02752133a None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:11.858509 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb923e5-b341-4162-8b4f-c6b02752133a None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:11.858787 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb923e5-b341-4162-8b4f-c6b02752133a None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:11.860618 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 742/1480] 10.222.0.25 () {54 vars in 962 bytes} [Wed Oct 27 01:31:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:31:11.865895 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc362d4a-a307-4bd8-b82a-35484608572b None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:11.866189 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc362d4a-a307-4bd8-b82a-35484608572b None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:11.866474 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc362d4a-a307-4bd8-b82a-35484608572b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:11.884207 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-fc362d4a-a307-4bd8-b82a-35484608572b None None] MFA Rules not processed for user `1819142aab4743fbb9e056ba61e3d474`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:31:11.885387 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-fc362d4a-a307-4bd8-b82a-35484608572b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:31:11.891839 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 739/1481] 10.222.0.25 () {58 vars in 1059 bytes} [Wed Oct 27 01:31:11 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:31:11.899939 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb923e5-b341-4162-8b4f-c6b02752133a None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:31:11.910070 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb923e5-b341-4162-8b4f-c6b02752133a None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:31:11.914248 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a044e0-f952-47db-9b68-e5099e8d19fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:31:11.914857 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a044e0-f952-47db-9b68-e5099e8d19fb service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:11.915137 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a044e0-f952-47db-9b68-e5099e8d19fb service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:11.915412 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a044e0-f952-47db-9b68-e5099e8d19fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:11.923967 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a044e0-f952-47db-9b68-e5099e8d19fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:31:11.925297 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a044e0-f952-47db-9b68-e5099e8d19fb service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:31:11.934526 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 743/1482] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:31:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:32:33.625459 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1067e-6e46-4020-a371-ec3c7876119d None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:33.626076 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1067e-6e46-4020-a371-ec3c7876119d None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:33.626076 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1067e-6e46-4020-a371-ec3c7876119d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:33.648656 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-9bd1067e-6e46-4020-a371-ec3c7876119d None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:33.649988 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-9bd1067e-6e46-4020-a371-ec3c7876119d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:33.663015 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 740/1483] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:33.672125 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122ef92-b6c6-4892-ad2a-93886f279fa9 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:33.673083 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122ef92-b6c6-4892-ad2a-93886f279fa9 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:33.677782 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122ef92-b6c6-4892-ad2a-93886f279fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:33.701894 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-3122ef92-b6c6-4892-ad2a-93886f279fa9 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:33.703465 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3122ef92-b6c6-4892-ad2a-93886f279fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:33.717513 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 744/1484] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:33.722065 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1067e-6e46-4020-a371-ec3c7876119d None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:33.738781 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1067e-6e46-4020-a371-ec3c7876119d None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:33.749499 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbce72f-331b-48c3-a1ca-0c33451b2639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:33.750178 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbce72f-331b-48c3-a1ca-0c33451b2639 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:33.750478 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbce72f-331b-48c3-a1ca-0c33451b2639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:33.750758 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbce72f-331b-48c3-a1ca-0c33451b2639 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:33.751500 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbce72f-331b-48c3-a1ca-0c33451b2639 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:32:33.751817 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbce72f-331b-48c3-a1ca-0c33451b2639 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:33.753425 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbce72f-331b-48c3-a1ca-0c33451b2639 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:33.775047 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 741/1485] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:32:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:32:33.782881 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122ef92-b6c6-4892-ad2a-93886f279fa9 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:33.792715 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122ef92-b6c6-4892-ad2a-93886f279fa9 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:33.805396 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0a369-0b10-4c75-8581-4610238f0c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:33.806345 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0a369-0b10-4c75-8581-4610238f0c1e admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:33.806638 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0a369-0b10-4c75-8581-4610238f0c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:33.806918 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0a369-0b10-4c75-8581-4610238f0c1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:33.807634 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0a369-0b10-4c75-8581-4610238f0c1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:33.809563 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0a369-0b10-4c75-8581-4610238f0c1e admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:33.864059 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 745/1486] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:32:33 2021] POST /identity/v3/projects => generated 391 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:33.868752 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbce72f-331b-48c3-a1ca-0c33451b2639 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:33.883371 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbce72f-331b-48c3-a1ca-0c33451b2639 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:33.957660 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81e014-f818-44df-bd68-8d46f1371922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:33.958980 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81e014-f818-44df-bd68-8d46f1371922 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:33.959491 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81e014-f818-44df-bd68-8d46f1371922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:33.960117 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81e014-f818-44df-bd68-8d46f1371922 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:33.961068 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81e014-f818-44df-bd68-8d46f1371922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:33.963730 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81e014-f818-44df-bd68-8d46f1371922 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:34.001974 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 742/1487] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:32:33 2021] POST /identity/v3/users => generated 296 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:34.006979 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0a369-0b10-4c75-8581-4610238f0c1e admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:34.021106 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0a369-0b10-4c75-8581-4610238f0c1e admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:34.032165 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9de12-9fd3-4ede-bfb8-02f06dc21505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:34.033281 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9de12-9fd3-4ede-bfb8-02f06dc21505 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.033818 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9de12-9fd3-4ede-bfb8-02f06dc21505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.034343 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9de12-9fd3-4ede-bfb8-02f06dc21505 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.038376 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9de12-9fd3-4ede-bfb8-02f06dc21505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:34.040375 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9de12-9fd3-4ede-bfb8-02f06dc21505 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:34.052701 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 746/1488] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:34 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:34.057748 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74800472-aaab-4b3b-ae51-728b20fb22b6 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.057748 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74800472-aaab-4b3b-ae51-728b20fb22b6 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.057748 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74800472-aaab-4b3b-ae51-728b20fb22b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.059116 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9de12-9fd3-4ede-bfb8-02f06dc21505 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:34.069886 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9de12-9fd3-4ede-bfb8-02f06dc21505 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:34.082851 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-74800472-aaab-4b3b-ae51-728b20fb22b6 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:34.084221 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-74800472-aaab-4b3b-ae51-728b20fb22b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:34.086519 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b888437-e014-4f28-ab31-9a401aa31cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:34.087453 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b888437-e014-4f28-ab31-9a401aa31cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.087973 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b888437-e014-4f28-ab31-9a401aa31cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.088473 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b888437-e014-4f28-ab31-9a401aa31cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.089449 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b888437-e014-4f28-ab31-9a401aa31cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:34.091290 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b888437-e014-4f28-ab31-9a401aa31cd8 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:34.096134 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 743/1489] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:34.103317 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 747/1490] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:34 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:34.106733 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13becf0-190f-47cf-bd1e-79fee8ee7e0e None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.106733 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13becf0-190f-47cf-bd1e-79fee8ee7e0e None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.106733 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13becf0-190f-47cf-bd1e-79fee8ee7e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.108027 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b888437-e014-4f28-ab31-9a401aa31cd8 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:34.118352 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b888437-e014-4f28-ab31-9a401aa31cd8 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:34.131939 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b931389-847b-4ece-8b04-d28f7ddf6e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:34.133216 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b931389-847b-4ece-8b04-d28f7ddf6e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.133822 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b931389-847b-4ece-8b04-d28f7ddf6e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.134345 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b931389-847b-4ece-8b04-d28f7ddf6e42 admin admin] PATH_INFO: `/v3/projects/1b65ee42f08f4ae3adb171819a394295/users/714ca1b794144b1eabeed1ebdaa27669/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.142508 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-b13becf0-190f-47cf-bd1e-79fee8ee7e0e None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:34.149509 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-b13becf0-190f-47cf-bd1e-79fee8ee7e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:34.156815 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b931389-847b-4ece-8b04-d28f7ddf6e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b65ee42f08f4ae3adb171819a394295, user_id=714ca1b794144b1eabeed1ebdaa27669, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:34.163853 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b931389-847b-4ece-8b04-d28f7ddf6e42 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:34.170179 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 744/1491] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:34.176493 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13becf0-190f-47cf-bd1e-79fee8ee7e0e None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:34.191050 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13becf0-190f-47cf-bd1e-79fee8ee7e0e None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:34.199080 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 748/1492] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:32:34 2021] PUT /identity/v3/projects/1b65ee42f08f4ae3adb171819a394295/users/714ca1b794144b1eabeed1ebdaa27669/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:34.204674 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e1b52-4b32-49c3-92fc-1cdf6a687dcf None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.205278 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e1b52-4b32-49c3-92fc-1cdf6a687dcf None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.205819 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e1b52-4b32-49c3-92fc-1cdf6a687dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.231363 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-724e1b52-4b32-49c3-92fc-1cdf6a687dcf None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:34.233074 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-724e1b52-4b32-49c3-92fc-1cdf6a687dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:34.295417 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc247a2-76fa-405b-b9e9-3d80776c14eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:34.296103 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc247a2-76fa-405b-b9e9-3d80776c14eb admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.296390 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc247a2-76fa-405b-b9e9-3d80776c14eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.296666 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc247a2-76fa-405b-b9e9-3d80776c14eb admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.297408 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc247a2-76fa-405b-b9e9-3d80776c14eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:32:34.297747 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc247a2-76fa-405b-b9e9-3d80776c14eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:34.299356 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc247a2-76fa-405b-b9e9-3d80776c14eb admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:34.321921 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 745/1493] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:32:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:32:34.333636 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc247a2-76fa-405b-b9e9-3d80776c14eb admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:34.340468 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 749/1494] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:32:34.342369 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeceef10-220c-4b22-8673-40937c567694 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.342885 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeceef10-220c-4b22-8673-40937c567694 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.343410 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeceef10-220c-4b22-8673-40937c567694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.391133 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc247a2-76fa-405b-b9e9-3d80776c14eb admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:34.410992 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d132564-39ff-4042-b272-e7a863180487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:34.411660 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d132564-39ff-4042-b272-e7a863180487 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.411946 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d132564-39ff-4042-b272-e7a863180487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.412221 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d132564-39ff-4042-b272-e7a863180487 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.414368 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d132564-39ff-4042-b272-e7a863180487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:34.416126 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d132564-39ff-4042-b272-e7a863180487 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:34.439711 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-aeceef10-220c-4b22-8673-40937c567694 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:34.441433 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-aeceef10-220c-4b22-8673-40937c567694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:34.457339 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 750/1495] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:34.459104 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935d7f3-dfef-456e-922a-7be8bfcdd178 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.459629 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935d7f3-dfef-456e-922a-7be8bfcdd178 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.460188 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935d7f3-dfef-456e-922a-7be8bfcdd178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.496652 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 746/1496] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:32:34 2021] POST /identity/v3/projects => generated 371 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:34.498124 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d132564-39ff-4042-b272-e7a863180487 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:34.501320 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-d935d7f3-dfef-456e-922a-7be8bfcdd178 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:34.502817 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-d935d7f3-dfef-456e-922a-7be8bfcdd178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:34.555195 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d132564-39ff-4042-b272-e7a863180487 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:34.565294 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc2602-945b-44c8-890f-a943aaed441f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:34.566089 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc2602-945b-44c8-890f-a943aaed441f service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.566445 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc2602-945b-44c8-890f-a943aaed441f service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.566718 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc2602-945b-44c8-890f-a943aaed441f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.569524 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 751/1497] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:34.570639 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb288a-1f5f-4c94-b6d1-888d87e71cb8 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.571061 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb288a-1f5f-4c94-b6d1-888d87e71cb8 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.571343 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb288a-1f5f-4c94-b6d1-888d87e71cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.580780 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc2602-945b-44c8-890f-a943aaed441f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:34.582803 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc2602-945b-44c8-890f-a943aaed441f service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:34.589926 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-8ecb288a-1f5f-4c94-b6d1-888d87e71cb8 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:34.591117 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-8ecb288a-1f5f-4c94-b6d1-888d87e71cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:34.592093 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 747/1498] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:34.593441 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0247a49-23ed-41f5-bfbf-88fef3ddf2e6 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.593660 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0247a49-23ed-41f5-bfbf-88fef3ddf2e6 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.593954 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0247a49-23ed-41f5-bfbf-88fef3ddf2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.601118 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 752/1499] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:34.606133 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752d6f8-ff53-4951-8416-80348a6603e3 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.607112 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752d6f8-ff53-4951-8416-80348a6603e3 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.607112 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752d6f8-ff53-4951-8416-80348a6603e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.613893 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-b0247a49-23ed-41f5-bfbf-88fef3ddf2e6 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:34.615219 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-b0247a49-23ed-41f5-bfbf-88fef3ddf2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:34.623698 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 748/1500] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:34.626579 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0247a49-23ed-41f5-bfbf-88fef3ddf2e6 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:34.627343 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-8752d6f8-ff53-4951-8416-80348a6603e3 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:34.628234 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-8752d6f8-ff53-4951-8416-80348a6603e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:34.637179 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 753/1501] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:34.638519 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731507f3-ebaf-4fa8-a845-e2a057fa2c36 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.639004 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731507f3-ebaf-4fa8-a845-e2a057fa2c36 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.639141 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731507f3-ebaf-4fa8-a845-e2a057fa2c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.644995 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0247a49-23ed-41f5-bfbf-88fef3ddf2e6 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:34.649827 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b356d7c-3b56-4ddc-bbaf-0dada1e70a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:34.650688 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b356d7c-3b56-4ddc-bbaf-0dada1e70a95 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.650968 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b356d7c-3b56-4ddc-bbaf-0dada1e70a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.651246 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b356d7c-3b56-4ddc-bbaf-0dada1e70a95 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.652003 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b356d7c-3b56-4ddc-bbaf-0dada1e70a95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:34.653941 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b356d7c-3b56-4ddc-bbaf-0dada1e70a95 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:34.663797 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-731507f3-ebaf-4fa8-a845-e2a057fa2c36 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:34.665688 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-731507f3-ebaf-4fa8-a845-e2a057fa2c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:34.675990 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 754/1502] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:34.677838 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 749/1503] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:32:34 2021] POST /identity/v3/users => generated 286 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:34.678561 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab929035-b28a-4649-8c17-ad02eb5c10c8 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.679017 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab929035-b28a-4649-8c17-ad02eb5c10c8 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.679133 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4385fdb-f413-49b0-994f-c2a391028d93 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.679391 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4385fdb-f413-49b0-994f-c2a391028d93 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.679668 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4385fdb-f413-49b0-994f-c2a391028d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.679832 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab929035-b28a-4649-8c17-ad02eb5c10c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.699433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-a4385fdb-f413-49b0-994f-c2a391028d93 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:34.700656 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-a4385fdb-f413-49b0-994f-c2a391028d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:34.701045 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-ab929035-b28a-4649-8c17-ad02eb5c10c8 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:34.702691 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-ab929035-b28a-4649-8c17-ad02eb5c10c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:34.709842 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 750/1504] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:34.710630 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4385fdb-f413-49b0-994f-c2a391028d93 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:34.716393 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 755/1505] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:34.718000 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b73785-8429-4b1e-b363-2cc6a9ff85fd None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.718337 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b73785-8429-4b1e-b363-2cc6a9ff85fd None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.718625 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b73785-8429-4b1e-b363-2cc6a9ff85fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.727399 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4385fdb-f413-49b0-994f-c2a391028d93 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:34.732489 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ea144-8310-4c4c-9425-d330482464cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:34.733311 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ea144-8310-4c4c-9425-d330482464cf admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.733719 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ea144-8310-4c4c-9425-d330482464cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.734093 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ea144-8310-4c4c-9425-d330482464cf admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.734937 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ea144-8310-4c4c-9425-d330482464cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:32:34.735333 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ea144-8310-4c4c-9425-d330482464cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:34.737072 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ea144-8310-4c4c-9425-d330482464cf admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:34.740692 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-48b73785-8429-4b1e-b363-2cc6a9ff85fd None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:34.741961 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-48b73785-8429-4b1e-b363-2cc6a9ff85fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:34.751004 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 751/1506] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:32:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:32:34.752077 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 756/1507] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:34.752794 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b73785-8429-4b1e-b363-2cc6a9ff85fd None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:34.754864 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb27ee-e992-4df0-8512-dbe84b150f10 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.755452 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb27ee-e992-4df0-8512-dbe84b150f10 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.756011 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb27ee-e992-4df0-8512-dbe84b150f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.763136 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b73785-8429-4b1e-b363-2cc6a9ff85fd None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:34.768631 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dbdb0-c27d-49cf-aacf-52ef5d2191d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:34.770017 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dbdb0-c27d-49cf-aacf-52ef5d2191d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.770696 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dbdb0-c27d-49cf-aacf-52ef5d2191d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.770696 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dbdb0-c27d-49cf-aacf-52ef5d2191d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.771323 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357dbdb0-c27d-49cf-aacf-52ef5d2191d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:34.773407 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357dbdb0-c27d-49cf-aacf-52ef5d2191d8 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:34.776231 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-ddfb27ee-e992-4df0-8512-dbe84b150f10 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:34.777807 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-ddfb27ee-e992-4df0-8512-dbe84b150f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:34.794423 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 757/1508] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:34 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:34.794537 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 752/1509] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:34.794624 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a8cae-9caf-48f2-bcd8-4f256b1151e8 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.794624 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a8cae-9caf-48f2-bcd8-4f256b1151e8 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.794789 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb27ee-e992-4df0-8512-dbe84b150f10 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:34.794876 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a8cae-9caf-48f2-bcd8-4f256b1151e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.804844 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb27ee-e992-4df0-8512-dbe84b150f10 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:34.811727 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9c713-a1be-46c5-8b26-c3c0c32d35ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:34.812552 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9c713-a1be-46c5-8b26-c3c0c32d35ed admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.812785 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9c713-a1be-46c5-8b26-c3c0c32d35ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.813072 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9c713-a1be-46c5-8b26-c3c0c32d35ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.813861 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9c713-a1be-46c5-8b26-c3c0c32d35ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:32:34.814169 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9c713-a1be-46c5-8b26-c3c0c32d35ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:34.815758 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9c713-a1be-46c5-8b26-c3c0c32d35ed admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:34.818741 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-963a8cae-9caf-48f2-bcd8-4f256b1151e8 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:34.819936 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-963a8cae-9caf-48f2-bcd8-4f256b1151e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:34.828677 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 758/1510] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:34.829852 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0568512-f682-400a-b49c-e8febcb8b09f None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.830140 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0568512-f682-400a-b49c-e8febcb8b09f None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.830420 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0568512-f682-400a-b49c-e8febcb8b09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.831552 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 753/1511] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:32:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:32:34.832979 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9c713-a1be-46c5-8b26-c3c0c32d35ed admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:34.843216 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9c713-a1be-46c5-8b26-c3c0c32d35ed admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:34.848407 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6ea0b-2f0e-4773-bb5f-006394365e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:34.849062 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6ea0b-2f0e-4773-bb5f-006394365e3b admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.849342 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6ea0b-2f0e-4773-bb5f-006394365e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.849648 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6ea0b-2f0e-4773-bb5f-006394365e3b admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.850520 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6ea0b-2f0e-4773-bb5f-006394365e3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:32:34.851233 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6ea0b-2f0e-4773-bb5f-006394365e3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:34.851747 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-f0568512-f682-400a-b49c-e8febcb8b09f None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:34.852400 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6ea0b-2f0e-4773-bb5f-006394365e3b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:34.853113 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-f0568512-f682-400a-b49c-e8febcb8b09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:34.861652 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 759/1512] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:34.862511 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0568512-f682-400a-b49c-e8febcb8b09f None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:34.875038 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 754/1513] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:32:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:32:34.875038 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6ea0b-2f0e-4773-bb5f-006394365e3b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:34.879108 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6ea0b-2f0e-4773-bb5f-006394365e3b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:34.879625 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0568512-f682-400a-b49c-e8febcb8b09f None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:34.884528 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e5022-2a31-4cd9-b768-61f2a827f1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:34.884670 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09b304-8fa2-42f4-93f3-3dd1b5ca7371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:34.885321 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e5022-2a31-4cd9-b768-61f2a827f1fd admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.885451 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09b304-8fa2-42f4-93f3-3dd1b5ca7371 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.885715 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e5022-2a31-4cd9-b768-61f2a827f1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.885810 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09b304-8fa2-42f4-93f3-3dd1b5ca7371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.886033 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09b304-8fa2-42f4-93f3-3dd1b5ca7371 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.886139 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e5022-2a31-4cd9-b768-61f2a827f1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.886861 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e5022-2a31-4cd9-b768-61f2a827f1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:34.887062 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09b304-8fa2-42f4-93f3-3dd1b5ca7371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:34.888825 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e5022-2a31-4cd9-b768-61f2a827f1fd admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:34.888964 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09b304-8fa2-42f4-93f3-3dd1b5ca7371 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:34.902465 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 755/1514] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:34 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:34.902465 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e5022-2a31-4cd9-b768-61f2a827f1fd admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:34.909508 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e5022-2a31-4cd9-b768-61f2a827f1fd admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:34.915080 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35f8cb-d090-4d20-8016-81c253b465e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:34.915839 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35f8cb-d090-4d20-8016-81c253b465e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:34.916149 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35f8cb-d090-4d20-8016-81c253b465e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:34.916483 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35f8cb-d090-4d20-8016-81c253b465e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:34.917267 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35f8cb-d090-4d20-8016-81c253b465e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:32:34.917669 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35f8cb-d090-4d20-8016-81c253b465e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:34.919290 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35f8cb-d090-4d20-8016-81c253b465e8 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:34.920512 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 760/1515] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:32:34 2021] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:34.922354 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09b304-8fa2-42f4-93f3-3dd1b5ca7371 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:34.938385 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 756/1516] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:32:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:32:34.939576 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35f8cb-d090-4d20-8016-81c253b465e8 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:34.959607 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35f8cb-d090-4d20-8016-81c253b465e8 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:35.025459 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e04cf-23f8-464a-8b27-10d1aba7b665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:35.026163 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e04cf-23f8-464a-8b27-10d1aba7b665 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:35.026451 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e04cf-23f8-464a-8b27-10d1aba7b665 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:35.026730 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e04cf-23f8-464a-8b27-10d1aba7b665 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:35.027468 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e04cf-23f8-464a-8b27-10d1aba7b665 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:32:35.027777 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e04cf-23f8-464a-8b27-10d1aba7b665 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:35.029559 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e04cf-23f8-464a-8b27-10d1aba7b665 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:35.036518 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09b304-8fa2-42f4-93f3-3dd1b5ca7371 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:35.044797 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4b387-ffe5-4f7d-8af0-4d730b5b5267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:35.045463 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4b387-ffe5-4f7d-8af0-4d730b5b5267 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:35.045624 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 757/1517] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:32:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:32:35.046429 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e04cf-23f8-464a-8b27-10d1aba7b665 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:35.049864 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4b387-ffe5-4f7d-8af0-4d730b5b5267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:35.050122 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4b387-ffe5-4f7d-8af0-4d730b5b5267 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:35.051461 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4b387-ffe5-4f7d-8af0-4d730b5b5267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:35.054345 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4b387-ffe5-4f7d-8af0-4d730b5b5267 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:35.060962 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e04cf-23f8-464a-8b27-10d1aba7b665 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:35.067363 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e7115-c8f4-4cd8-bc0f-239b4d4f832c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:35.068149 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e7115-c8f4-4cd8-bc0f-239b4d4f832c admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:35.068501 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e7115-c8f4-4cd8-bc0f-239b4d4f832c admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:35.068982 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e7115-c8f4-4cd8-bc0f-239b4d4f832c admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:35.069844 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e7115-c8f4-4cd8-bc0f-239b4d4f832c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:32:35.070224 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e7115-c8f4-4cd8-bc0f-239b4d4f832c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:35.071816 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e7115-c8f4-4cd8-bc0f-239b4d4f832c admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:35.086894 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 758/1518] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:32:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:32:35.087785 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e7115-c8f4-4cd8-bc0f-239b4d4f832c admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:35.088728 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 761/1519] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:32:34 2021] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:35.089705 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4b387-ffe5-4f7d-8af0-4d730b5b5267 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:35.104632 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e7115-c8f4-4cd8-bc0f-239b4d4f832c admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:35.159635 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4b387-ffe5-4f7d-8af0-4d730b5b5267 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:35.164837 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24cfb76-c8fb-4296-9f8f-4b0ea5c9f1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:35.165826 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eced95-486b-4755-a835-1f84981efa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:35.165979 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cfb76-c8fb-4296-9f8f-4b0ea5c9f1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:35.166243 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cfb76-c8fb-4296-9f8f-4b0ea5c9f1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:35.166488 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eced95-486b-4755-a835-1f84981efa7a admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:35.166660 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cfb76-c8fb-4296-9f8f-4b0ea5c9f1a9 admin admin] PATH_INFO: `/v3/projects/0f2da116edc141a8bf54baa587618a81/users/d75a476cf37e40f68d94eb7083bd7a27/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:35.166760 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eced95-486b-4755-a835-1f84981efa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:35.167048 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eced95-486b-4755-a835-1f84981efa7a admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:35.167758 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eced95-486b-4755-a835-1f84981efa7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:35.169788 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eced95-486b-4755-a835-1f84981efa7a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:35.183165 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24cfb76-c8fb-4296-9f8f-4b0ea5c9f1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f2da116edc141a8bf54baa587618a81, user_id=d75a476cf37e40f68d94eb7083bd7a27, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:35.186000 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24cfb76-c8fb-4296-9f8f-4b0ea5c9f1a9 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:35.199298 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 759/1520] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:32:35 2021] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:35.200512 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eced95-486b-4755-a835-1f84981efa7a admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:35.202215 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 762/1521] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:32:35 2021] PUT /identity/v3/projects/0f2da116edc141a8bf54baa587618a81/users/d75a476cf37e40f68d94eb7083bd7a27/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:35.210587 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24cfb76-c8fb-4296-9f8f-4b0ea5c9f1a9 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:35.268598 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eced95-486b-4755-a835-1f84981efa7a admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:35.273643 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a5b0f-9172-4cd0-8da6-9e68915bc74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:35.275549 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a5b0f-9172-4cd0-8da6-9e68915bc74b admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:35.275549 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a5b0f-9172-4cd0-8da6-9e68915bc74b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:35.275773 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a5b0f-9172-4cd0-8da6-9e68915bc74b admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:35.277262 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a5b0f-9172-4cd0-8da6-9e68915bc74b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:35.279650 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a5b0f-9172-4cd0-8da6-9e68915bc74b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:35.283464 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24cfb76-c8fb-4296-9f8f-4b0ea5c9f1a9 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:35.291457 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13788a-1a20-4d64-9314-1ae1fadbcacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:35.292207 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13788a-1a20-4d64-9314-1ae1fadbcacd admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:35.292734 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13788a-1a20-4d64-9314-1ae1fadbcacd admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:35.294242 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13788a-1a20-4d64-9314-1ae1fadbcacd admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:35.296248 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13788a-1a20-4d64-9314-1ae1fadbcacd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:35.299496 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13788a-1a20-4d64-9314-1ae1fadbcacd admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:35.305808 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 760/1522] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:32:35 2021] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:35.307091 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a5b0f-9172-4cd0-8da6-9e68915bc74b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:35.323500 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a5b0f-9172-4cd0-8da6-9e68915bc74b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:35.328792 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad73dd6-3e91-45f3-9119-25e2e0baf712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:35.329746 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad73dd6-3e91-45f3-9119-25e2e0baf712 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:35.330052 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad73dd6-3e91-45f3-9119-25e2e0baf712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:35.330334 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad73dd6-3e91-45f3-9119-25e2e0baf712 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:35.331081 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad73dd6-3e91-45f3-9119-25e2e0baf712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:35.333071 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad73dd6-3e91-45f3-9119-25e2e0baf712 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:35.343122 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 763/1523] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:32:35 2021] POST /identity/v3/projects => generated 363 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:35.344162 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13788a-1a20-4d64-9314-1ae1fadbcacd admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:35.365668 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 761/1524] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:32:35 2021] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:35.366505 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad73dd6-3e91-45f3-9119-25e2e0baf712 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:35.420514 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13788a-1a20-4d64-9314-1ae1fadbcacd admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:35.457177 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad73dd6-3e91-45f3-9119-25e2e0baf712 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:35.463973 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ca26f-8e22-4c8d-8e61-9f70f52ef053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:35.465638 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ca26f-8e22-4c8d-8e61-9f70f52ef053 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:35.466156 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ca26f-8e22-4c8d-8e61-9f70f52ef053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:35.466690 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ca26f-8e22-4c8d-8e61-9f70f52ef053 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:35.467607 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ca26f-8e22-4c8d-8e61-9f70f52ef053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:35.470155 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ca26f-8e22-4c8d-8e61-9f70f52ef053 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:35.497397 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5449c-2ee3-4212-961f-72fdab9c3613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:35.498216 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5449c-2ee3-4212-961f-72fdab9c3613 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:35.498610 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5449c-2ee3-4212-961f-72fdab9c3613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:35.498956 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5449c-2ee3-4212-961f-72fdab9c3613 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:35.499735 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5449c-2ee3-4212-961f-72fdab9c3613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:35.501822 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5449c-2ee3-4212-961f-72fdab9c3613 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:35.505863 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 762/1525] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:32:35 2021] POST /identity/v3/projects => generated 389 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:35.506807 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ca26f-8e22-4c8d-8e61-9f70f52ef053 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:35.527098 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 764/1526] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:32:35 2021] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:35.528784 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82ca05-7060-41e2-b5f2-8e2b08cddea2 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:35.529195 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82ca05-7060-41e2-b5f2-8e2b08cddea2 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:35.529582 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82ca05-7060-41e2-b5f2-8e2b08cddea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:35.568224 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-2e82ca05-7060-41e2-b5f2-8e2b08cddea2 None None] MFA Rules not processed for user `d75a476cf37e40f68d94eb7083bd7a27`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:35.569998 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-2e82ca05-7060-41e2-b5f2-8e2b08cddea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:35.584415 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ca26f-8e22-4c8d-8e61-9f70f52ef053 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:35.596686 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16232d74-3b69-4c0e-bd96-d80aaef0b9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:35.597916 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16232d74-3b69-4c0e-bd96-d80aaef0b9b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:35.599565 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16232d74-3b69-4c0e-bd96-d80aaef0b9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:35.599859 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16232d74-3b69-4c0e-bd96-d80aaef0b9b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:35.600582 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16232d74-3b69-4c0e-bd96-d80aaef0b9b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:35.602553 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16232d74-3b69-4c0e-bd96-d80aaef0b9b7 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:35.632465 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 763/1527] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:32:35 2021] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:35.632465 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16232d74-3b69-4c0e-bd96-d80aaef0b9b7 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:35.642551 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16232d74-3b69-4c0e-bd96-d80aaef0b9b7 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:35.647360 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97463e59-98d4-42c6-a548-4f7e40da32f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:35.648019 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97463e59-98d4-42c6-a548-4f7e40da32f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:35.648309 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97463e59-98d4-42c6-a548-4f7e40da32f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:35.648591 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97463e59-98d4-42c6-a548-4f7e40da32f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:35.649462 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97463e59-98d4-42c6-a548-4f7e40da32f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:35.651311 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97463e59-98d4-42c6-a548-4f7e40da32f1 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:35.655853 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 765/1528] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:35 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:35.659474 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82ca05-7060-41e2-b5f2-8e2b08cddea2 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:35.662736 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 764/1529] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:35 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:35.663448 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97463e59-98d4-42c6-a548-4f7e40da32f1 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:35.670319 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82ca05-7060-41e2-b5f2-8e2b08cddea2 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:35.672899 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97463e59-98d4-42c6-a548-4f7e40da32f1 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:35.675047 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705e8b4-4b82-4251-9b84-437ba9e554ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:35.676522 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705e8b4-4b82-4251-9b84-437ba9e554ac admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:35.677121 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705e8b4-4b82-4251-9b84-437ba9e554ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:35.677121 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705e8b4-4b82-4251-9b84-437ba9e554ac admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:35.677954 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705e8b4-4b82-4251-9b84-437ba9e554ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:35.679437 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f1f13-023f-4f9c-b9c1-99ba86e51b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:35.680715 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f1f13-023f-4f9c-b9c1-99ba86e51b99 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:35.681288 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705e8b4-4b82-4251-9b84-437ba9e554ac admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:35.681622 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f1f13-023f-4f9c-b9c1-99ba86e51b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:35.682131 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f1f13-023f-4f9c-b9c1-99ba86e51b99 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:35.682842 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f1f13-023f-4f9c-b9c1-99ba86e51b99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:35.684763 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f1f13-023f-4f9c-b9c1-99ba86e51b99 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:35.708081 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 766/1530] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:32:35 2021] POST /identity/v3/users => generated 282 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:35.709215 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705e8b4-4b82-4251-9b84-437ba9e554ac admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:35.709435 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 765/1531] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:32:35 2021] POST /identity/v3/users => generated 289 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:35.710670 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f1f13-023f-4f9c-b9c1-99ba86e51b99 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:35.721105 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f1f13-023f-4f9c-b9c1-99ba86e51b99 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:35.726112 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705e8b4-4b82-4251-9b84-437ba9e554ac admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:35.726424 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb170e-170b-421a-ad4c-c8ce6d3082a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:35.727091 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb170e-170b-421a-ad4c-c8ce6d3082a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:35.727444 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb170e-170b-421a-ad4c-c8ce6d3082a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:35.727665 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb170e-170b-421a-ad4c-c8ce6d3082a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:35.728548 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb170e-170b-421a-ad4c-c8ce6d3082a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:35.730286 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb170e-170b-421a-ad4c-c8ce6d3082a9 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:35.732482 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede86b6-677e-4a34-8750-9148874b9990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:35.732814 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede86b6-677e-4a34-8750-9148874b9990 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:35.733000 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede86b6-677e-4a34-8750-9148874b9990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:35.733396 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede86b6-677e-4a34-8750-9148874b9990 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:35.734213 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede86b6-677e-4a34-8750-9148874b9990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:35.736112 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede86b6-677e-4a34-8750-9148874b9990 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:35.742134 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 766/1532] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:35 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:35.743223 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb170e-170b-421a-ad4c-c8ce6d3082a9 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:35.755891 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb170e-170b-421a-ad4c-c8ce6d3082a9 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:35.760778 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 767/1533] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:32:35 2021] POST /identity/v3/users => generated 295 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:35.761832 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede86b6-677e-4a34-8750-9148874b9990 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:35.761946 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec14b7-e50f-4123-86e8-a6fdf6f6747e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:35.762578 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec14b7-e50f-4123-86e8-a6fdf6f6747e admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:35.762869 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec14b7-e50f-4123-86e8-a6fdf6f6747e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:35.763156 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec14b7-e50f-4123-86e8-a6fdf6f6747e admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:35.763889 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec14b7-e50f-4123-86e8-a6fdf6f6747e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:35.765472 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec14b7-e50f-4123-86e8-a6fdf6f6747e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:35.771711 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede86b6-677e-4a34-8750-9148874b9990 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:35.776711 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414aadec-e582-4c07-8745-c3bd4a2cc085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:35.777360 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414aadec-e582-4c07-8745-c3bd4a2cc085 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:35.777792 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414aadec-e582-4c07-8745-c3bd4a2cc085 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:35.777946 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414aadec-e582-4c07-8745-c3bd4a2cc085 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:35.778316 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 767/1534] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:35 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:35.778767 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414aadec-e582-4c07-8745-c3bd4a2cc085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:35.779513 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec14b7-e50f-4123-86e8-a6fdf6f6747e admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:35.780736 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414aadec-e582-4c07-8745-c3bd4a2cc085 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:35.790668 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec14b7-e50f-4123-86e8-a6fdf6f6747e admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:35.795985 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc573d-9375-4776-addb-cb18e671395f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:35.796991 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc573d-9375-4776-addb-cb18e671395f admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:35.797176 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc573d-9375-4776-addb-cb18e671395f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:35.797531 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc573d-9375-4776-addb-cb18e671395f admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:35.798723 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc573d-9375-4776-addb-cb18e671395f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:35.800463 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc573d-9375-4776-addb-cb18e671395f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:35.811534 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 768/1535] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:32:35 2021] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:35.812216 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414aadec-e582-4c07-8745-c3bd4a2cc085 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:35.815641 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 768/1536] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:35 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:35.815641 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc573d-9375-4776-addb-cb18e671395f admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:35.823885 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc573d-9375-4776-addb-cb18e671395f admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:35.881279 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee459b-80d8-4108-9eca-bc05b614a30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:35.882217 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee459b-80d8-4108-9eca-bc05b614a30f admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:35.882508 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee459b-80d8-4108-9eca-bc05b614a30f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:35.882781 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee459b-80d8-4108-9eca-bc05b614a30f admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:35.883384 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414aadec-e582-4c07-8745-c3bd4a2cc085 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:35.883497 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee459b-80d8-4108-9eca-bc05b614a30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:35.885115 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee459b-80d8-4108-9eca-bc05b614a30f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:35.888399 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d757f45-43b1-4ec6-a93c-2f80a53ba376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:35.889059 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d757f45-43b1-4ec6-a93c-2f80a53ba376 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:35.889344 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d757f45-43b1-4ec6-a93c-2f80a53ba376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:35.889654 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d757f45-43b1-4ec6-a93c-2f80a53ba376 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:35.890391 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d757f45-43b1-4ec6-a93c-2f80a53ba376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:35.891960 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d757f45-43b1-4ec6-a93c-2f80a53ba376 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:35.895459 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 769/1537] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:35 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:35.899846 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee459b-80d8-4108-9eca-bc05b614a30f admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:35.906366 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 769/1538] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:35 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:35.906366 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d757f45-43b1-4ec6-a93c-2f80a53ba376 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:35.912897 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee459b-80d8-4108-9eca-bc05b614a30f admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:35.917232 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d757f45-43b1-4ec6-a93c-2f80a53ba376 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:35.917542 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a7a5b-59f6-432d-9fd4-9235597cbead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:35.918200 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a7a5b-59f6-432d-9fd4-9235597cbead admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:35.918480 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a7a5b-59f6-432d-9fd4-9235597cbead admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:35.918757 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a7a5b-59f6-432d-9fd4-9235597cbead admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:35.919488 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a7a5b-59f6-432d-9fd4-9235597cbead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:35.921186 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a7a5b-59f6-432d-9fd4-9235597cbead admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:35.922243 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c82c9a-bc83-4929-b816-7e4b5db7d885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:35.922891 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c82c9a-bc83-4929-b816-7e4b5db7d885 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:35.923246 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c82c9a-bc83-4929-b816-7e4b5db7d885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:35.923465 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c82c9a-bc83-4929-b816-7e4b5db7d885 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:35.924190 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c82c9a-bc83-4929-b816-7e4b5db7d885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:35.925857 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c82c9a-bc83-4929-b816-7e4b5db7d885 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:35.931726 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 770/1539] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:35 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:35.932379 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a7a5b-59f6-432d-9fd4-9235597cbead admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:35.938095 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 770/1540] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:35 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:35.939026 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c82c9a-bc83-4929-b816-7e4b5db7d885 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:35.946344 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a7a5b-59f6-432d-9fd4-9235597cbead admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:35.948917 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c82c9a-bc83-4929-b816-7e4b5db7d885 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:35.951137 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7226b-4bf7-48f1-ae9e-7b6c63874152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:35.951803 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7226b-4bf7-48f1-ae9e-7b6c63874152 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:35.952089 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7226b-4bf7-48f1-ae9e-7b6c63874152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:35.952507 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7226b-4bf7-48f1-ae9e-7b6c63874152 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:35.953192 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7226b-4bf7-48f1-ae9e-7b6c63874152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:35.954796 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7226b-4bf7-48f1-ae9e-7b6c63874152 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:35.958729 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4ceeb-8136-45c3-a6c1-2fe4b89ee92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:35.959534 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4ceeb-8136-45c3-a6c1-2fe4b89ee92b admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:35.960363 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4ceeb-8136-45c3-a6c1-2fe4b89ee92b admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:35.960824 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4ceeb-8136-45c3-a6c1-2fe4b89ee92b admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:35.961655 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4ceeb-8136-45c3-a6c1-2fe4b89ee92b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:35.963605 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4ceeb-8136-45c3-a6c1-2fe4b89ee92b admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:35.966794 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 771/1541] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:35 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:35.967769 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7226b-4bf7-48f1-ae9e-7b6c63874152 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:35.979227 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7226b-4bf7-48f1-ae9e-7b6c63874152 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:35.985303 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea590c24-de30-45b8-8d63-65af660008a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:35.986355 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea590c24-de30-45b8-8d63-65af660008a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:35.987012 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea590c24-de30-45b8-8d63-65af660008a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:35.987304 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea590c24-de30-45b8-8d63-65af660008a8 admin admin] PATH_INFO: `/v3/projects/27ddd2330923484e889e923d2ff11996/users/13f08832b1cd4593850cdfe209f6c5a1/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:35.990599 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 771/1542] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:32:35 2021] POST /identity/v3/users => generated 292 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:35.991760 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4ceeb-8136-45c3-a6c1-2fe4b89ee92b admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:36.002225 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4ceeb-8136-45c3-a6c1-2fe4b89ee92b admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:36.003880 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea590c24-de30-45b8-8d63-65af660008a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27ddd2330923484e889e923d2ff11996, user_id=13f08832b1cd4593850cdfe209f6c5a1, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:36.006664 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea590c24-de30-45b8-8d63-65af660008a8 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:36.007008 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2493b0-7311-4f31-9638-fb4f49bbb75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:36.007672 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2493b0-7311-4f31-9638-fb4f49bbb75d admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:36.007951 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2493b0-7311-4f31-9638-fb4f49bbb75d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:36.008235 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2493b0-7311-4f31-9638-fb4f49bbb75d admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:36.009092 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2493b0-7311-4f31-9638-fb4f49bbb75d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:36.010716 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2493b0-7311-4f31-9638-fb4f49bbb75d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:36.020535 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 772/1543] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:32:35 2021] PUT /identity/v3/projects/27ddd2330923484e889e923d2ff11996/users/13f08832b1cd4593850cdfe209f6c5a1/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:36.021428 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea590c24-de30-45b8-8d63-65af660008a8 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:36.025642 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 772/1544] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:35 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:36.026475 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2493b0-7311-4f31-9638-fb4f49bbb75d admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:36.039333 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2493b0-7311-4f31-9638-fb4f49bbb75d admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:36.088881 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea590c24-de30-45b8-8d63-65af660008a8 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:36.093813 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad4f98-8cd9-4f2a-a548-d83b58bb862b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:36.094498 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad4f98-8cd9-4f2a-a548-d83b58bb862b admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:36.094785 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad4f98-8cd9-4f2a-a548-d83b58bb862b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:36.095064 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad4f98-8cd9-4f2a-a548-d83b58bb862b admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:36.095815 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad4f98-8cd9-4f2a-a548-d83b58bb862b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:36.097473 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad4f98-8cd9-4f2a-a548-d83b58bb862b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:36.098934 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02784f-e7ac-4dca-86dd-23dca9a580e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:36.099838 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02784f-e7ac-4dca-86dd-23dca9a580e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:36.100474 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02784f-e7ac-4dca-86dd-23dca9a580e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:36.100474 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02784f-e7ac-4dca-86dd-23dca9a580e0 admin admin] PATH_INFO: `/v3/projects/64c187e6131a49d8ba364f8c55c65fe5/users/d52f4b62fb284efdbe679cfc7e3c3ebc/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:36.108800 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 773/1545] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:36 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:36.109690 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad4f98-8cd9-4f2a-a548-d83b58bb862b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:36.119754 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad4f98-8cd9-4f2a-a548-d83b58bb862b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:36.120281 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02784f-e7ac-4dca-86dd-23dca9a580e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64c187e6131a49d8ba364f8c55c65fe5, user_id=d52f4b62fb284efdbe679cfc7e3c3ebc, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:36.123133 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02784f-e7ac-4dca-86dd-23dca9a580e0 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:36.124627 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acfed1-a381-4872-aba5-d8ed2a58d890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:36.125525 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acfed1-a381-4872-aba5-d8ed2a58d890 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:36.125707 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acfed1-a381-4872-aba5-d8ed2a58d890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:36.125941 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acfed1-a381-4872-aba5-d8ed2a58d890 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:36.126845 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1acfed1-a381-4872-aba5-d8ed2a58d890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:36.128492 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1acfed1-a381-4872-aba5-d8ed2a58d890 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:36.138080 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 773/1546] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:32:36 2021] PUT /identity/v3/projects/64c187e6131a49d8ba364f8c55c65fe5/users/d52f4b62fb284efdbe679cfc7e3c3ebc/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:36.139212 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02784f-e7ac-4dca-86dd-23dca9a580e0 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:36.141126 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 774/1547] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:36 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:36.142389 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acfed1-a381-4872-aba5-d8ed2a58d890 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:36.156508 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acfed1-a381-4872-aba5-d8ed2a58d890 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:36.220544 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64672f5-27a7-402f-b03e-fb1092047f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:36.221217 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64672f5-27a7-402f-b03e-fb1092047f8e admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:36.221525 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64672f5-27a7-402f-b03e-fb1092047f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:36.221841 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64672f5-27a7-402f-b03e-fb1092047f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:36.223290 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64672f5-27a7-402f-b03e-fb1092047f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:36.223621 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02784f-e7ac-4dca-86dd-23dca9a580e0 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:36.224825 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64672f5-27a7-402f-b03e-fb1092047f8e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:36.230346 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9767b23-a26f-453e-86b4-7d3eafdda638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:36.231827 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9767b23-a26f-453e-86b4-7d3eafdda638 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:36.232274 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9767b23-a26f-453e-86b4-7d3eafdda638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:36.232394 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9767b23-a26f-453e-86b4-7d3eafdda638 admin admin] PATH_INFO: `/v3/projects/d0adcfae956746948ce8bf01fa185a4a/users/e7bdbbbf823e44c5ada267e4fa89284f/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:36.235171 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 775/1548] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:36 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:36.236059 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64672f5-27a7-402f-b03e-fb1092047f8e admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:36.247866 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64672f5-27a7-402f-b03e-fb1092047f8e admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:36.251410 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9767b23-a26f-453e-86b4-7d3eafdda638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0adcfae956746948ce8bf01fa185a4a, user_id=e7bdbbbf823e44c5ada267e4fa89284f, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:36.252898 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea571c1-a229-4556-ab5e-6c7cbd9275ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:36.253929 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea571c1-a229-4556-ab5e-6c7cbd9275ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:36.254255 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea571c1-a229-4556-ab5e-6c7cbd9275ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:36.254387 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9767b23-a26f-453e-86b4-7d3eafdda638 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:36.254638 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea571c1-a229-4556-ab5e-6c7cbd9275ab admin admin] PATH_INFO: `/v3/projects/d9eced377e3f4f85826c191384777532/users/ec1f566372814a95890d41b260573dc9/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:36.269584 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 774/1549] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:32:36 2021] PUT /identity/v3/projects/d0adcfae956746948ce8bf01fa185a4a/users/e7bdbbbf823e44c5ada267e4fa89284f/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:36.271021 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab40086-3505-4201-bb79-5ab804266a79 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:36.271383 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab40086-3505-4201-bb79-5ab804266a79 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:36.271736 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab40086-3505-4201-bb79-5ab804266a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:36.276927 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea571c1-a229-4556-ab5e-6c7cbd9275ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9eced377e3f4f85826c191384777532, user_id=ec1f566372814a95890d41b260573dc9, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:36.279731 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea571c1-a229-4556-ab5e-6c7cbd9275ab admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:36.302021 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 776/1550] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:32:36 2021] PUT /identity/v3/projects/d9eced377e3f4f85826c191384777532/users/ec1f566372814a95890d41b260573dc9/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:36.302021 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea571c1-a229-4556-ab5e-6c7cbd9275ab admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:36.304195 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-5ab40086-3505-4201-bb79-5ab804266a79 None None] MFA Rules not processed for user `13f08832b1cd4593850cdfe209f6c5a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:36.305472 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-5ab40086-3505-4201-bb79-5ab804266a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:36.373068 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea571c1-a229-4556-ab5e-6c7cbd9275ab admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:36.377414 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 775/1551] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:36 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:36.378332 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98705792-23b1-4d7b-8a65-092fce57a87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:36.378831 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c43396-7738-487d-8065-75517ee1c938 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:36.379204 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c43396-7738-487d-8065-75517ee1c938 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:36.379476 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98705792-23b1-4d7b-8a65-092fce57a87a admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:36.379623 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c43396-7738-487d-8065-75517ee1c938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:36.380069 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98705792-23b1-4d7b-8a65-092fce57a87a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:36.380418 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98705792-23b1-4d7b-8a65-092fce57a87a admin admin] PATH_INFO: `/v3/projects/cbf6e37df5cf44f59505c54cf84517cb/users/6483aca4f25c4651add6ab3ba28504a9/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:36.406149 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98705792-23b1-4d7b-8a65-092fce57a87a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf6e37df5cf44f59505c54cf84517cb, user_id=6483aca4f25c4651add6ab3ba28504a9, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:36.408849 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98705792-23b1-4d7b-8a65-092fce57a87a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:36.409009 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-c6c43396-7738-487d-8065-75517ee1c938 None None] MFA Rules not processed for user `d52f4b62fb284efdbe679cfc7e3c3ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:36.410837 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-c6c43396-7738-487d-8065-75517ee1c938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:36.424923 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 777/1552] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:32:36 2021] PUT /identity/v3/projects/cbf6e37df5cf44f59505c54cf84517cb/users/6483aca4f25c4651add6ab3ba28504a9/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:36.426576 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98705792-23b1-4d7b-8a65-092fce57a87a admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:36.495716 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 776/1553] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:36 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:36.496665 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98705792-23b1-4d7b-8a65-092fce57a87a admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:36.496954 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c43396-7738-487d-8065-75517ee1c938 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:36.504171 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4226a-5335-4e34-9bf8-b6b57a70845f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:36.505074 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4226a-5335-4e34-9bf8-b6b57a70845f admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:36.505666 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4226a-5335-4e34-9bf8-b6b57a70845f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:36.505666 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4226a-5335-4e34-9bf8-b6b57a70845f admin admin] PATH_INFO: `/v3/projects/52db6551fde546ca893bf07830528d4d/users/b164b9dd32884e99b0b22eb7c50bdda2/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:36.511475 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c43396-7738-487d-8065-75517ee1c938 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:36.516650 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b08642-cd93-4127-adff-b7d6829f6d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:36.517701 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b08642-cd93-4127-adff-b7d6829f6d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:36.518096 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b08642-cd93-4127-adff-b7d6829f6d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:36.518476 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b08642-cd93-4127-adff-b7d6829f6d44 admin admin] PATH_INFO: `/v3/projects/0d657713cf1e4cb1a2f28b2b83cccb37/users/92d831b9b1bb45c5ad5298620958af04/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:36.522115 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4226a-5335-4e34-9bf8-b6b57a70845f admin admin] RBAC: Authorizing `identity:create_grant(project_id=52db6551fde546ca893bf07830528d4d, user_id=b164b9dd32884e99b0b22eb7c50bdda2, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:36.524824 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4226a-5335-4e34-9bf8-b6b57a70845f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:36.535280 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b08642-cd93-4127-adff-b7d6829f6d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d657713cf1e4cb1a2f28b2b83cccb37, user_id=92d831b9b1bb45c5ad5298620958af04, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:36.537973 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b08642-cd93-4127-adff-b7d6829f6d44 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:36.538601 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 778/1554] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:32:36 2021] PUT /identity/v3/projects/52db6551fde546ca893bf07830528d4d/users/b164b9dd32884e99b0b22eb7c50bdda2/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:36.539926 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c3ee9-df20-4485-9d24-eb0cc0f832b8 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:36.540283 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c3ee9-df20-4485-9d24-eb0cc0f832b8 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:36.540632 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c3ee9-df20-4485-9d24-eb0cc0f832b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:36.554693 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 777/1555] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:32:36 2021] PUT /identity/v3/projects/0d657713cf1e4cb1a2f28b2b83cccb37/users/92d831b9b1bb45c5ad5298620958af04/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:36.558799 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d7e59-f7b0-4e65-99ea-682097aa77ec None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:36.559086 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d7e59-f7b0-4e65-99ea-682097aa77ec None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:36.559363 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d7e59-f7b0-4e65-99ea-682097aa77ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:36.559614 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-881c3ee9-df20-4485-9d24-eb0cc0f832b8 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:36.560893 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-881c3ee9-df20-4485-9d24-eb0cc0f832b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:36.577815 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-b47d7e59-f7b0-4e65-99ea-682097aa77ec None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:36.579152 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-b47d7e59-f7b0-4e65-99ea-682097aa77ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:36.623827 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 779/1556] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:36.627203 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df4e67-1398-4958-ba3d-b0591d512611 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:36.627203 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df4e67-1398-4958-ba3d-b0591d512611 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:36.627203 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df4e67-1398-4958-ba3d-b0591d512611 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:36.628370 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 780/1557] 10.222.0.25 () {54 vars in 960 bytes} [Wed Oct 27 01:32:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:32:36.630285 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001359f-da95-42df-9372-2acf9e4aec9e None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:36.630927 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001359f-da95-42df-9372-2acf9e4aec9e None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:36.630927 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001359f-da95-42df-9372-2acf9e4aec9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:36.646396 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 778/1558] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:36.647544 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d7e59-f7b0-4e65-99ea-682097aa77ec None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:36.657007 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d7e59-f7b0-4e65-99ea-682097aa77ec None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:36.661829 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c622bef-54b4-468e-b927-7298e6e67479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:36.662490 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c622bef-54b4-468e-b927-7298e6e67479 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:36.662780 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c622bef-54b4-468e-b927-7298e6e67479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:36.663036 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c622bef-54b4-468e-b927-7298e6e67479 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:36.663781 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c622bef-54b4-468e-b927-7298e6e67479 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:36.663896 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-e001359f-da95-42df-9372-2acf9e4aec9e None None] MFA Rules not processed for user `6483aca4f25c4651add6ab3ba28504a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:36.665249 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-e001359f-da95-42df-9372-2acf9e4aec9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:36.665705 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c622bef-54b4-468e-b927-7298e6e67479 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:36.696001 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 779/1559] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:32:36 2021] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:36.698394 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d4eba-198b-4768-a346-9c45deb7a5f1 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:36.699044 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d4eba-198b-4768-a346-9c45deb7a5f1 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:36.699585 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d4eba-198b-4768-a346-9c45deb7a5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:36.718688 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-9d2d4eba-198b-4768-a346-9c45deb7a5f1 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:36.719892 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-9d2d4eba-198b-4768-a346-9c45deb7a5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:36.736974 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 781/1560] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:36 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:36.737860 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001359f-da95-42df-9372-2acf9e4aec9e None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:36.751867 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001359f-da95-42df-9372-2acf9e4aec9e None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:36.780223 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 780/1561] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:36.781072 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d4eba-198b-4768-a346-9c45deb7a5f1 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:36.809961 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278ab46-3d11-463a-b86d-4a4245d31a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:36.810635 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278ab46-3d11-463a-b86d-4a4245d31a62 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:36.810931 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278ab46-3d11-463a-b86d-4a4245d31a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:36.811205 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278ab46-3d11-463a-b86d-4a4245d31a62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:36.811949 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278ab46-3d11-463a-b86d-4a4245d31a62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:36.813565 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278ab46-3d11-463a-b86d-4a4245d31a62 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:36.824357 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 782/1562] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:36 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:36.826086 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb23a1-c6e2-4396-ba1c-dd8104330b09 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:36.826596 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb23a1-c6e2-4396-ba1c-dd8104330b09 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:36.827123 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb23a1-c6e2-4396-ba1c-dd8104330b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:36.840609 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d4eba-198b-4768-a346-9c45deb7a5f1 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:36.844403 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9481d2-d3ed-4156-b19d-6a38e52d96af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:36.845077 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9481d2-d3ed-4156-b19d-6a38e52d96af service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:36.845822 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9481d2-d3ed-4156-b19d-6a38e52d96af service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:36.845822 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9481d2-d3ed-4156-b19d-6a38e52d96af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:36.846768 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-6bcb23a1-c6e2-4396-ba1c-dd8104330b09 None None] MFA Rules not processed for user `b2f8304b85b64dc4ac58523897306660`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:36.848752 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-6bcb23a1-c6e2-4396-ba1c-dd8104330b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:36.855559 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9481d2-d3ed-4156-b19d-6a38e52d96af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:36.856984 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9481d2-d3ed-4156-b19d-6a38e52d96af service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:36.866504 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 781/1563] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:36.867315 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9481d2-d3ed-4156-b19d-6a38e52d96af service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:36.868616 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-1e9481d2-d3ed-4156-b19d-6a38e52d96af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:36.880037 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9481d2-d3ed-4156-b19d-6a38e52d96af service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:36.883829 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b3c18-09cc-496f-8584-372874a9fc89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:36.884526 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b3c18-09cc-496f-8584-372874a9fc89 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:36.884801 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b3c18-09cc-496f-8584-372874a9fc89 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:36.885083 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b3c18-09cc-496f-8584-372874a9fc89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:36.895389 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b3c18-09cc-496f-8584-372874a9fc89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:36.896638 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b3c18-09cc-496f-8584-372874a9fc89 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:36.908088 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 782/1564] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:36.909237 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b3c18-09cc-496f-8584-372874a9fc89 service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:36.919442 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b3c18-09cc-496f-8584-372874a9fc89 service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:36.920187 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 783/1565] 10.222.0.25 () {58 vars in 1057 bytes} [Wed Oct 27 01:32:36 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:36.921056 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb23a1-c6e2-4396-ba1c-dd8104330b09 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:36.924634 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8f985-f919-4fe7-b21e-1d398b9e66eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:36.925302 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8f985-f919-4fe7-b21e-1d398b9e66eb admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:36.925652 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8f985-f919-4fe7-b21e-1d398b9e66eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:36.925933 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8f985-f919-4fe7-b21e-1d398b9e66eb admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:36.926787 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8f985-f919-4fe7-b21e-1d398b9e66eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:36.929068 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8f985-f919-4fe7-b21e-1d398b9e66eb admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:36.953238 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 783/1566] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:32:36 2021] POST /identity/v3/users => generated 299 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:36.954137 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8f985-f919-4fe7-b21e-1d398b9e66eb admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:36.964470 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8f985-f919-4fe7-b21e-1d398b9e66eb admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:36.968636 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414b109-e16e-44b1-99c9-cecbe19c94a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:36.969431 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414b109-e16e-44b1-99c9-cecbe19c94a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:36.969749 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414b109-e16e-44b1-99c9-cecbe19c94a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:36.970026 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414b109-e16e-44b1-99c9-cecbe19c94a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:36.980633 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414b109-e16e-44b1-99c9-cecbe19c94a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:36.982148 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414b109-e16e-44b1-99c9-cecbe19c94a6 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:36.993233 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 784/1567] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:36.994127 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414b109-e16e-44b1-99c9-cecbe19c94a6 service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:36.997515 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb23a1-c6e2-4396-ba1c-dd8104330b09 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:37.004583 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ccb42-aa66-43c2-9982-ad97ae405d65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:37.005179 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ccb42-aa66-43c2-9982-ad97ae405d65 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:37.005464 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ccb42-aa66-43c2-9982-ad97ae405d65 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:37.005762 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ccb42-aa66-43c2-9982-ad97ae405d65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:37.008932 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414b109-e16e-44b1-99c9-cecbe19c94a6 service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:37.014379 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b889f9a-720d-4fd9-828a-d8de2e9df63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:37.015263 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b889f9a-720d-4fd9-828a-d8de2e9df63f admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:37.015557 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b889f9a-720d-4fd9-828a-d8de2e9df63f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:37.015831 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b889f9a-720d-4fd9-828a-d8de2e9df63f admin admin] PATH_INFO: `/v3/projects/0d657713cf1e4cb1a2f28b2b83cccb37/users/92d831b9b1bb45c5ad5298620958af04/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:37.017939 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b889f9a-720d-4fd9-828a-d8de2e9df63f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d657713cf1e4cb1a2f28b2b83cccb37, user_id=92d831b9b1bb45c5ad5298620958af04, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:37.021749 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b889f9a-720d-4fd9-828a-d8de2e9df63f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:37.037530 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 785/1568] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:32:36 2021] PUT /identity/v3/projects/0d657713cf1e4cb1a2f28b2b83cccb37/users/92d831b9b1bb45c5ad5298620958af04/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:37.037530 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b889f9a-720d-4fd9-828a-d8de2e9df63f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:37.102940 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ccb42-aa66-43c2-9982-ad97ae405d65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:37.104647 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ccb42-aa66-43c2-9982-ad97ae405d65 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:37.127443 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 784/1569] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:36 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:37.129137 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ccb42-aa66-43c2-9982-ad97ae405d65 service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:37.164423 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ccb42-aa66-43c2-9982-ad97ae405d65 service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:37.186668 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b889f9a-720d-4fd9-828a-d8de2e9df63f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:37.195900 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b818ec-3ffb-4825-861e-b770da3aea51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:37.197691 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b818ec-3ffb-4825-861e-b770da3aea51 service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:37.198228 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b818ec-3ffb-4825-861e-b770da3aea51 service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:37.200324 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b818ec-3ffb-4825-861e-b770da3aea51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:37.297536 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3877206-ad40-4a10-9529-79a2178947c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:37.298535 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3877206-ad40-4a10-9529-79a2178947c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:37.298988 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3877206-ad40-4a10-9529-79a2178947c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:37.299434 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3877206-ad40-4a10-9529-79a2178947c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:37.300320 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3877206-ad40-4a10-9529-79a2178947c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:37.303717 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3877206-ad40-4a10-9529-79a2178947c5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:37.306439 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b818ec-3ffb-4825-861e-b770da3aea51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:37.308309 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b818ec-3ffb-4825-861e-b770da3aea51 service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:37.322947 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 785/1570] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:37 2021] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:37.326017 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05174c-eba8-4e66-ac9e-f2ea53c574e9 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:37.327954 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 786/1571] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:37 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:37.328433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05174c-eba8-4e66-ac9e-f2ea53c574e9 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:37.328898 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05174c-eba8-4e66-ac9e-f2ea53c574e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:37.332257 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b818ec-3ffb-4825-861e-b770da3aea51 service nova] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:37.353116 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b818ec-3ffb-4825-861e-b770da3aea51 service nova] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:37.362829 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2547a-7931-48e6-8d83-a0716fda9be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:37.364664 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2547a-7931-48e6-8d83-a0716fda9be4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:37.365113 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2547a-7931-48e6-8d83-a0716fda9be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:37.365592 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2547a-7931-48e6-8d83-a0716fda9be4 admin admin] PATH_INFO: `/v3/projects/5a8acae8c13c4c5bb38e15e410e71301/users/e1d5db82ac174f9bab88a18b4904797b/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:37.383496 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-0c05174c-eba8-4e66-ac9e-f2ea53c574e9 None None] MFA Rules not processed for user `92d831b9b1bb45c5ad5298620958af04`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:37.384993 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-0c05174c-eba8-4e66-ac9e-f2ea53c574e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:37.393728 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2547a-7931-48e6-8d83-a0716fda9be4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a8acae8c13c4c5bb38e15e410e71301, user_id=e1d5db82ac174f9bab88a18b4904797b, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:37.396703 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2547a-7931-48e6-8d83-a0716fda9be4 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:37.427173 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 787/1572] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:32:37 2021] PUT /identity/v3/projects/5a8acae8c13c4c5bb38e15e410e71301/users/e1d5db82ac174f9bab88a18b4904797b/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:37.432863 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2547a-7931-48e6-8d83-a0716fda9be4 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:37.538589 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 786/1573] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:37 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:37.546925 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05174c-eba8-4e66-ac9e-f2ea53c574e9 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:37.615409 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2547a-7931-48e6-8d83-a0716fda9be4 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:37.629407 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b9b54-01cb-421f-98d0-64337a98526f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:37.630379 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b9b54-01cb-421f-98d0-64337a98526f admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:37.630770 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b9b54-01cb-421f-98d0-64337a98526f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:37.631365 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b9b54-01cb-421f-98d0-64337a98526f admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:37.632298 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b9b54-01cb-421f-98d0-64337a98526f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:37.636240 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b9b54-01cb-421f-98d0-64337a98526f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:37.661246 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05174c-eba8-4e66-ac9e-f2ea53c574e9 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:37.673033 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 788/1574] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:37 2021] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:37.676766 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b9b54-01cb-421f-98d0-64337a98526f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:37.716580 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b9b54-01cb-421f-98d0-64337a98526f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:37.733128 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4677b04-35ca-479e-9641-098bd688bd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:37.734547 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4677b04-35ca-479e-9641-098bd688bd24 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:37.737569 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4677b04-35ca-479e-9641-098bd688bd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:37.738660 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4677b04-35ca-479e-9641-098bd688bd24 admin admin] PATH_INFO: `/v3/projects/5a8acae8c13c4c5bb38e15e410e71301/users/e1d5db82ac174f9bab88a18b4904797b/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:37.744874 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4677b04-35ca-479e-9641-098bd688bd24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a8acae8c13c4c5bb38e15e410e71301, user_id=e1d5db82ac174f9bab88a18b4904797b, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:37.750889 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4677b04-35ca-479e-9641-098bd688bd24 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:37.766437 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 789/1575] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:32:37 2021] PUT /identity/v3/projects/5a8acae8c13c4c5bb38e15e410e71301/users/e1d5db82ac174f9bab88a18b4904797b/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:37.767538 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311410dc-ed88-4ff9-97a7-856f83905452 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:37.769047 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311410dc-ed88-4ff9-97a7-856f83905452 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:37.769047 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311410dc-ed88-4ff9-97a7-856f83905452 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:37.770412 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311410dc-ed88-4ff9-97a7-856f83905452 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:37.787440 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7281c-1a93-4f77-b935-548bdbb6669a None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:37.788972 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7281c-1a93-4f77-b935-548bdbb6669a None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:37.790451 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7281c-1a93-4f77-b935-548bdbb6669a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:37.873725 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-84f7281c-1a93-4f77-b935-548bdbb6669a None None] MFA Rules not processed for user `e1d5db82ac174f9bab88a18b4904797b`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:37.876957 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-84f7281c-1a93-4f77-b935-548bdbb6669a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:37.905893 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311410dc-ed88-4ff9-97a7-856f83905452 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:37.907583 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311410dc-ed88-4ff9-97a7-856f83905452 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:37.924010 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 787/1576] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:37 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:37.925444 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cebdd-6160-4f29-b7b2-f4cd9b531120 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:37.926476 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cebdd-6160-4f29-b7b2-f4cd9b531120 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:37.926778 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cebdd-6160-4f29-b7b2-f4cd9b531120 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:37.929035 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 788/1577] 10.222.0.25 () {54 vars in 912 bytes} [Wed Oct 27 01:32:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:32:37.935138 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e571bb9-084a-46ab-8c1f-89070ef6a596 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:37.935433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e571bb9-084a-46ab-8c1f-89070ef6a596 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:37.935763 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e571bb9-084a-46ab-8c1f-89070ef6a596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:37.956136 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-0e571bb9-084a-46ab-8c1f-89070ef6a596 None None] MFA Rules not processed for user `b2f8304b85b64dc4ac58523897306660`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:37.956947 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-0e571bb9-084a-46ab-8c1f-89070ef6a596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:38.050368 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 789/1578] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Oct 27 01:32:37 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:38.062126 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e571bb9-084a-46ab-8c1f-89070ef6a596 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:38.104571 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 790/1579] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:37 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:38.151065 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e571bb9-084a-46ab-8c1f-89070ef6a596 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:38.156988 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7298a5c-77c4-4c3c-bf84-00bebb7fe3d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:38.157769 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7298a5c-77c4-4c3c-bf84-00bebb7fe3d6 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:38.158666 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7298a5c-77c4-4c3c-bf84-00bebb7fe3d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:38.159156 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7298a5c-77c4-4c3c-bf84-00bebb7fe3d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:38.181995 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7298a5c-77c4-4c3c-bf84-00bebb7fe3d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:38.183734 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7298a5c-77c4-4c3c-bf84-00bebb7fe3d6 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:38.200046 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 790/1580] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:38 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:32:38.413450 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7281c-1a93-4f77-b935-548bdbb6669a None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:38.428121 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7281c-1a93-4f77-b935-548bdbb6669a None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:38.439743 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a03a33-eb8e-497f-9223-e01fac5b5586 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:38.442745 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a03a33-eb8e-497f-9223-e01fac5b5586 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:38.443209 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a03a33-eb8e-497f-9223-e01fac5b5586 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:38.444007 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a03a33-eb8e-497f-9223-e01fac5b5586 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:38.469377 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a03a33-eb8e-497f-9223-e01fac5b5586 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:38.472739 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a03a33-eb8e-497f-9223-e01fac5b5586 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:38.507872 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 791/1581] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:38 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:38.553448 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7298a5c-77c4-4c3c-bf84-00bebb7fe3d6 service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:38.667755 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a03a33-eb8e-497f-9223-e01fac5b5586 service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:38.692693 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a03a33-eb8e-497f-9223-e01fac5b5586 service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:38.702755 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a390b-3828-471d-81a4-f9ff9b8b66b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:38.703900 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a390b-3828-471d-81a4-f9ff9b8b66b5 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:38.703900 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a390b-3828-471d-81a4-f9ff9b8b66b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:38.705703 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a390b-3828-471d-81a4-f9ff9b8b66b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:38.733870 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7298a5c-77c4-4c3c-bf84-00bebb7fe3d6 service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:38.752744 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c2817-d968-4e10-b582-9cdf87d759b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:38.758290 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c2817-d968-4e10-b582-9cdf87d759b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:38.760028 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c2817-d968-4e10-b582-9cdf87d759b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:38.761113 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c2817-d968-4e10-b582-9cdf87d759b8 admin admin] PATH_INFO: `/v3/users/d52f4b62fb284efdbe679cfc7e3c3ebc` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:38.766506 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c2817-d968-4e10-b582-9cdf87d759b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d52f4b62fb284efdbe679cfc7e3c3ebc)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:38.771317 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: WARNING py.warnings [None req-221c2817-d968-4e10-b582-9cdf87d759b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:32:38.771317 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: warnings.warn(msg) Oct 27 01:32:38.771317 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: Oct 27 01:32:38.776864 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c2817-d968-4e10-b582-9cdf87d759b8 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:38.811879 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a390b-3828-471d-81a4-f9ff9b8b66b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:38.813632 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a390b-3828-471d-81a4-f9ff9b8b66b5 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:38.829951 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 792/1582] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:38 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:38.987593 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-221c2817-d968-4e10-b582-9cdf87d759b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd52f4b62fb284efdbe679cfc7e3c3ebc'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:39.003406 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-221c2817-d968-4e10-b582-9cdf87d759b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd52f4b62fb284efdbe679cfc7e3c3ebc'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:39.052529 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-221c2817-d968-4e10-b582-9cdf87d759b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd52f4b62fb284efdbe679cfc7e3c3ebc'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:39.053711 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-221c2817-d968-4e10-b582-9cdf87d759b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd52f4b62fb284efdbe679cfc7e3c3ebc'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:39.099772 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-221c2817-d968-4e10-b582-9cdf87d759b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd52f4b62fb284efdbe679cfc7e3c3ebc'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:39.111280 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 791/1583] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:32:38 2021] DELETE /identity/v3/users/d52f4b62fb284efdbe679cfc7e3c3ebc => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:39.116594 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0948657-5a55-4e0d-bffd-cbe1105a8395 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:39.116954 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0948657-5a55-4e0d-bffd-cbe1105a8395 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:39.117238 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0948657-5a55-4e0d-bffd-cbe1105a8395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:39.159259 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-b0948657-5a55-4e0d-bffd-cbe1105a8395 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:39.165382 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-b0948657-5a55-4e0d-bffd-cbe1105a8395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:39.385909 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 793/1584] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:39.407048 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c2817-d968-4e10-b582-9cdf87d759b8 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:39.410828 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-221c2817-d968-4e10-b582-9cdf87d759b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:39.543596 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c2817-d968-4e10-b582-9cdf87d759b8 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:39.547847 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d0a95-0ece-4bbe-8061-a498af89b25b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:39.548672 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d0a95-0ece-4bbe-8061-a498af89b25b service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:39.549051 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d0a95-0ece-4bbe-8061-a498af89b25b service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:39.549340 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d0a95-0ece-4bbe-8061-a498af89b25b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:39.560241 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d0a95-0ece-4bbe-8061-a498af89b25b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:39.561771 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d0a95-0ece-4bbe-8061-a498af89b25b service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:39.574044 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 792/1585] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:39.764956 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a96ea-03c5-4a92-8562-54a6b6bcd11a None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:39.765245 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a96ea-03c5-4a92-8562-54a6b6bcd11a None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:39.765545 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a96ea-03c5-4a92-8562-54a6b6bcd11a None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:39.768175 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 794/1586] 10.222.0.25 () {54 vars in 960 bytes} [Wed Oct 27 01:32:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:32:39.779832 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36c33c-18c9-4999-86c1-fc0178992645 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:39.780834 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36c33c-18c9-4999-86c1-fc0178992645 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:39.782494 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36c33c-18c9-4999-86c1-fc0178992645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:39.804684 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-ac36c33c-18c9-4999-86c1-fc0178992645 None None] MFA Rules not processed for user `b2f8304b85b64dc4ac58523897306660`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:39.806659 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-ac36c33c-18c9-4999-86c1-fc0178992645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:39.918461 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 793/1587] 10.222.0.25 () {58 vars in 1057 bytes} [Wed Oct 27 01:32:39 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:39.919834 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028addcc-1f2c-46ed-9e72-56d64527a0ad None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:39.920341 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028addcc-1f2c-46ed-9e72-56d64527a0ad None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:39.920438 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028addcc-1f2c-46ed-9e72-56d64527a0ad None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:39.922415 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 795/1588] 10.222.0.25 () {54 vars in 912 bytes} [Wed Oct 27 01:32:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:32:39.930141 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d736ca-d598-40cf-8727-b8f83791851e None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:39.931492 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d736ca-d598-40cf-8727-b8f83791851e None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:39.931937 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d736ca-d598-40cf-8727-b8f83791851e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:39.980566 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-b5d736ca-d598-40cf-8727-b8f83791851e None None] MFA Rules not processed for user `b2f8304b85b64dc4ac58523897306660`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:39.982143 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-b5d736ca-d598-40cf-8727-b8f83791851e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:40.018608 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 794/1589] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Oct 27 01:32:39 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:40.028176 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028addcc-1f2c-46ed-9e72-56d64527a0ad None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:40.030314 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-028addcc-1f2c-46ed-9e72-56d64527a0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:40.177255 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028addcc-1f2c-46ed-9e72-56d64527a0ad None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:40.182950 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe3926-8be1-4d47-b8aa-dfa78ab5d84d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:40.185793 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe3926-8be1-4d47-b8aa-dfa78ab5d84d service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:40.186323 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe3926-8be1-4d47-b8aa-dfa78ab5d84d service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:40.186882 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe3926-8be1-4d47-b8aa-dfa78ab5d84d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:40.210967 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe3926-8be1-4d47-b8aa-dfa78ab5d84d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:40.212623 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe3926-8be1-4d47-b8aa-dfa78ab5d84d service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:40.252447 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 796/1590] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:40 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:32:40.448766 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4095a7f-cc7f-428a-8c79-0e1170c30ced None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:40.448766 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4095a7f-cc7f-428a-8c79-0e1170c30ced None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:40.448766 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4095a7f-cc7f-428a-8c79-0e1170c30ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:40.481832 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-c4095a7f-cc7f-428a-8c79-0e1170c30ced None None] MFA Rules not processed for user `e7bdbbbf823e44c5ada267e4fa89284f`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:40.500335 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-c4095a7f-cc7f-428a-8c79-0e1170c30ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:40.742023 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 795/1591] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:40 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:40.745858 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730fb63-74a3-4335-9443-834c43359690 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:40.746765 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730fb63-74a3-4335-9443-834c43359690 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:40.746765 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730fb63-74a3-4335-9443-834c43359690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:40.786963 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-2730fb63-74a3-4335-9443-834c43359690 None None] MFA Rules not processed for user `e7bdbbbf823e44c5ada267e4fa89284f`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:40.797928 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-2730fb63-74a3-4335-9443-834c43359690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:40.817333 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 797/1592] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:40 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:40.831042 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4095a7f-cc7f-428a-8c79-0e1170c30ced None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:40.832993 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-c4095a7f-cc7f-428a-8c79-0e1170c30ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:40.877918 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4095a7f-cc7f-428a-8c79-0e1170c30ced None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:40.887161 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43094b8-37e5-4acc-8993-c760c475a839 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:40.899867 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43094b8-37e5-4acc-8993-c760c475a839 service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:40.900533 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43094b8-37e5-4acc-8993-c760c475a839 service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:40.900827 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43094b8-37e5-4acc-8993-c760c475a839 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:40.927007 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43094b8-37e5-4acc-8993-c760c475a839 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:40.930490 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43094b8-37e5-4acc-8993-c760c475a839 service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:40.945494 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 796/1593] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:40 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:32:42.050147 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730fb63-74a3-4335-9443-834c43359690 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:42.052146 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-2730fb63-74a3-4335-9443-834c43359690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:42.064455 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43094b8-37e5-4acc-8993-c760c475a839 service nova] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:42.066311 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-d43094b8-37e5-4acc-8993-c760c475a839 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:42.095866 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730fb63-74a3-4335-9443-834c43359690 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:42.106897 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43094b8-37e5-4acc-8993-c760c475a839 service nova] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:42.117399 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6573e1-2b98-4bb0-8588-a9ae458edf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:42.118326 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6573e1-2b98-4bb0-8588-a9ae458edf22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:42.118611 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6573e1-2b98-4bb0-8588-a9ae458edf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:42.118885 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6573e1-2b98-4bb0-8588-a9ae458edf22 admin admin] PATH_INFO: `/v3/projects/64c187e6131a49d8ba364f8c55c65fe5` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:42.126074 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977bc5a-9b6c-423b-aea3-32b28c82ba88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:42.127104 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6573e1-2b98-4bb0-8588-a9ae458edf22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64c187e6131a49d8ba364f8c55c65fe5)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:42.131461 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977bc5a-9b6c-423b-aea3-32b28c82ba88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:42.132748 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: WARNING py.warnings [None req-eb6573e1-2b98-4bb0-8588-a9ae458edf22 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:32:42.132748 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: warnings.warn(msg) Oct 27 01:32:42.132748 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: Oct 27 01:32:42.133371 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977bc5a-9b6c-423b-aea3-32b28c82ba88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:42.133893 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977bc5a-9b6c-423b-aea3-32b28c82ba88 admin admin] PATH_INFO: `/v3/users/13f08832b1cd4593850cdfe209f6c5a1` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:42.136769 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977bc5a-9b6c-423b-aea3-32b28c82ba88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13f08832b1cd4593850cdfe209f6c5a1)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:42.137247 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6573e1-2b98-4bb0-8588-a9ae458edf22 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:42.139349 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977bc5a-9b6c-423b-aea3-32b28c82ba88 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:42.272039 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6977bc5a-9b6c-423b-aea3-32b28c82ba88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13f08832b1cd4593850cdfe209f6c5a1'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:42.285208 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6977bc5a-9b6c-423b-aea3-32b28c82ba88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13f08832b1cd4593850cdfe209f6c5a1'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:42.289960 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-eb6573e1-2b98-4bb0-8588-a9ae458edf22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64c187e6131a49d8ba364f8c55c65fe5', 'request_id': 'req-eb6573e1-2b98-4bb0-8588-a9ae458edf22'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:42.303802 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6977bc5a-9b6c-423b-aea3-32b28c82ba88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13f08832b1cd4593850cdfe209f6c5a1'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:42.304018 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-eb6573e1-2b98-4bb0-8588-a9ae458edf22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64c187e6131a49d8ba364f8c55c65fe5', 'request_id': 'req-eb6573e1-2b98-4bb0-8588-a9ae458edf22'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:42.305958 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6977bc5a-9b6c-423b-aea3-32b28c82ba88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13f08832b1cd4593850cdfe209f6c5a1'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:42.332876 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6977bc5a-9b6c-423b-aea3-32b28c82ba88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13f08832b1cd4593850cdfe209f6c5a1'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:42.333090 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-eb6573e1-2b98-4bb0-8588-a9ae458edf22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64c187e6131a49d8ba364f8c55c65fe5', 'request_id': 'req-eb6573e1-2b98-4bb0-8588-a9ae458edf22'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:42.357166 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 797/1594] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:32:42 2021] DELETE /identity/v3/users/13f08832b1cd4593850cdfe209f6c5a1 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:42.365068 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767aaafe-e28c-4930-af15-45738f7d7962 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:42.365396 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767aaafe-e28c-4930-af15-45738f7d7962 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:42.365724 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767aaafe-e28c-4930-af15-45738f7d7962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:42.373195 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-eb6573e1-2b98-4bb0-8588-a9ae458edf22 admin admin] The token cache is being invalidate because project 64c187e6131a49d8ba364f8c55c65fe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:32:42.373697 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-eb6573e1-2b98-4bb0-8588-a9ae458edf22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:42.376749 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-eb6573e1-2b98-4bb0-8588-a9ae458edf22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:42.383729 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 798/1595] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:32:42 2021] DELETE /identity/v3/projects/64c187e6131a49d8ba364f8c55c65fe5 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:42.386809 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8562f5-f47f-47c2-bc23-6539a2c2f2ea None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:42.388170 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8562f5-f47f-47c2-bc23-6539a2c2f2ea None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:42.390091 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8562f5-f47f-47c2-bc23-6539a2c2f2ea None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:42.393529 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 799/1596] 10.222.0.25 () {54 vars in 912 bytes} [Wed Oct 27 01:32:42 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:32:42.395777 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8562f5-f47f-47c2-bc23-6539a2c2f2ea None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:42.401938 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-9d8562f5-f47f-47c2-bc23-6539a2c2f2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:42.428587 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-767aaafe-e28c-4930-af15-45738f7d7962 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:42.430141 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-767aaafe-e28c-4930-af15-45738f7d7962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:42.558756 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8562f5-f47f-47c2-bc23-6539a2c2f2ea None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:42.569869 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34d16d-2e8c-4e7d-a072-3b4ada26c432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:42.570824 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34d16d-2e8c-4e7d-a072-3b4ada26c432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:42.571367 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 798/1597] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:42.572166 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34d16d-2e8c-4e7d-a072-3b4ada26c432 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:42.572459 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34d16d-2e8c-4e7d-a072-3b4ada26c432 admin admin] PATH_INFO: `/v3/users/e1d5db82ac174f9bab88a18b4904797b` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:42.575555 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e9b1f-3adb-43fe-84b1-39de8b1fbd88 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:42.576145 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e9b1f-3adb-43fe-84b1-39de8b1fbd88 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:42.576145 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e9b1f-3adb-43fe-84b1-39de8b1fbd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:42.576844 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34d16d-2e8c-4e7d-a072-3b4ada26c432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1d5db82ac174f9bab88a18b4904797b)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:42.580455 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34d16d-2e8c-4e7d-a072-3b4ada26c432 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:42.634822 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-a00e9b1f-3adb-43fe-84b1-39de8b1fbd88 None None] MFA Rules not processed for user `bff692322c68420186f2918d380ece98`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:42.638324 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-a00e9b1f-3adb-43fe-84b1-39de8b1fbd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:42.720621 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-8f34d16d-2e8c-4e7d-a072-3b4ada26c432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1d5db82ac174f9bab88a18b4904797b'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:42.737712 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-8f34d16d-2e8c-4e7d-a072-3b4ada26c432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1d5db82ac174f9bab88a18b4904797b'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:42.740485 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-8f34d16d-2e8c-4e7d-a072-3b4ada26c432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1d5db82ac174f9bab88a18b4904797b'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:42.781084 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-8f34d16d-2e8c-4e7d-a072-3b4ada26c432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1d5db82ac174f9bab88a18b4904797b'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:42.795695 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 799/1598] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Oct 27 01:32:42 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:42.796721 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e9b1f-3adb-43fe-84b1-39de8b1fbd88 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:42.799033 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-a00e9b1f-3adb-43fe-84b1-39de8b1fbd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:42.804881 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-8f34d16d-2e8c-4e7d-a072-3b4ada26c432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1d5db82ac174f9bab88a18b4904797b'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:42.820060 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e9b1f-3adb-43fe-84b1-39de8b1fbd88 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:42.828046 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 800/1599] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:32:42 2021] DELETE /identity/v3/users/e1d5db82ac174f9bab88a18b4904797b => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:42.834837 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685b2b3-e78c-4054-b131-05ce22762cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:42.835811 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685b2b3-e78c-4054-b131-05ce22762cee service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:42.836207 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685b2b3-e78c-4054-b131-05ce22762cee service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:42.836591 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685b2b3-e78c-4054-b131-05ce22762cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:42.838802 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-7685b2b3-e78c-4054-b131-05ce22762cee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:42.866780 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685b2b3-e78c-4054-b131-05ce22762cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:42.868919 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685b2b3-e78c-4054-b131-05ce22762cee service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:42.892730 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 800/1600] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:42.899557 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34d16d-2e8c-4e7d-a072-3b4ada26c432 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:43.077909 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34d16d-2e8c-4e7d-a072-3b4ada26c432 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:43.084115 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1b9a9-af62-4067-8de1-42c8587807a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:43.085123 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1b9a9-af62-4067-8de1-42c8587807a5 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:43.085645 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1b9a9-af62-4067-8de1-42c8587807a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:43.086195 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1b9a9-af62-4067-8de1-42c8587807a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:43.097587 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1b9a9-af62-4067-8de1-42c8587807a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:43.105748 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1b9a9-af62-4067-8de1-42c8587807a5 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:43.117009 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 801/1601] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:42 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:43.769711 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685b2b3-e78c-4054-b131-05ce22762cee service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:43.771167 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-7685b2b3-e78c-4054-b131-05ce22762cee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:43.786040 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685b2b3-e78c-4054-b131-05ce22762cee service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:43.868107 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8f9bd-7ee0-4d9d-a4a9-b70247587f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:43.869583 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8f9bd-7ee0-4d9d-a4a9-b70247587f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:43.870046 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8f9bd-7ee0-4d9d-a4a9-b70247587f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:43.870479 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8f9bd-7ee0-4d9d-a4a9-b70247587f4b admin admin] PATH_INFO: `/v3/projects/27ddd2330923484e889e923d2ff11996` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:43.874263 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8f9bd-7ee0-4d9d-a4a9-b70247587f4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=27ddd2330923484e889e923d2ff11996)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:43.876579 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8f9bd-7ee0-4d9d-a4a9-b70247587f4b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:44.008777 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-e6d8f9bd-7ee0-4d9d-a4a9-b70247587f4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27ddd2330923484e889e923d2ff11996', 'request_id': 'req-e6d8f9bd-7ee0-4d9d-a4a9-b70247587f4b'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:44.028841 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-e6d8f9bd-7ee0-4d9d-a4a9-b70247587f4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27ddd2330923484e889e923d2ff11996', 'request_id': 'req-e6d8f9bd-7ee0-4d9d-a4a9-b70247587f4b'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:44.041641 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-e6d8f9bd-7ee0-4d9d-a4a9-b70247587f4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27ddd2330923484e889e923d2ff11996', 'request_id': 'req-e6d8f9bd-7ee0-4d9d-a4a9-b70247587f4b'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:44.073790 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-e6d8f9bd-7ee0-4d9d-a4a9-b70247587f4b admin admin] The token cache is being invalidate because project 27ddd2330923484e889e923d2ff11996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:32:44.073979 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-e6d8f9bd-7ee0-4d9d-a4a9-b70247587f4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:44.074995 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-e6d8f9bd-7ee0-4d9d-a4a9-b70247587f4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:44.082818 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 801/1602] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:32:43 2021] DELETE /identity/v3/projects/27ddd2330923484e889e923d2ff11996 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:44.088534 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8c86a-ce90-48c0-a2ff-8be2d36bbf51 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:44.089776 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8c86a-ce90-48c0-a2ff-8be2d36bbf51 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:44.090245 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8c86a-ce90-48c0-a2ff-8be2d36bbf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:44.138906 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-4ec8c86a-ce90-48c0-a2ff-8be2d36bbf51 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:44.140363 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4ec8c86a-ce90-48c0-a2ff-8be2d36bbf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:44.232935 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 802/1603] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:44.240590 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7832d9-5c63-441b-a045-2b1cc49b9617 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:44.242297 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7832d9-5c63-441b-a045-2b1cc49b9617 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:44.242791 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7832d9-5c63-441b-a045-2b1cc49b9617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:44.259512 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e0d2b-e6fe-4905-adfd-7d2bdb98a229 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:44.259711 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e0d2b-e6fe-4905-adfd-7d2bdb98a229 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:44.259995 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e0d2b-e6fe-4905-adfd-7d2bdb98a229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:44.295848 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-b03e0d2b-e6fe-4905-adfd-7d2bdb98a229 None None] MFA Rules not processed for user `714ca1b794144b1eabeed1ebdaa27669`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:44.297321 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-b03e0d2b-e6fe-4905-adfd-7d2bdb98a229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:44.328580 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-ee7832d9-5c63-441b-a045-2b1cc49b9617 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:44.342124 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-ee7832d9-5c63-441b-a045-2b1cc49b9617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:44.403870 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 802/1604] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:32:44.406448 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7832d9-5c63-441b-a045-2b1cc49b9617 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:44.419250 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 803/1605] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:44 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:32:44.421039 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070e12e-5f17-4cfe-98bf-cafba215969c None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:44.421513 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070e12e-5f17-4cfe-98bf-cafba215969c None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:44.422092 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070e12e-5f17-4cfe-98bf-cafba215969c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:44.449136 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7832d9-5c63-441b-a045-2b1cc49b9617 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:44.451706 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-3070e12e-5f17-4cfe-98bf-cafba215969c None None] MFA Rules not processed for user `714ca1b794144b1eabeed1ebdaa27669`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:44.455101 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3070e12e-5f17-4cfe-98bf-cafba215969c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:44.467966 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 804/1606] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:44 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:44.469142 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070e12e-5f17-4cfe-98bf-cafba215969c None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:44.470862 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3070e12e-5f17-4cfe-98bf-cafba215969c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:44.474382 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2fbc3-552d-4904-86db-6817e7b63043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:44.475227 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2fbc3-552d-4904-86db-6817e7b63043 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:44.475515 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2fbc3-552d-4904-86db-6817e7b63043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:44.475797 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2fbc3-552d-4904-86db-6817e7b63043 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:44.478851 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2fbc3-552d-4904-86db-6817e7b63043 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:32:44.478851 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2fbc3-552d-4904-86db-6817e7b63043 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:44.483882 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2fbc3-552d-4904-86db-6817e7b63043 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:44.519494 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 803/1607] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:32:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:32:44.522339 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2fbc3-552d-4904-86db-6817e7b63043 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:44.545428 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2fbc3-552d-4904-86db-6817e7b63043 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:44.565424 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e85a2-26f2-4577-a2d1-4995711df505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:44.566855 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e85a2-26f2-4577-a2d1-4995711df505 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:44.567375 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e85a2-26f2-4577-a2d1-4995711df505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:44.567906 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e85a2-26f2-4577-a2d1-4995711df505 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:44.570804 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e85a2-26f2-4577-a2d1-4995711df505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:44.576831 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e85a2-26f2-4577-a2d1-4995711df505 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:44.612517 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070e12e-5f17-4cfe-98bf-cafba215969c None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:44.627119 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e4559-b862-4a8c-96ee-f86f5ddedcb8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff82e315d8c42e49556ab67fbf53b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:44.627794 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e4559-b862-4a8c-96ee-f86f5ddedcb8 service placement] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:44.628083 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e4559-b862-4a8c-96ee-f86f5ddedcb8 service placement] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:44.628472 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e4559-b862-4a8c-96ee-f86f5ddedcb8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:44.639206 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3c2e4559-b862-4a8c-96ee-f86f5ddedcb8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:44.653592 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e4559-b862-4a8c-96ee-f86f5ddedcb8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:44.655395 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e4559-b862-4a8c-96ee-f86f5ddedcb8 service placement] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:44.665581 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 804/1608] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:32:44 2021] POST /identity/v3/projects => generated 403 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:44.666467 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e85a2-26f2-4577-a2d1-4995711df505 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:44.668884 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-726e85a2-26f2-4577-a2d1-4995711df505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:44.672342 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 805/1609] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:44 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:44.673389 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e4559-b862-4a8c-96ee-f86f5ddedcb8 service placement] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:44.693287 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e4559-b862-4a8c-96ee-f86f5ddedcb8 service placement] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:44.765589 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e85a2-26f2-4577-a2d1-4995711df505 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:44.774465 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8809d-51ee-4656-9977-68ca1bc56299 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:44.776338 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8809d-51ee-4656-9977-68ca1bc56299 service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:44.776843 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8809d-51ee-4656-9977-68ca1bc56299 service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:44.777325 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8809d-51ee-4656-9977-68ca1bc56299 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:44.805708 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc66d0-cab5-4b80-aae8-58ebac26f627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:44.806897 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc66d0-cab5-4b80-aae8-58ebac26f627 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:44.807184 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc66d0-cab5-4b80-aae8-58ebac26f627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:44.807461 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc66d0-cab5-4b80-aae8-58ebac26f627 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:44.808241 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc66d0-cab5-4b80-aae8-58ebac26f627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:44.810350 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc66d0-cab5-4b80-aae8-58ebac26f627 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:44.856168 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 806/1610] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:32:44 2021] POST /identity/v3/users => generated 302 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:44.859973 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc66d0-cab5-4b80-aae8-58ebac26f627 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:44.891571 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8809d-51ee-4656-9977-68ca1bc56299 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:44.892479 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc66d0-cab5-4b80-aae8-58ebac26f627 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:44.902669 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8809d-51ee-4656-9977-68ca1bc56299 service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:44.906955 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb22ec-d9da-4e2b-b5de-c1c7723533e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:44.908163 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb22ec-d9da-4e2b-b5de-c1c7723533e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:44.908840 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb22ec-d9da-4e2b-b5de-c1c7723533e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:44.909125 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb22ec-d9da-4e2b-b5de-c1c7723533e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:44.910489 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb22ec-d9da-4e2b-b5de-c1c7723533e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:44.912799 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb22ec-d9da-4e2b-b5de-c1c7723533e5 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:44.920015 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 805/1611] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:44 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:44.940437 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 807/1612] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:44 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:44.944526 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8809d-51ee-4656-9977-68ca1bc56299 service nova] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:44.960703 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8809d-51ee-4656-9977-68ca1bc56299 service nova] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:44.970042 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c8692-08ec-4639-a03e-feec79ed96c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:44.970735 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c8692-08ec-4639-a03e-feec79ed96c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:44.971236 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c8692-08ec-4639-a03e-feec79ed96c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:44.971361 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c8692-08ec-4639-a03e-feec79ed96c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:44.972024 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c8692-08ec-4639-a03e-feec79ed96c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:44.974455 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c8692-08ec-4639-a03e-feec79ed96c5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:44.990306 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 806/1613] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:44 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:32:44.991104 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb22ec-d9da-4e2b-b5de-c1c7723533e5 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:45.004041 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb22ec-d9da-4e2b-b5de-c1c7723533e5 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:45.016657 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83204dd5-0aaf-445a-8db0-1e2f5485658b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:45.017604 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83204dd5-0aaf-445a-8db0-1e2f5485658b admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:45.017890 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83204dd5-0aaf-445a-8db0-1e2f5485658b admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:45.019838 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83204dd5-0aaf-445a-8db0-1e2f5485658b admin admin] PATH_INFO: `/v3/projects/583382d05e7d478c8dc5d59aefea7c11/users/b08e423ea4b743d98311d0dfc8075635/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:45.054279 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83204dd5-0aaf-445a-8db0-1e2f5485658b admin admin] RBAC: Authorizing `identity:create_grant(project_id=583382d05e7d478c8dc5d59aefea7c11, user_id=b08e423ea4b743d98311d0dfc8075635, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:45.057841 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83204dd5-0aaf-445a-8db0-1e2f5485658b admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:45.078544 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 808/1614] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:32:44 2021] PUT /identity/v3/projects/583382d05e7d478c8dc5d59aefea7c11/users/b08e423ea4b743d98311d0dfc8075635/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:45.089862 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd4715-58f2-49ae-a8d2-7e8b6b42467a None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:45.090297 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd4715-58f2-49ae-a8d2-7e8b6b42467a None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:45.090644 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd4715-58f2-49ae-a8d2-7e8b6b42467a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:45.153234 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-eadd4715-58f2-49ae-a8d2-7e8b6b42467a None None] MFA Rules not processed for user `b08e423ea4b743d98311d0dfc8075635`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:45.154642 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-eadd4715-58f2-49ae-a8d2-7e8b6b42467a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:45.263896 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 807/1615] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:45 2021] POST /identity/v3/auth/tokens => generated 3423 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:45.264531 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83204dd5-0aaf-445a-8db0-1e2f5485658b admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:45.396155 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83204dd5-0aaf-445a-8db0-1e2f5485658b admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:45.420055 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac8bc3-06c8-42f1-a22b-bb59bbf61673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:45.421550 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac8bc3-06c8-42f1-a22b-bb59bbf61673 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:45.421918 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac8bc3-06c8-42f1-a22b-bb59bbf61673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:45.422391 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac8bc3-06c8-42f1-a22b-bb59bbf61673 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:45.423365 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac8bc3-06c8-42f1-a22b-bb59bbf61673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:45.425725 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac8bc3-06c8-42f1-a22b-bb59bbf61673 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:45.458804 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de83755-094d-479d-baef-e2a28a6ed631 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:45.459846 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de83755-094d-479d-baef-e2a28a6ed631 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:45.460368 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de83755-094d-479d-baef-e2a28a6ed631 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:45.462365 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 808/1616] 10.222.0.25 () {54 vars in 912 bytes} [Wed Oct 27 01:32:45 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:32:45.469250 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d3ea7-90fe-40d3-8338-f29914a3a132 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:45.470215 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d3ea7-90fe-40d3-8338-f29914a3a132 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:45.470469 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 809/1617] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:32:45 2021] POST /identity/v3/projects => generated 403 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:32:45.470844 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d3ea7-90fe-40d3-8338-f29914a3a132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:45.474349 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac8bc3-06c8-42f1-a22b-bb59bbf61673 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:45.527343 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-a44d3ea7-90fe-40d3-8338-f29914a3a132 None None] MFA Rules not processed for user `bff692322c68420186f2918d380ece98`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:45.529635 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-a44d3ea7-90fe-40d3-8338-f29914a3a132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:45.587037 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac8bc3-06c8-42f1-a22b-bb59bbf61673 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:45.602105 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d4ada-1a74-4343-809b-9de727840bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:45.603204 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d4ada-1a74-4343-809b-9de727840bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:45.603721 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d4ada-1a74-4343-809b-9de727840bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:45.604109 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d4ada-1a74-4343-809b-9de727840bd4 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:45.605264 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d4ada-1a74-4343-809b-9de727840bd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:45.610090 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d4ada-1a74-4343-809b-9de727840bd4 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:45.637742 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 809/1618] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Oct 27 01:32:45 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:32:45.638806 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d3ea7-90fe-40d3-8338-f29914a3a132 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:45.654854 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-a44d3ea7-90fe-40d3-8338-f29914a3a132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:45.677000 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 810/1619] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:32:45 2021] POST /identity/v3/users => generated 308 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:45.678483 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d4ada-1a74-4343-809b-9de727840bd4 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:45.683978 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-0c2d4ada-1a74-4343-809b-9de727840bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:45.698676 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d3ea7-90fe-40d3-8338-f29914a3a132 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:45.722883 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d4ada-1a74-4343-809b-9de727840bd4 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:45.732313 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ee09e-277a-47b9-bc55-89d1178dafea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:45.735025 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ee09e-277a-47b9-bc55-89d1178dafea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:45.736617 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ee09e-277a-47b9-bc55-89d1178dafea admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:45.738548 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ee09e-277a-47b9-bc55-89d1178dafea admin admin] PATH_INFO: `/v3/projects/5a8acae8c13c4c5bb38e15e410e71301` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:45.741245 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ee09e-277a-47b9-bc55-89d1178dafea admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a8acae8c13c4c5bb38e15e410e71301)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:45.743364 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d09e4b-5b05-40f2-82d2-74fc50edda5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:45.746838 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ee09e-277a-47b9-bc55-89d1178dafea admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:45.747089 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d09e4b-5b05-40f2-82d2-74fc50edda5d service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:45.747622 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d09e4b-5b05-40f2-82d2-74fc50edda5d service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:45.748152 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d09e4b-5b05-40f2-82d2-74fc50edda5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:45.766004 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d09e4b-5b05-40f2-82d2-74fc50edda5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:45.768578 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d09e4b-5b05-40f2-82d2-74fc50edda5d service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:45.786989 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 811/1620] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:45 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:45.787822 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d09e4b-5b05-40f2-82d2-74fc50edda5d service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:45.831032 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d09e4b-5b05-40f2-82d2-74fc50edda5d service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:45.836193 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13910f95-d763-4e08-aa49-b6f223a11eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:45.836879 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13910f95-d763-4e08-aa49-b6f223a11eff admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:45.837190 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13910f95-d763-4e08-aa49-b6f223a11eff admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:45.837493 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13910f95-d763-4e08-aa49-b6f223a11eff admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:45.838447 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13910f95-d763-4e08-aa49-b6f223a11eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:45.839935 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13910f95-d763-4e08-aa49-b6f223a11eff admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:45.866835 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 812/1621] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:45 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:45.870746 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13910f95-d763-4e08-aa49-b6f223a11eff admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:45.886592 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13910f95-d763-4e08-aa49-b6f223a11eff admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:45.889170 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-fc9ee09e-277a-47b9-bc55-89d1178dafea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a8acae8c13c4c5bb38e15e410e71301', 'request_id': 'req-fc9ee09e-277a-47b9-bc55-89d1178dafea'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:45.906114 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-fc9ee09e-277a-47b9-bc55-89d1178dafea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a8acae8c13c4c5bb38e15e410e71301', 'request_id': 'req-fc9ee09e-277a-47b9-bc55-89d1178dafea'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:45.928497 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-fc9ee09e-277a-47b9-bc55-89d1178dafea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a8acae8c13c4c5bb38e15e410e71301', 'request_id': 'req-fc9ee09e-277a-47b9-bc55-89d1178dafea'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:45.981197 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-fc9ee09e-277a-47b9-bc55-89d1178dafea admin admin] The token cache is being invalidate because project 5a8acae8c13c4c5bb38e15e410e71301 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:32:45.981526 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-fc9ee09e-277a-47b9-bc55-89d1178dafea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:45.986015 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-fc9ee09e-277a-47b9-bc55-89d1178dafea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:45.997586 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 810/1622] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:32:45 2021] DELETE /identity/v3/projects/5a8acae8c13c4c5bb38e15e410e71301 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:46.006713 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bf150-f50f-4f2b-a17c-3683cb13e363 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:46.006998 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bf150-f50f-4f2b-a17c-3683cb13e363 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:46.007287 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bf150-f50f-4f2b-a17c-3683cb13e363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:46.026124 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818b91c-82ee-4dff-892b-6e9229d57152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:46.027044 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818b91c-82ee-4dff-892b-6e9229d57152 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:46.027328 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818b91c-82ee-4dff-892b-6e9229d57152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:46.027610 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818b91c-82ee-4dff-892b-6e9229d57152 admin admin] PATH_INFO: `/v3/projects/e6837a91eb4a4ea1b6489910bdc4d3ca/users/64c3c40797f14f7f96c2aea2bd5e4d93/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:46.070909 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-226bf150-f50f-4f2b-a17c-3683cb13e363 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:46.072170 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-226bf150-f50f-4f2b-a17c-3683cb13e363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:46.085271 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818b91c-82ee-4dff-892b-6e9229d57152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6837a91eb4a4ea1b6489910bdc4d3ca, user_id=64c3c40797f14f7f96c2aea2bd5e4d93, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:46.088127 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818b91c-82ee-4dff-892b-6e9229d57152 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:46.109177 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 811/1623] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:46.118943 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcb199-aed2-41b3-99a6-389a1060f287 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:46.119261 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcb199-aed2-41b3-99a6-389a1060f287 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:46.119521 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcb199-aed2-41b3-99a6-389a1060f287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:46.129330 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 813/1624] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:32:45 2021] PUT /identity/v3/projects/e6837a91eb4a4ea1b6489910bdc4d3ca/users/64c3c40797f14f7f96c2aea2bd5e4d93/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:46.131132 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818b91c-82ee-4dff-892b-6e9229d57152 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:46.133583 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-9818b91c-82ee-4dff-892b-6e9229d57152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:46.160539 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-6ffcb199-aed2-41b3-99a6-389a1060f287 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:46.164604 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-6ffcb199-aed2-41b3-99a6-389a1060f287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:46.334367 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 812/1625] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:32:46.337443 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffcb199-aed2-41b3-99a6-389a1060f287 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:46.359883 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffcb199-aed2-41b3-99a6-389a1060f287 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:46.360415 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818b91c-82ee-4dff-892b-6e9229d57152 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:46.365692 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97137469-5388-42c0-8608-19a49bb3b4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:46.366371 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97137469-5388-42c0-8608-19a49bb3b4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:46.366656 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97137469-5388-42c0-8608-19a49bb3b4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:46.367103 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97137469-5388-42c0-8608-19a49bb3b4c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:46.367856 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97137469-5388-42c0-8608-19a49bb3b4c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:46.369470 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97137469-5388-42c0-8608-19a49bb3b4c2 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:46.369720 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5c9dd-f26c-44f3-b4fc-fbbe9be32ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:46.370358 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5c9dd-f26c-44f3-b4fc-fbbe9be32ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:46.370648 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5c9dd-f26c-44f3-b4fc-fbbe9be32ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:46.370930 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5c9dd-f26c-44f3-b4fc-fbbe9be32ba1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:46.374087 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5c9dd-f26c-44f3-b4fc-fbbe9be32ba1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:32:46.374340 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5c9dd-f26c-44f3-b4fc-fbbe9be32ba1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:46.381657 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5c9dd-f26c-44f3-b4fc-fbbe9be32ba1 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:46.390806 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 814/1626] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:46 2021] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:46.392013 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97137469-5388-42c0-8608-19a49bb3b4c2 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:46.421743 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 813/1627] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:32:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:32:46.423832 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5c9dd-f26c-44f3-b4fc-fbbe9be32ba1 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:46.441031 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97137469-5388-42c0-8608-19a49bb3b4c2 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:46.459829 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5c9dd-f26c-44f3-b4fc-fbbe9be32ba1 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:46.460902 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9697d-51c9-42bb-ad3e-4b4db98efaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:46.462079 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9697d-51c9-42bb-ad3e-4b4db98efaa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:46.462531 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9697d-51c9-42bb-ad3e-4b4db98efaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:46.462994 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9697d-51c9-42bb-ad3e-4b4db98efaa8 admin admin] PATH_INFO: `/v3/projects/e6837a91eb4a4ea1b6489910bdc4d3ca/users/64c3c40797f14f7f96c2aea2bd5e4d93/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:46.466602 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9697d-51c9-42bb-ad3e-4b4db98efaa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6837a91eb4a4ea1b6489910bdc4d3ca, user_id=64c3c40797f14f7f96c2aea2bd5e4d93, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:46.469584 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9697d-51c9-42bb-ad3e-4b4db98efaa8 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:46.482260 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d4bfe-af86-48ea-94af-1ea8cafcd211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:46.483015 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d4bfe-af86-48ea-94af-1ea8cafcd211 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:46.483243 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d4bfe-af86-48ea-94af-1ea8cafcd211 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:46.483553 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d4bfe-af86-48ea-94af-1ea8cafcd211 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:46.484288 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d4bfe-af86-48ea-94af-1ea8cafcd211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:46.486275 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d4bfe-af86-48ea-94af-1ea8cafcd211 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:46.488012 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 815/1628] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:32:46 2021] PUT /identity/v3/projects/e6837a91eb4a4ea1b6489910bdc4d3ca/users/64c3c40797f14f7f96c2aea2bd5e4d93/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:46.499679 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dce1b3-7630-46ed-a138-b20a317cb9cf None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:46.500135 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dce1b3-7630-46ed-a138-b20a317cb9cf None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:46.500579 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dce1b3-7630-46ed-a138-b20a317cb9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:46.540641 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-e7dce1b3-7630-46ed-a138-b20a317cb9cf None None] MFA Rules not processed for user `64c3c40797f14f7f96c2aea2bd5e4d93`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:46.543989 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-e7dce1b3-7630-46ed-a138-b20a317cb9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:46.565459 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 814/1629] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:32:46 2021] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:46.567552 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d4bfe-af86-48ea-94af-1ea8cafcd211 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:46.650727 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 816/1630] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:46 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:32:46.671377 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dce1b3-7630-46ed-a138-b20a317cb9cf None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:46.671377 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-e7dce1b3-7630-46ed-a138-b20a317cb9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:46.729909 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d4bfe-af86-48ea-94af-1ea8cafcd211 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:46.748817 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2897957-6216-4750-a0bd-b465421895b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:46.751386 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2897957-6216-4750-a0bd-b465421895b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:46.752571 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2897957-6216-4750-a0bd-b465421895b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:46.753943 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2897957-6216-4750-a0bd-b465421895b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:46.754753 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2897957-6216-4750-a0bd-b465421895b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:46.761467 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2897957-6216-4750-a0bd-b465421895b3 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:46.833790 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 815/1631] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:32:46 2021] POST /identity/v3/users => generated 294 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:46.838833 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2897957-6216-4750-a0bd-b465421895b3 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:46.875650 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2897957-6216-4750-a0bd-b465421895b3 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:46.893012 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf40741-25a5-4643-a127-3ecc3a14bd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:46.894329 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf40741-25a5-4643-a127-3ecc3a14bd59 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:46.895947 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf40741-25a5-4643-a127-3ecc3a14bd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:46.896373 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf40741-25a5-4643-a127-3ecc3a14bd59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:46.897291 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf40741-25a5-4643-a127-3ecc3a14bd59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:46.902549 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf40741-25a5-4643-a127-3ecc3a14bd59 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:46.947419 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dce1b3-7630-46ed-a138-b20a317cb9cf None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:46.952198 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 816/1632] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:46 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:46.955709 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf40741-25a5-4643-a127-3ecc3a14bd59 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:47.005120 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf40741-25a5-4643-a127-3ecc3a14bd59 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:47.024306 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eae08a-69ca-424f-bf3d-1fa66c25377f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:47.028973 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eae08a-69ca-424f-bf3d-1fa66c25377f admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:47.031591 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eae08a-69ca-424f-bf3d-1fa66c25377f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:47.032884 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eae08a-69ca-424f-bf3d-1fa66c25377f admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:47.034370 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eae08a-69ca-424f-bf3d-1fa66c25377f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:47.043945 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eae08a-69ca-424f-bf3d-1fa66c25377f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:47.092256 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 817/1633] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:46 2021] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:47.094118 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eae08a-69ca-424f-bf3d-1fa66c25377f admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:47.134590 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eae08a-69ca-424f-bf3d-1fa66c25377f admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:47.156093 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dafce9-e473-40b7-a590-00ee5a80165a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:47.156781 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dafce9-e473-40b7-a590-00ee5a80165a service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:47.157067 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dafce9-e473-40b7-a590-00ee5a80165a service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:47.157348 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dafce9-e473-40b7-a590-00ee5a80165a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:47.165894 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e1796-5c6b-4d78-ae10-4e5bc268f2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:47.166992 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e1796-5c6b-4d78-ae10-4e5bc268f2eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:47.167134 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e1796-5c6b-4d78-ae10-4e5bc268f2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:47.167843 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e1796-5c6b-4d78-ae10-4e5bc268f2eb admin admin] PATH_INFO: `/v3/projects/e0fd61f933bd4fde8904f3a5478e1f2d/users/8a4c2ed569294318b8d0a2bebbb569f8/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:47.243338 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e1796-5c6b-4d78-ae10-4e5bc268f2eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0fd61f933bd4fde8904f3a5478e1f2d, user_id=8a4c2ed569294318b8d0a2bebbb569f8, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:47.246048 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e1796-5c6b-4d78-ae10-4e5bc268f2eb admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:47.287898 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 818/1634] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:32:47 2021] PUT /identity/v3/projects/e0fd61f933bd4fde8904f3a5478e1f2d/users/8a4c2ed569294318b8d0a2bebbb569f8/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:47.302007 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d700eb-6169-4cfe-8a71-b03555263de4 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:47.302304 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d700eb-6169-4cfe-8a71-b03555263de4 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:47.302588 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d700eb-6169-4cfe-8a71-b03555263de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:47.392992 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-98d700eb-6169-4cfe-8a71-b03555263de4 None None] MFA Rules not processed for user `8a4c2ed569294318b8d0a2bebbb569f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:47.394811 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-98d700eb-6169-4cfe-8a71-b03555263de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:47.446466 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dafce9-e473-40b7-a590-00ee5a80165a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:47.448101 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dafce9-e473-40b7-a590-00ee5a80165a service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:47.474896 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 817/1635] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:46 2021] GET /identity/v3/auth/tokens => generated 3490 bytes in 807 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:32:47.530083 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e9b8b-0616-40aa-8438-57aad69afcaf None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:47.530083 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e9b8b-0616-40aa-8438-57aad69afcaf None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:47.530338 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e9b8b-0616-40aa-8438-57aad69afcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:47.570840 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-427e9b8b-0616-40aa-8438-57aad69afcaf None None] MFA Rules not processed for user `714ca1b794144b1eabeed1ebdaa27669`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:47.583477 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-427e9b8b-0616-40aa-8438-57aad69afcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:47.590668 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 819/1636] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:47 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:47.593017 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d700eb-6169-4cfe-8a71-b03555263de4 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:47.845673 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 818/1637] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:47 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:32:47.866218 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d700eb-6169-4cfe-8a71-b03555263de4 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:47.898670 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fd412-8c2e-45f2-ad1e-492c76ad1a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:47.900348 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fd412-8c2e-45f2-ad1e-492c76ad1a74 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:47.900864 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fd412-8c2e-45f2-ad1e-492c76ad1a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:47.901299 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fd412-8c2e-45f2-ad1e-492c76ad1a74 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:47.902264 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0fd412-8c2e-45f2-ad1e-492c76ad1a74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:47.904627 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0fd412-8c2e-45f2-ad1e-492c76ad1a74 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:47.976998 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 820/1638] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:32:47 2021] POST /identity/v3/projects => generated 387 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:47.981301 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e9b8b-0616-40aa-8438-57aad69afcaf None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:48.025870 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e9b8b-0616-40aa-8438-57aad69afcaf None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:48.122180 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fd412-8c2e-45f2-ad1e-492c76ad1a74 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:48.265006 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3659f-08d4-4176-8092-fbcaed9fa6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:48.265952 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3659f-08d4-4176-8092-fbcaed9fa6be admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:48.266245 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3659f-08d4-4176-8092-fbcaed9fa6be admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:48.266534 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3659f-08d4-4176-8092-fbcaed9fa6be admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:48.273126 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3659f-08d4-4176-8092-fbcaed9fa6be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:48.276938 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3659f-08d4-4176-8092-fbcaed9fa6be admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:48.323512 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fd412-8c2e-45f2-ad1e-492c76ad1a74 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:48.329935 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c4aec-9887-4dc4-8d99-faa9f8f4a5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:48.331030 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c4aec-9887-4dc4-8d99-faa9f8f4a5c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:48.331452 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c4aec-9887-4dc4-8d99-faa9f8f4a5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:48.332061 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c4aec-9887-4dc4-8d99-faa9f8f4a5c5 admin admin] PATH_INFO: `/v3/users/b08e423ea4b743d98311d0dfc8075635` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:48.333544 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c4aec-9887-4dc4-8d99-faa9f8f4a5c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b08e423ea4b743d98311d0dfc8075635)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:48.339210 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c4aec-9887-4dc4-8d99-faa9f8f4a5c5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:48.385580 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 819/1639] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:32:47 2021] POST /identity/v3/users => generated 300 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:48.391480 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3659f-08d4-4176-8092-fbcaed9fa6be admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:48.424048 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3659f-08d4-4176-8092-fbcaed9fa6be admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:48.440240 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd2769-7449-4045-9937-9d977344e158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:48.441515 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd2769-7449-4045-9937-9d977344e158 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:48.442378 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd2769-7449-4045-9937-9d977344e158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:48.445061 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd2769-7449-4045-9937-9d977344e158 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:48.445894 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd2769-7449-4045-9937-9d977344e158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:48.451570 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd2769-7449-4045-9937-9d977344e158 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:48.457512 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-631c4aec-9887-4dc4-8d99-faa9f8f4a5c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b08e423ea4b743d98311d0dfc8075635'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:48.475129 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-631c4aec-9887-4dc4-8d99-faa9f8f4a5c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b08e423ea4b743d98311d0dfc8075635'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:48.487532 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 820/1640] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:48 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:48.489427 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd2769-7449-4045-9937-9d977344e158 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:48.508711 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-631c4aec-9887-4dc4-8d99-faa9f8f4a5c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b08e423ea4b743d98311d0dfc8075635'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:48.510965 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-631c4aec-9887-4dc4-8d99-faa9f8f4a5c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b08e423ea4b743d98311d0dfc8075635'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:48.521591 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd2769-7449-4045-9937-9d977344e158 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:48.534549 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-631c4aec-9887-4dc4-8d99-faa9f8f4a5c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b08e423ea4b743d98311d0dfc8075635'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:48.547716 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b39a3a-57b7-4bae-855e-3aa30c7c68f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:48.548635 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b39a3a-57b7-4bae-855e-3aa30c7c68f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:48.548924 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b39a3a-57b7-4bae-855e-3aa30c7c68f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:48.549207 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b39a3a-57b7-4bae-855e-3aa30c7c68f5 admin admin] PATH_INFO: `/v3/projects/1428ee77d0df497f88965813dea97908/users/d4d3c2cda07c425481535d3c60f29cc0/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:48.557625 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 821/1641] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:32:48 2021] DELETE /identity/v3/users/b08e423ea4b743d98311d0dfc8075635 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:48.562508 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fed5d-7f8d-4b0d-be6d-301a7f5edf9d None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:48.563719 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fed5d-7f8d-4b0d-be6d-301a7f5edf9d None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:48.564231 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fed5d-7f8d-4b0d-be6d-301a7f5edf9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:48.589682 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-c37fed5d-7f8d-4b0d-be6d-301a7f5edf9d None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:48.591482 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-c37fed5d-7f8d-4b0d-be6d-301a7f5edf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:48.619585 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b39a3a-57b7-4bae-855e-3aa30c7c68f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1428ee77d0df497f88965813dea97908, user_id=d4d3c2cda07c425481535d3c60f29cc0, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:48.625427 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b39a3a-57b7-4bae-855e-3aa30c7c68f5 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:48.679844 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 821/1642] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:32:48 2021] PUT /identity/v3/projects/1428ee77d0df497f88965813dea97908/users/d4d3c2cda07c425481535d3c60f29cc0/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:48.684547 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b39a3a-57b7-4bae-855e-3aa30c7c68f5 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:48.691485 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-73b39a3a-57b7-4bae-855e-3aa30c7c68f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:48.698325 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 822/1643] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:32:48.919817 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b39a3a-57b7-4bae-855e-3aa30c7c68f5 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:48.950796 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29376fe0-882c-4e9c-b108-87130ab5ad04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:48.958443 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29376fe0-882c-4e9c-b108-87130ab5ad04 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:48.958735 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29376fe0-882c-4e9c-b108-87130ab5ad04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:48.959239 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29376fe0-882c-4e9c-b108-87130ab5ad04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:48.960188 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29376fe0-882c-4e9c-b108-87130ab5ad04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:48.962292 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29376fe0-882c-4e9c-b108-87130ab5ad04 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:49.003199 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 822/1644] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:48 2021] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:32:49.007706 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fed5d-7f8d-4b0d-be6d-301a7f5edf9d None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:49.021229 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29376fe0-882c-4e9c-b108-87130ab5ad04 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:49.023651 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-29376fe0-882c-4e9c-b108-87130ab5ad04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:49.026609 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fed5d-7f8d-4b0d-be6d-301a7f5edf9d None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:49.070576 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295ab70-5779-4714-962f-eae34cf21731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:49.077631 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295ab70-5779-4714-962f-eae34cf21731 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:49.080133 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295ab70-5779-4714-962f-eae34cf21731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:49.080443 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295ab70-5779-4714-962f-eae34cf21731 admin admin] PATH_INFO: `/v3/projects/1428ee77d0df497f88965813dea97908/users/d4d3c2cda07c425481535d3c60f29cc0/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:49.100486 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295ab70-5779-4714-962f-eae34cf21731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1428ee77d0df497f88965813dea97908, user_id=d4d3c2cda07c425481535d3c60f29cc0, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:49.115138 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295ab70-5779-4714-962f-eae34cf21731 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:49.178887 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29376fe0-882c-4e9c-b108-87130ab5ad04 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:49.182632 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 823/1645] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:32:49 2021] PUT /identity/v3/projects/1428ee77d0df497f88965813dea97908/users/d4d3c2cda07c425481535d3c60f29cc0/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:49.251990 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce2f71-fc0c-456b-aa0d-5c2566889de6 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:49.252348 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce2f71-fc0c-456b-aa0d-5c2566889de6 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:49.252771 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce2f71-fc0c-456b-aa0d-5c2566889de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:49.359313 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e4228-48f3-4e3f-b9de-5bda19626a78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:49.364170 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e4228-48f3-4e3f-b9de-5bda19626a78 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:49.364484 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e4228-48f3-4e3f-b9de-5bda19626a78 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:49.364772 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e4228-48f3-4e3f-b9de-5bda19626a78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:49.392634 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-93ce2f71-fc0c-456b-aa0d-5c2566889de6 None None] MFA Rules not processed for user `d4d3c2cda07c425481535d3c60f29cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:49.395509 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-93ce2f71-fc0c-456b-aa0d-5c2566889de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:49.496161 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e4228-48f3-4e3f-b9de-5bda19626a78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:49.499012 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e4228-48f3-4e3f-b9de-5bda19626a78 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:49.536243 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 823/1646] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:32:49.615036 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 824/1647] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:49 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:32:49.624963 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e4228-48f3-4e3f-b9de-5bda19626a78 service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:49.626459 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-0a4e4228-48f3-4e3f-b9de-5bda19626a78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:49.699638 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e217eb-558e-42fe-b0ea-cee7c74a73c3 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:49.699975 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e217eb-558e-42fe-b0ea-cee7c74a73c3 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:49.700257 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e217eb-558e-42fe-b0ea-cee7c74a73c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:49.766580 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-64e217eb-558e-42fe-b0ea-cee7c74a73c3 None None] MFA Rules not processed for user `b164b9dd32884e99b0b22eb7c50bdda2`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:49.779886 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-64e217eb-558e-42fe-b0ea-cee7c74a73c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:49.831888 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e4228-48f3-4e3f-b9de-5bda19626a78 service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:49.839435 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a9901-51dd-4fc9-884c-cd9c358ae631 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:49.840562 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a9901-51dd-4fc9-884c-cd9c358ae631 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:49.840853 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a9901-51dd-4fc9-884c-cd9c358ae631 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:49.841181 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a9901-51dd-4fc9-884c-cd9c358ae631 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:49.918508 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a9901-51dd-4fc9-884c-cd9c358ae631 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:49.919872 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a9901-51dd-4fc9-884c-cd9c358ae631 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:49.965044 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 824/1648] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:49 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:49.985303 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 825/1649] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:49 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:32:50.000412 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a9901-51dd-4fc9-884c-cd9c358ae631 service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:50.002278 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-f77a9901-51dd-4fc9-884c-cd9c358ae631 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:50.026921 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d03ef-ba29-434d-accd-016a0527460f None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:50.026921 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d03ef-ba29-434d-accd-016a0527460f None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:50.026921 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d03ef-ba29-434d-accd-016a0527460f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:50.051771 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-9e8d03ef-ba29-434d-accd-016a0527460f None None] MFA Rules not processed for user `56895529b11b4236bccb5956a8ccb5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:50.053010 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-9e8d03ef-ba29-434d-accd-016a0527460f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:50.247349 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a9901-51dd-4fc9-884c-cd9c358ae631 service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:50.289750 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c606fe8-5d2d-4805-a344-03b250b62e26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:50.290426 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c606fe8-5d2d-4805-a344-03b250b62e26 service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:50.290709 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c606fe8-5d2d-4805-a344-03b250b62e26 service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:50.290986 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c606fe8-5d2d-4805-a344-03b250b62e26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:50.353297 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c606fe8-5d2d-4805-a344-03b250b62e26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:50.359533 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c606fe8-5d2d-4805-a344-03b250b62e26 service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:50.363734 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 826/1650] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Oct 27 01:32:50 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 27 01:32:50.405648 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 825/1651] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:49 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:50.510931 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d03ef-ba29-434d-accd-016a0527460f None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:50.514758 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-9e8d03ef-ba29-434d-accd-016a0527460f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:50.575356 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d03ef-ba29-434d-accd-016a0527460f None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:50.610570 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af1e4a-5220-450a-9bfd-dee892232070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:50.617072 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af1e4a-5220-450a-9bfd-dee892232070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:50.617374 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af1e4a-5220-450a-9bfd-dee892232070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:50.621093 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af1e4a-5220-450a-9bfd-dee892232070 admin admin] PATH_INFO: `/v3/users/6483aca4f25c4651add6ab3ba28504a9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:50.624459 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af1e4a-5220-450a-9bfd-dee892232070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6483aca4f25c4651add6ab3ba28504a9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:50.627163 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af1e4a-5220-450a-9bfd-dee892232070 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:50.732946 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c606fe8-5d2d-4805-a344-03b250b62e26 service nova] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:50.734436 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-5c606fe8-5d2d-4805-a344-03b250b62e26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:50.760392 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-04af1e4a-5220-450a-9bfd-dee892232070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6483aca4f25c4651add6ab3ba28504a9'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:50.770057 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-04af1e4a-5220-450a-9bfd-dee892232070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6483aca4f25c4651add6ab3ba28504a9'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:50.781393 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-04af1e4a-5220-450a-9bfd-dee892232070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6483aca4f25c4651add6ab3ba28504a9'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:50.782941 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-04af1e4a-5220-450a-9bfd-dee892232070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6483aca4f25c4651add6ab3ba28504a9'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:50.812069 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-04af1e4a-5220-450a-9bfd-dee892232070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6483aca4f25c4651add6ab3ba28504a9'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:50.834360 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 827/1652] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:32:50 2021] DELETE /identity/v3/users/6483aca4f25c4651add6ab3ba28504a9 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:50.836156 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d10ec-c029-4610-9bd0-fb6df28c1ebe None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:50.837700 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d10ec-c029-4610-9bd0-fb6df28c1ebe None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:50.839081 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d10ec-c029-4610-9bd0-fb6df28c1ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:50.884793 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-015d10ec-c029-4610-9bd0-fb6df28c1ebe None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:50.886717 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-015d10ec-c029-4610-9bd0-fb6df28c1ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:51.043227 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c606fe8-5d2d-4805-a344-03b250b62e26 service nova] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:51.109537 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 828/1653] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:51.189361 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d10ec-c029-4610-9bd0-fb6df28c1ebe None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:51.192352 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-015d10ec-c029-4610-9bd0-fb6df28c1ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:51.226843 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff9b1f-e419-4319-a69a-0680872082f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f386f358fdb241f5a529a2cf3d839201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:51.228172 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff9b1f-e419-4319-a69a-0680872082f7 service swift] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:51.228815 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff9b1f-e419-4319-a69a-0680872082f7 service swift] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:51.229859 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff9b1f-e419-4319-a69a-0680872082f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:51.235070 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-55ff9b1f-e419-4319-a69a-0680872082f7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:51.342753 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d10ec-c029-4610-9bd0-fb6df28c1ebe None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:51.356221 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07ca87-f8b6-4cf6-87cb-f1d8299e1ac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:51.357030 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07ca87-f8b6-4cf6-87cb-f1d8299e1ac0 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:51.360334 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07ca87-f8b6-4cf6-87cb-f1d8299e1ac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:51.361358 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07ca87-f8b6-4cf6-87cb-f1d8299e1ac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:51.391558 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff9b1f-e419-4319-a69a-0680872082f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:51.398587 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff9b1f-e419-4319-a69a-0680872082f7 service swift] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:51.400853 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07ca87-f8b6-4cf6-87cb-f1d8299e1ac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:51.403178 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07ca87-f8b6-4cf6-87cb-f1d8299e1ac0 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:51.424062 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 826/1654] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Oct 27 01:32:50 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 691 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:32:51.478270 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 829/1655] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:32:51.506738 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff9b1f-e419-4319-a69a-0680872082f7 service swift] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:51.508519 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-55ff9b1f-e419-4319-a69a-0680872082f7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:51.556429 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff9b1f-e419-4319-a69a-0680872082f7 service swift] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:51.577858 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7592f-1c90-4a80-8df9-634991b6d52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:51.579955 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7592f-1c90-4a80-8df9-634991b6d52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:51.585197 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7592f-1c90-4a80-8df9-634991b6d52a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:51.586947 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7592f-1c90-4a80-8df9-634991b6d52a admin admin] PATH_INFO: `/v3/projects/583382d05e7d478c8dc5d59aefea7c11` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:51.591555 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7592f-1c90-4a80-8df9-634991b6d52a admin admin] RBAC: Authorizing `identity:delete_project(project_id=583382d05e7d478c8dc5d59aefea7c11)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:51.595258 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7592f-1c90-4a80-8df9-634991b6d52a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:51.761614 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-34d7592f-1c90-4a80-8df9-634991b6d52a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '583382d05e7d478c8dc5d59aefea7c11', 'request_id': 'req-34d7592f-1c90-4a80-8df9-634991b6d52a'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:51.786348 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-34d7592f-1c90-4a80-8df9-634991b6d52a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '583382d05e7d478c8dc5d59aefea7c11', 'request_id': 'req-34d7592f-1c90-4a80-8df9-634991b6d52a'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:51.805884 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-34d7592f-1c90-4a80-8df9-634991b6d52a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '583382d05e7d478c8dc5d59aefea7c11', 'request_id': 'req-34d7592f-1c90-4a80-8df9-634991b6d52a'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:51.841153 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-34d7592f-1c90-4a80-8df9-634991b6d52a admin admin] The token cache is being invalidate because project 583382d05e7d478c8dc5d59aefea7c11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:32:51.841599 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-34d7592f-1c90-4a80-8df9-634991b6d52a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:51.843068 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-34d7592f-1c90-4a80-8df9-634991b6d52a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:51.849780 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07ca87-f8b6-4cf6-87cb-f1d8299e1ac0 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:51.859743 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 827/1656] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:32:51 2021] DELETE /identity/v3/projects/583382d05e7d478c8dc5d59aefea7c11 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:51.865228 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07ca87-f8b6-4cf6-87cb-f1d8299e1ac0 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:52.145435 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77b336-3c07-4237-90ae-934000a8599b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:52.150844 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77b336-3c07-4237-90ae-934000a8599b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:52.152189 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77b336-3c07-4237-90ae-934000a8599b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:52.155003 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77b336-3c07-4237-90ae-934000a8599b admin admin] PATH_INFO: `/v3/users/64c3c40797f14f7f96c2aea2bd5e4d93` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:52.158024 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7592f-1c90-4a80-8df9-634991b6d52a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:52.159658 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-34d7592f-1c90-4a80-8df9-634991b6d52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:52.165427 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e77b336-3c07-4237-90ae-934000a8599b admin admin] RBAC: Authorizing `identity:delete_user(user_id=64c3c40797f14f7f96c2aea2bd5e4d93)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:52.173438 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7592f-1c90-4a80-8df9-634991b6d52a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:52.175209 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e77b336-3c07-4237-90ae-934000a8599b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:52.180712 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5eb60-9b91-420f-901d-68772f844565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:52.182414 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5eb60-9b91-420f-901d-68772f844565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:52.183050 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5eb60-9b91-420f-901d-68772f844565 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:52.183658 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5eb60-9b91-420f-901d-68772f844565 admin admin] PATH_INFO: `/v3/users/8a4c2ed569294318b8d0a2bebbb569f8` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:52.185350 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5eb60-9b91-420f-901d-68772f844565 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a4c2ed569294318b8d0a2bebbb569f8)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:52.188005 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5eb60-9b91-420f-901d-68772f844565 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:52.291586 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-dfa5eb60-9b91-420f-901d-68772f844565 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a4c2ed569294318b8d0a2bebbb569f8'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:52.323257 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-dfa5eb60-9b91-420f-901d-68772f844565 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a4c2ed569294318b8d0a2bebbb569f8'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:52.327095 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-dfa5eb60-9b91-420f-901d-68772f844565 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a4c2ed569294318b8d0a2bebbb569f8'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:52.346526 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-dfa5eb60-9b91-420f-901d-68772f844565 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a4c2ed569294318b8d0a2bebbb569f8'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:52.359829 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-dfa5eb60-9b91-420f-901d-68772f844565 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a4c2ed569294318b8d0a2bebbb569f8'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:52.373285 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 828/1657] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:32:52 2021] DELETE /identity/v3/users/8a4c2ed569294318b8d0a2bebbb569f8 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:32:52.378024 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b619d-9bc8-486b-98f0-ee06ee8172e5 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:52.379002 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b619d-9bc8-486b-98f0-ee06ee8172e5 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:52.379292 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b619d-9bc8-486b-98f0-ee06ee8172e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:52.414826 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-895b619d-9bc8-486b-98f0-ee06ee8172e5 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:52.416747 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-895b619d-9bc8-486b-98f0-ee06ee8172e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:52.417690 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-1e77b336-3c07-4237-90ae-934000a8599b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64c3c40797f14f7f96c2aea2bd5e4d93'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:52.432757 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-1e77b336-3c07-4237-90ae-934000a8599b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64c3c40797f14f7f96c2aea2bd5e4d93'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:52.444777 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-1e77b336-3c07-4237-90ae-934000a8599b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64c3c40797f14f7f96c2aea2bd5e4d93'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:52.447013 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-1e77b336-3c07-4237-90ae-934000a8599b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64c3c40797f14f7f96c2aea2bd5e4d93'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:52.461569 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-1e77b336-3c07-4237-90ae-934000a8599b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64c3c40797f14f7f96c2aea2bd5e4d93'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:52.475131 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 830/1658] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:32:51 2021] DELETE /identity/v3/users/64c3c40797f14f7f96c2aea2bd5e4d93 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:32:52.546047 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 829/1659] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:52.593210 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77b336-3c07-4237-90ae-934000a8599b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:52.594785 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-1e77b336-3c07-4237-90ae-934000a8599b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:52.791551 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77b336-3c07-4237-90ae-934000a8599b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:52.805437 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b370b1-2919-464b-8156-418bee3ff9e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:52.806827 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b370b1-2919-464b-8156-418bee3ff9e7 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:52.807322 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b370b1-2919-464b-8156-418bee3ff9e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:52.807804 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b370b1-2919-464b-8156-418bee3ff9e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:52.971381 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b370b1-2919-464b-8156-418bee3ff9e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:52.975773 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b370b1-2919-464b-8156-418bee3ff9e7 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:53.002980 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 831/1660] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:53.517222 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee60526-925f-4580-9863-f67f19263698 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:53.518320 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee60526-925f-4580-9863-f67f19263698 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:53.518830 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee60526-925f-4580-9863-f67f19263698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:53.557938 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-6ee60526-925f-4580-9863-f67f19263698 None None] MFA Rules not processed for user `bff692322c68420186f2918d380ece98`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:53.560367 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-6ee60526-925f-4580-9863-f67f19263698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:53.582030 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 830/1661] 10.222.0.15 () {58 vars in 1015 bytes} [Wed Oct 27 01:32:53 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:53.805046 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b370b1-2919-464b-8156-418bee3ff9e7 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:53.819750 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b370b1-2919-464b-8156-418bee3ff9e7 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:53.836257 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080cf74-7b56-4cc5-93c1-c5d1ab0b42c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:53.838687 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080cf74-7b56-4cc5-93c1-c5d1ab0b42c0 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:53.841783 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080cf74-7b56-4cc5-93c1-c5d1ab0b42c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:53.847567 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080cf74-7b56-4cc5-93c1-c5d1ab0b42c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:53.877390 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5080cf74-7b56-4cc5-93c1-c5d1ab0b42c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:53.879222 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5080cf74-7b56-4cc5-93c1-c5d1ab0b42c0 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:53.916832 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 832/1662] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:53 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:55.395506 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee60526-925f-4580-9863-f67f19263698 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:55.397883 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-6ee60526-925f-4580-9863-f67f19263698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:55.437711 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee60526-925f-4580-9863-f67f19263698 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:55.446869 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee579d-373b-4cad-be5b-26c422ae8b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:55.460281 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee579d-373b-4cad-be5b-26c422ae8b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:55.461537 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee579d-373b-4cad-be5b-26c422ae8b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:55.462111 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee579d-373b-4cad-be5b-26c422ae8b2f admin admin] PATH_INFO: `/v3/projects/cbf6e37df5cf44f59505c54cf84517cb` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:55.475603 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee579d-373b-4cad-be5b-26c422ae8b2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf6e37df5cf44f59505c54cf84517cb)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:55.478343 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee579d-373b-4cad-be5b-26c422ae8b2f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:55.491068 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080cf74-7b56-4cc5-93c1-c5d1ab0b42c0 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:55.492576 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-5080cf74-7b56-4cc5-93c1-c5d1ab0b42c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:55.543040 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080cf74-7b56-4cc5-93c1-c5d1ab0b42c0 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:55.569992 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2747de9-a354-4e63-8383-97c87f082dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:55.577764 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2747de9-a354-4e63-8383-97c87f082dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:55.578059 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2747de9-a354-4e63-8383-97c87f082dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:55.585737 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2747de9-a354-4e63-8383-97c87f082dcb admin admin] PATH_INFO: `/v3/projects/e6837a91eb4a4ea1b6489910bdc4d3ca` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:55.606552 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2747de9-a354-4e63-8383-97c87f082dcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6837a91eb4a4ea1b6489910bdc4d3ca)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:55.612857 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2747de9-a354-4e63-8383-97c87f082dcb admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:55.757215 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-c8ee579d-373b-4cad-be5b-26c422ae8b2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf6e37df5cf44f59505c54cf84517cb', 'request_id': 'req-c8ee579d-373b-4cad-be5b-26c422ae8b2f'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:55.780592 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-c8ee579d-373b-4cad-be5b-26c422ae8b2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf6e37df5cf44f59505c54cf84517cb', 'request_id': 'req-c8ee579d-373b-4cad-be5b-26c422ae8b2f'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:55.803706 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-d2747de9-a354-4e63-8383-97c87f082dcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6837a91eb4a4ea1b6489910bdc4d3ca', 'request_id': 'req-d2747de9-a354-4e63-8383-97c87f082dcb'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:55.817711 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-d2747de9-a354-4e63-8383-97c87f082dcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6837a91eb4a4ea1b6489910bdc4d3ca', 'request_id': 'req-d2747de9-a354-4e63-8383-97c87f082dcb'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:55.828244 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-c8ee579d-373b-4cad-be5b-26c422ae8b2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf6e37df5cf44f59505c54cf84517cb', 'request_id': 'req-c8ee579d-373b-4cad-be5b-26c422ae8b2f'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:55.836714 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-d2747de9-a354-4e63-8383-97c87f082dcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6837a91eb4a4ea1b6489910bdc4d3ca', 'request_id': 'req-d2747de9-a354-4e63-8383-97c87f082dcb'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:55.864178 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-d2747de9-a354-4e63-8383-97c87f082dcb admin admin] The token cache is being invalidate because project e6837a91eb4a4ea1b6489910bdc4d3ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:32:55.865931 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-d2747de9-a354-4e63-8383-97c87f082dcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:55.868898 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-d2747de9-a354-4e63-8383-97c87f082dcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:55.873083 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-c8ee579d-373b-4cad-be5b-26c422ae8b2f admin admin] The token cache is being invalidate because project cbf6e37df5cf44f59505c54cf84517cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:32:55.873322 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 833/1663] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:32:55 2021] DELETE /identity/v3/projects/e6837a91eb4a4ea1b6489910bdc4d3ca => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:55.876559 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-c8ee579d-373b-4cad-be5b-26c422ae8b2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:55.880085 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a283ce-9e9d-45e2-9ff8-5df5080f7b02 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:55.880271 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-c8ee579d-373b-4cad-be5b-26c422ae8b2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:55.881885 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a283ce-9e9d-45e2-9ff8-5df5080f7b02 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:55.882952 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a283ce-9e9d-45e2-9ff8-5df5080f7b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:55.885122 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 831/1664] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:32:55 2021] DELETE /identity/v3/projects/cbf6e37df5cf44f59505c54cf84517cb => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:55.895002 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02522734-2b68-4c4b-a94f-761b3bdb1bf9 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:55.895468 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02522734-2b68-4c4b-a94f-761b3bdb1bf9 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:55.895903 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02522734-2b68-4c4b-a94f-761b3bdb1bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:55.933773 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-70a283ce-9e9d-45e2-9ff8-5df5080f7b02 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:55.936700 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-70a283ce-9e9d-45e2-9ff8-5df5080f7b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:55.958794 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-02522734-2b68-4c4b-a94f-761b3bdb1bf9 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:55.960273 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-02522734-2b68-4c4b-a94f-761b3bdb1bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:56.120568 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 834/1665] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:56.122585 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3263090-2917-4638-b37c-50334e59b8e3 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:56.125664 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3263090-2917-4638-b37c-50334e59b8e3 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:56.126091 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3263090-2917-4638-b37c-50334e59b8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:56.139741 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 832/1666] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:56.148829 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f37ee9-fefb-4fd0-a9c0-99f7fde1adac None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:56.149527 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f37ee9-fefb-4fd0-a9c0-99f7fde1adac None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:56.150149 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f37ee9-fefb-4fd0-a9c0-99f7fde1adac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:56.169223 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-d3263090-2917-4638-b37c-50334e59b8e3 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:56.171022 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-d3263090-2917-4638-b37c-50334e59b8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:56.188284 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 835/1667] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:56.190706 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3263090-2917-4638-b37c-50334e59b8e3 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:56.205235 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3263090-2917-4638-b37c-50334e59b8e3 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:56.205497 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-d4f37ee9-fefb-4fd0-a9c0-99f7fde1adac None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:56.207811 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-d4f37ee9-fefb-4fd0-a9c0-99f7fde1adac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:56.236525 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 833/1668] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:56.240766 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f37ee9-fefb-4fd0-a9c0-99f7fde1adac None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:56.265951 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f37ee9-fefb-4fd0-a9c0-99f7fde1adac None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:56.273387 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8d2f0-29cb-4e5d-9ddf-142f81e771b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:56.274132 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8d2f0-29cb-4e5d-9ddf-142f81e771b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:56.274454 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8d2f0-29cb-4e5d-9ddf-142f81e771b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:56.274741 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8d2f0-29cb-4e5d-9ddf-142f81e771b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:56.275503 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8d2f0-29cb-4e5d-9ddf-142f81e771b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:32:56.275814 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8d2f0-29cb-4e5d-9ddf-142f81e771b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:56.277432 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8d2f0-29cb-4e5d-9ddf-142f81e771b2 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:56.280326 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed5bfd-c49b-4d71-83f5-65174116976d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:56.281387 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed5bfd-c49b-4d71-83f5-65174116976d admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:56.283110 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed5bfd-c49b-4d71-83f5-65174116976d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:56.283509 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed5bfd-c49b-4d71-83f5-65174116976d admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:56.285503 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed5bfd-c49b-4d71-83f5-65174116976d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:32:56.286128 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed5bfd-c49b-4d71-83f5-65174116976d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:56.288144 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed5bfd-c49b-4d71-83f5-65174116976d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:56.309755 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 834/1669] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:32:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:32:56.329621 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed5bfd-c49b-4d71-83f5-65174116976d admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:56.345065 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 836/1670] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:32:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:32:56.346052 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8d2f0-29cb-4e5d-9ddf-142f81e771b2 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:56.352560 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-b6d8d2f0-29cb-4e5d-9ddf-142f81e771b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:56.375120 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed5bfd-c49b-4d71-83f5-65174116976d admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:56.390838 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d2f1d-6aeb-4a31-b730-aa3c39b0c94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:56.391689 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d2f1d-6aeb-4a31-b730-aa3c39b0c94a admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:56.392086 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d2f1d-6aeb-4a31-b730-aa3c39b0c94a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:56.393240 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d2f1d-6aeb-4a31-b730-aa3c39b0c94a admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:56.395133 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d2f1d-6aeb-4a31-b730-aa3c39b0c94a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:56.398388 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d2f1d-6aeb-4a31-b730-aa3c39b0c94a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:56.401384 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8d2f0-29cb-4e5d-9ddf-142f81e771b2 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:56.413470 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa1f48-dced-4c0c-a9ba-3c6037890072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:56.414570 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa1f48-dced-4c0c-a9ba-3c6037890072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:56.415183 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa1f48-dced-4c0c-a9ba-3c6037890072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:56.415602 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa1f48-dced-4c0c-a9ba-3c6037890072 admin admin] PATH_INFO: `/v3/projects/e0fd61f933bd4fde8904f3a5478e1f2d` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:56.417749 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa1f48-dced-4c0c-a9ba-3c6037890072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0fd61f933bd4fde8904f3a5478e1f2d)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:56.422885 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa1f48-dced-4c0c-a9ba-3c6037890072 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:56.560260 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 835/1671] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:32:56 2021] POST /identity/v3/projects => generated 405 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:56.569375 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d2f1d-6aeb-4a31-b730-aa3c39b0c94a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:56.594983 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-38aa1f48-dced-4c0c-a9ba-3c6037890072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0fd61f933bd4fde8904f3a5478e1f2d', 'request_id': 'req-38aa1f48-dced-4c0c-a9ba-3c6037890072'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:56.619308 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-38aa1f48-dced-4c0c-a9ba-3c6037890072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0fd61f933bd4fde8904f3a5478e1f2d', 'request_id': 'req-38aa1f48-dced-4c0c-a9ba-3c6037890072'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:56.642028 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-38aa1f48-dced-4c0c-a9ba-3c6037890072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0fd61f933bd4fde8904f3a5478e1f2d', 'request_id': 'req-38aa1f48-dced-4c0c-a9ba-3c6037890072'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:56.684266 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-38aa1f48-dced-4c0c-a9ba-3c6037890072 admin admin] The token cache is being invalidate because project e0fd61f933bd4fde8904f3a5478e1f2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:32:56.693192 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-38aa1f48-dced-4c0c-a9ba-3c6037890072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:56.694368 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-38aa1f48-dced-4c0c-a9ba-3c6037890072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:56.699019 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 837/1672] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:32:56 2021] DELETE /identity/v3/projects/e0fd61f933bd4fde8904f3a5478e1f2d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:56.700029 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa1f48-dced-4c0c-a9ba-3c6037890072 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:56.707238 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-38aa1f48-dced-4c0c-a9ba-3c6037890072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:56.869905 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d2f1d-6aeb-4a31-b730-aa3c39b0c94a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:56.884630 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384b3e4-39b7-46b7-ba41-fdff75a05d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:56.885630 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384b3e4-39b7-46b7-ba41-fdff75a05d91 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:56.886075 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384b3e4-39b7-46b7-ba41-fdff75a05d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:56.886506 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384b3e4-39b7-46b7-ba41-fdff75a05d91 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:56.887470 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384b3e4-39b7-46b7-ba41-fdff75a05d91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:56.890045 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384b3e4-39b7-46b7-ba41-fdff75a05d91 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:56.969037 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 836/1673] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:32:56 2021] POST /identity/v3/projects => generated 367 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:56.972136 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384b3e4-39b7-46b7-ba41-fdff75a05d91 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:56.978890 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-6384b3e4-39b7-46b7-ba41-fdff75a05d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:57.000031 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa1f48-dced-4c0c-a9ba-3c6037890072 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:57.159953 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384b3e4-39b7-46b7-ba41-fdff75a05d91 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:57.171908 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a68de-b775-46f9-ad73-6f4223f45906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:57.172925 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a68de-b775-46f9-ad73-6f4223f45906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:57.173450 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a68de-b775-46f9-ad73-6f4223f45906 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:57.174309 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a68de-b775-46f9-ad73-6f4223f45906 admin admin] PATH_INFO: `/v3/users/d4d3c2cda07c425481535d3c60f29cc0` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:57.182360 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a68de-b775-46f9-ad73-6f4223f45906 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4d3c2cda07c425481535d3c60f29cc0)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:57.184611 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a68de-b775-46f9-ad73-6f4223f45906 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:57.243579 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d218b5e-4d56-4435-b83e-f06f9c9d9fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:57.244662 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d218b5e-4d56-4435-b83e-f06f9c9d9fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:57.245242 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d218b5e-4d56-4435-b83e-f06f9c9d9fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:57.245781 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d218b5e-4d56-4435-b83e-f06f9c9d9fc5 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:57.246827 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d218b5e-4d56-4435-b83e-f06f9c9d9fc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:57.249774 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d218b5e-4d56-4435-b83e-f06f9c9d9fc5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:57.291675 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 838/1674] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:32:56 2021] POST /identity/v3/users => generated 303 bytes in 592 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:57.292819 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d218b5e-4d56-4435-b83e-f06f9c9d9fc5 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:57.299031 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-3d218b5e-4d56-4435-b83e-f06f9c9d9fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:57.307110 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-730a68de-b775-46f9-ad73-6f4223f45906 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4d3c2cda07c425481535d3c60f29cc0'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:57.334353 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-730a68de-b775-46f9-ad73-6f4223f45906 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4d3c2cda07c425481535d3c60f29cc0'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:57.338119 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-730a68de-b775-46f9-ad73-6f4223f45906 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4d3c2cda07c425481535d3c60f29cc0'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:57.340463 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d218b5e-4d56-4435-b83e-f06f9c9d9fc5 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:57.357381 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48009fb-235c-4fd1-b82e-11a6758c8dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:57.358113 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48009fb-235c-4fd1-b82e-11a6758c8dfc admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:57.358445 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48009fb-235c-4fd1-b82e-11a6758c8dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:57.358735 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48009fb-235c-4fd1-b82e-11a6758c8dfc admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:57.359461 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48009fb-235c-4fd1-b82e-11a6758c8dfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:57.361400 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48009fb-235c-4fd1-b82e-11a6758c8dfc admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:57.372349 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-730a68de-b775-46f9-ad73-6f4223f45906 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4d3c2cda07c425481535d3c60f29cc0'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:57.388422 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-730a68de-b775-46f9-ad73-6f4223f45906 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4d3c2cda07c425481535d3c60f29cc0'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:32:57.400939 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 837/1675] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:32:56 2021] DELETE /identity/v3/users/d4d3c2cda07c425481535d3c60f29cc0 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:57.402405 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432a787-d8af-4354-b336-50569e18b8e2 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:57.402688 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432a787-d8af-4354-b336-50569e18b8e2 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:57.403140 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432a787-d8af-4354-b336-50569e18b8e2 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:57.406709 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 838/1676] 10.222.0.25 () {54 vars in 921 bytes} [Wed Oct 27 01:32:57 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:32:57.413572 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432a787-d8af-4354-b336-50569e18b8e2 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:57.419118 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-5432a787-d8af-4354-b336-50569e18b8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:57.420905 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 839/1677] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:32:57 2021] POST /identity/v3/users => generated 284 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:57.425387 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48009fb-235c-4fd1-b82e-11a6758c8dfc admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:57.427732 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-e48009fb-235c-4fd1-b82e-11a6758c8dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:57.457940 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48009fb-235c-4fd1-b82e-11a6758c8dfc admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:57.570415 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432a787-d8af-4354-b336-50569e18b8e2 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:57.576385 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173ebd3-99db-4e5c-938b-62c35b46dece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:57.577166 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173ebd3-99db-4e5c-938b-62c35b46dece admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:57.577787 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173ebd3-99db-4e5c-938b-62c35b46dece admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:57.577963 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173ebd3-99db-4e5c-938b-62c35b46dece admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:57.578826 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173ebd3-99db-4e5c-938b-62c35b46dece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:57.580547 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173ebd3-99db-4e5c-938b-62c35b46dece admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:57.591961 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ce35e-10c9-40e3-a19f-f3689ca1ee71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:57.592823 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ce35e-10c9-40e3-a19f-f3689ca1ee71 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:57.593381 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ce35e-10c9-40e3-a19f-f3689ca1ee71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:57.593913 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ce35e-10c9-40e3-a19f-f3689ca1ee71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:57.595462 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ce35e-10c9-40e3-a19f-f3689ca1ee71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:57.598666 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ce35e-10c9-40e3-a19f-f3689ca1ee71 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:57.608178 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 839/1678] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:57 2021] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:57.612807 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 840/1679] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:57 2021] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:57.613411 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdfa77-ffd7-4f7f-b9cb-e82ad0bf1a93 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:57.613845 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdfa77-ffd7-4f7f-b9cb-e82ad0bf1a93 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:57.614252 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdfa77-ffd7-4f7f-b9cb-e82ad0bf1a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:57.614479 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ce35e-10c9-40e3-a19f-f3689ca1ee71 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:57.626462 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ce35e-10c9-40e3-a19f-f3689ca1ee71 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:57.633168 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b81bdd-b342-422e-8715-d555997bdbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:57.634286 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b81bdd-b342-422e-8715-d555997bdbbb admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:57.634776 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b81bdd-b342-422e-8715-d555997bdbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:57.635248 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b81bdd-b342-422e-8715-d555997bdbbb admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:57.636366 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b81bdd-b342-422e-8715-d555997bdbbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:57.638193 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b81bdd-b342-422e-8715-d555997bdbbb admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:57.652926 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 841/1680] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:57 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:57.654198 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b81bdd-b342-422e-8715-d555997bdbbb admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:57.663396 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-84fdfa77-ffd7-4f7f-b9cb-e82ad0bf1a93 None None] MFA Rules not processed for user `b2f8304b85b64dc4ac58523897306660`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:57.664615 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-84fdfa77-ffd7-4f7f-b9cb-e82ad0bf1a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:57.668565 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b81bdd-b342-422e-8715-d555997bdbbb admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:57.675528 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff51ca-52c2-4f08-b700-a365d888975f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:57.676472 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff51ca-52c2-4f08-b700-a365d888975f admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:57.676975 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff51ca-52c2-4f08-b700-a365d888975f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:57.677537 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff51ca-52c2-4f08-b700-a365d888975f admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:57.678667 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff51ca-52c2-4f08-b700-a365d888975f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:57.696160 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff51ca-52c2-4f08-b700-a365d888975f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:57.728623 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 842/1681] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:57 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:57.729945 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff51ca-52c2-4f08-b700-a365d888975f admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:57.751283 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff51ca-52c2-4f08-b700-a365d888975f admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:57.758057 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec8b6d-06c4-46b6-9469-3b4cf5f44d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:57.759277 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec8b6d-06c4-46b6-9469-3b4cf5f44d92 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:57.759769 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec8b6d-06c4-46b6-9469-3b4cf5f44d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:57.760272 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec8b6d-06c4-46b6-9469-3b4cf5f44d92 admin admin] PATH_INFO: `/v3/projects/58182ff44b5a48d292366f5905d759cf/users/7d26a74565b549fc98781cb32ac74bd7/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:57.780201 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec8b6d-06c4-46b6-9469-3b4cf5f44d92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58182ff44b5a48d292366f5905d759cf, user_id=7d26a74565b549fc98781cb32ac74bd7, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:57.783765 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec8b6d-06c4-46b6-9469-3b4cf5f44d92 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:57.814436 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 843/1682] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:32:57 2021] PUT /identity/v3/projects/58182ff44b5a48d292366f5905d759cf/users/7d26a74565b549fc98781cb32ac74bd7/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:57.816217 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec8b6d-06c4-46b6-9469-3b4cf5f44d92 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:57.845567 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 840/1683] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Oct 27 01:32:57 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:57.849226 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa5207-e0e4-4fe0-9f8d-a8f0497b579f None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:57.850204 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa5207-e0e4-4fe0-9f8d-a8f0497b579f None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:57.851509 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa5207-e0e4-4fe0-9f8d-a8f0497b579f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:57.885587 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-2aaa5207-e0e4-4fe0-9f8d-a8f0497b579f None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:57.886970 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-2aaa5207-e0e4-4fe0-9f8d-a8f0497b579f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:57.969368 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec8b6d-06c4-46b6-9469-3b4cf5f44d92 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:57.975617 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21b2d7-6898-4734-a955-90e06270ebba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:57.977824 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21b2d7-6898-4734-a955-90e06270ebba admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:57.978361 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21b2d7-6898-4734-a955-90e06270ebba admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:57.978858 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21b2d7-6898-4734-a955-90e06270ebba admin admin] PATH_INFO: `/v3/projects/a80442d6910a4823bef80d7421977ad6/users/08bfbe3428214d2380b19a82c58aa859/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:58.008681 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21b2d7-6898-4734-a955-90e06270ebba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a80442d6910a4823bef80d7421977ad6, user_id=08bfbe3428214d2380b19a82c58aa859, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:58.011819 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21b2d7-6898-4734-a955-90e06270ebba admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:58.058514 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 844/1684] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:32:57 2021] PUT /identity/v3/projects/a80442d6910a4823bef80d7421977ad6/users/08bfbe3428214d2380b19a82c58aa859/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:58.059796 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21b2d7-6898-4734-a955-90e06270ebba admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:58.069956 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-9d21b2d7-6898-4734-a955-90e06270ebba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:58.078271 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 841/1685] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:58.080498 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95dc4f-0083-48b7-8a0d-074a99680ede None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:58.080800 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95dc4f-0083-48b7-8a0d-074a99680ede None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:58.081750 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95dc4f-0083-48b7-8a0d-074a99680ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:58.149982 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-4b95dc4f-0083-48b7-8a0d-074a99680ede None None] MFA Rules not processed for user `08bfbe3428214d2380b19a82c58aa859`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:58.155808 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4b95dc4f-0083-48b7-8a0d-074a99680ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:58.278321 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21b2d7-6898-4734-a955-90e06270ebba admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:58.295750 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea71eae-775a-43e8-8ea9-f9eba4033b6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:58.297980 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea71eae-775a-43e8-8ea9-f9eba4033b6a service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:58.298651 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea71eae-775a-43e8-8ea9-f9eba4033b6a service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:58.300496 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea71eae-775a-43e8-8ea9-f9eba4033b6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:58.333380 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea71eae-775a-43e8-8ea9-f9eba4033b6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:58.339830 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea71eae-775a-43e8-8ea9-f9eba4033b6a service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:58.354515 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 842/1686] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:58 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:58.355418 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95dc4f-0083-48b7-8a0d-074a99680ede None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:58.358527 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4b95dc4f-0083-48b7-8a0d-074a99680ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:58.392454 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 845/1687] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:58 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:58.393318 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea71eae-775a-43e8-8ea9-f9eba4033b6a service nova] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:58.513412 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95dc4f-0083-48b7-8a0d-074a99680ede None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:58.518435 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bda6d-0ff4-4d98-816c-11ce43cb38c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:58.519409 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bda6d-0ff4-4d98-816c-11ce43cb38c0 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:58.519702 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bda6d-0ff4-4d98-816c-11ce43cb38c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:58.520047 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bda6d-0ff4-4d98-816c-11ce43cb38c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:58.587226 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea71eae-775a-43e8-8ea9-f9eba4033b6a service nova] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:58.606833 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04929c-cd80-491a-b9b7-b147dc2b57b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:58.607605 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04929c-cd80-491a-b9b7-b147dc2b57b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:58.607914 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04929c-cd80-491a-b9b7-b147dc2b57b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:58.608202 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04929c-cd80-491a-b9b7-b147dc2b57b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:58.620459 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04929c-cd80-491a-b9b7-b147dc2b57b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:58.625778 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04929c-cd80-491a-b9b7-b147dc2b57b4 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:58.637628 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bda6d-0ff4-4d98-816c-11ce43cb38c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:58.643118 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bda6d-0ff4-4d98-816c-11ce43cb38c0 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:58.655075 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 843/1688] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:58.702090 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 846/1689] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:32:58 2021] POST /identity/v3/projects => generated 367 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:58.704226 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bda6d-0ff4-4d98-816c-11ce43cb38c0 service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:58.729624 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bda6d-0ff4-4d98-816c-11ce43cb38c0 service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:58.995085 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331995d-077a-4d93-950b-83480c048701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:58.995777 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331995d-077a-4d93-950b-83480c048701 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:58.996667 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331995d-077a-4d93-950b-83480c048701 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:58.996667 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331995d-077a-4d93-950b-83480c048701 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:58.997124 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331995d-077a-4d93-950b-83480c048701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:58.999210 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331995d-077a-4d93-950b-83480c048701 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:59.052071 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 844/1690] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:32:58 2021] POST /identity/v3/users => generated 290 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:32:59.053861 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04929c-cd80-491a-b9b7-b147dc2b57b4 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:59.070803 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04929c-cd80-491a-b9b7-b147dc2b57b4 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:59.082918 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296eb08a-572d-4cde-a47b-f3d916f77a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:59.083772 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296eb08a-572d-4cde-a47b-f3d916f77a4e admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:59.084064 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296eb08a-572d-4cde-a47b-f3d916f77a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:59.084346 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296eb08a-572d-4cde-a47b-f3d916f77a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:59.087887 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296eb08a-572d-4cde-a47b-f3d916f77a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:59.091651 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296eb08a-572d-4cde-a47b-f3d916f77a4e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:59.123161 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 847/1691] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:59 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:59.124873 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331995d-077a-4d93-950b-83480c048701 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:59.147237 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331995d-077a-4d93-950b-83480c048701 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:59.170891 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2739a9f-c93d-4365-a320-90df775df156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:59.171819 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2739a9f-c93d-4365-a320-90df775df156 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:59.172103 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2739a9f-c93d-4365-a320-90df775df156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:59.172382 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2739a9f-c93d-4365-a320-90df775df156 admin admin] PATH_INFO: `/v3/projects/2832186649c24f539923a22eb7a9f7b3/users/9399f1d9bf144fad821c7ac8a5e13377/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:59.195396 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2739a9f-c93d-4365-a320-90df775df156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2832186649c24f539923a22eb7a9f7b3, user_id=9399f1d9bf144fad821c7ac8a5e13377, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:59.199806 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2739a9f-c93d-4365-a320-90df775df156 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:59.232992 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 845/1692] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:32:59 2021] PUT /identity/v3/projects/2832186649c24f539923a22eb7a9f7b3/users/9399f1d9bf144fad821c7ac8a5e13377/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:59.236556 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296eb08a-572d-4cde-a47b-f3d916f77a4e admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:59.252143 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296eb08a-572d-4cde-a47b-f3d916f77a4e admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:59.372727 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53af253-026e-4a90-93fd-dfde65922982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:59.373798 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53af253-026e-4a90-93fd-dfde65922982 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:59.374090 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53af253-026e-4a90-93fd-dfde65922982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:59.374375 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53af253-026e-4a90-93fd-dfde65922982 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:59.375156 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53af253-026e-4a90-93fd-dfde65922982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:59.378470 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53af253-026e-4a90-93fd-dfde65922982 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:59.391680 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 848/1693] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:32:59 2021] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:32:59.395895 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2739a9f-c93d-4365-a320-90df775df156 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:59.410152 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2739a9f-c93d-4365-a320-90df775df156 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:59.425499 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b66608-13a2-4af9-bb65-3f90a2d23ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:59.427404 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b66608-13a2-4af9-bb65-3f90a2d23ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:59.427708 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b66608-13a2-4af9-bb65-3f90a2d23ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:59.427996 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b66608-13a2-4af9-bb65-3f90a2d23ea2 admin admin] PATH_INFO: `/v3/projects/2832186649c24f539923a22eb7a9f7b3/users/9399f1d9bf144fad821c7ac8a5e13377/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:59.432049 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b66608-13a2-4af9-bb65-3f90a2d23ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2832186649c24f539923a22eb7a9f7b3, user_id=9399f1d9bf144fad821c7ac8a5e13377, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:59.434767 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b66608-13a2-4af9-bb65-3f90a2d23ea2 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:59.461174 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 846/1694] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:32:59 2021] PUT /identity/v3/projects/2832186649c24f539923a22eb7a9f7b3/users/9399f1d9bf144fad821c7ac8a5e13377/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:32:59.475060 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0871bde-f4d8-449c-b89a-6f7d993c26a9 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:59.475317 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0871bde-f4d8-449c-b89a-6f7d993c26a9 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:59.475560 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0871bde-f4d8-449c-b89a-6f7d993c26a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:59.517309 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-c0871bde-f4d8-449c-b89a-6f7d993c26a9 None None] MFA Rules not processed for user `9399f1d9bf144fad821c7ac8a5e13377`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:32:59.519335 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-c0871bde-f4d8-449c-b89a-6f7d993c26a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:59.659139 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 849/1695] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:32:59 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:32:59.665424 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b66608-13a2-4af9-bb65-3f90a2d23ea2 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:59.667324 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-39b66608-13a2-4af9-bb65-3f90a2d23ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:59.785974 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b66608-13a2-4af9-bb65-3f90a2d23ea2 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:59.790875 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fd8b5-1d32-455c-8f13-7bd1bb79e5fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:59.791889 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fd8b5-1d32-455c-8f13-7bd1bb79e5fb service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:59.792584 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fd8b5-1d32-455c-8f13-7bd1bb79e5fb service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:59.793010 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fd8b5-1d32-455c-8f13-7bd1bb79e5fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:59.813308 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39fd8b5-1d32-455c-8f13-7bd1bb79e5fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:59.815202 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39fd8b5-1d32-455c-8f13-7bd1bb79e5fb service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:59.849967 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 847/1696] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:59 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:00.096447 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0871bde-f4d8-449c-b89a-6f7d993c26a9 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:00.098791 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-c0871bde-f4d8-449c-b89a-6f7d993c26a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:00.271334 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0871bde-f4d8-449c-b89a-6f7d993c26a9 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:00.277592 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fd9dc-5d3d-4f00-b2bc-2506766715c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:00.279136 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fd9dc-5d3d-4f00-b2bc-2506766715c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:00.279431 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fd9dc-5d3d-4f00-b2bc-2506766715c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:00.279711 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fd9dc-5d3d-4f00-b2bc-2506766715c2 admin admin] PATH_INFO: `/v3/projects/1428ee77d0df497f88965813dea97908` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:00.282177 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fd9dc-5d3d-4f00-b2bc-2506766715c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1428ee77d0df497f88965813dea97908)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:00.284410 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fd9dc-5d3d-4f00-b2bc-2506766715c2 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:00.425421 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-2a4fd9dc-5d3d-4f00-b2bc-2506766715c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1428ee77d0df497f88965813dea97908', 'request_id': 'req-2a4fd9dc-5d3d-4f00-b2bc-2506766715c2'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:00.436300 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-2a4fd9dc-5d3d-4f00-b2bc-2506766715c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1428ee77d0df497f88965813dea97908', 'request_id': 'req-2a4fd9dc-5d3d-4f00-b2bc-2506766715c2'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:00.446371 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-2a4fd9dc-5d3d-4f00-b2bc-2506766715c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1428ee77d0df497f88965813dea97908', 'request_id': 'req-2a4fd9dc-5d3d-4f00-b2bc-2506766715c2'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:00.463294 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-2a4fd9dc-5d3d-4f00-b2bc-2506766715c2 admin admin] The token cache is being invalidate because project 1428ee77d0df497f88965813dea97908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:00.463865 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-2a4fd9dc-5d3d-4f00-b2bc-2506766715c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:00.464845 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-2a4fd9dc-5d3d-4f00-b2bc-2506766715c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:00.473116 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 850/1697] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:33:00 2021] DELETE /identity/v3/projects/1428ee77d0df497f88965813dea97908 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:00.473637 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4d4fd-d385-4f66-8fab-73db9fd58b61 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:00.473936 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4d4fd-d385-4f66-8fab-73db9fd58b61 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:00.474129 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4d4fd-d385-4f66-8fab-73db9fd58b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:00.514395 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-75d4d4fd-d385-4f66-8fab-73db9fd58b61 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:00.516045 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-75d4d4fd-d385-4f66-8fab-73db9fd58b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:00.632878 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 848/1698] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:00.633329 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f980312-ab4f-4256-beef-5e101c769572 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:00.633656 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f980312-ab4f-4256-beef-5e101c769572 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:00.633943 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f980312-ab4f-4256-beef-5e101c769572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:00.657884 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-5f980312-ab4f-4256-beef-5e101c769572 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:00.660208 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-5f980312-ab4f-4256-beef-5e101c769572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:00.679393 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 851/1699] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:00.707813 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4d4fd-d385-4f66-8fab-73db9fd58b61 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:00.721110 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4d4fd-d385-4f66-8fab-73db9fd58b61 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:00.729057 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c57421-6e9c-4925-8b00-95310714a510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:00.729779 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c57421-6e9c-4925-8b00-95310714a510 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:00.730067 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c57421-6e9c-4925-8b00-95310714a510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:00.730461 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c57421-6e9c-4925-8b00-95310714a510 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:00.731283 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c57421-6e9c-4925-8b00-95310714a510 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:33:00.731835 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c57421-6e9c-4925-8b00-95310714a510 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:00.736096 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c57421-6e9c-4925-8b00-95310714a510 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:00.787950 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f980312-ab4f-4256-beef-5e101c769572 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:00.795254 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 849/1700] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:33:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:33:00.813683 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f980312-ab4f-4256-beef-5e101c769572 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:00.827974 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057d283-ae35-4921-9020-b9d4d1757368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:00.829817 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057d283-ae35-4921-9020-b9d4d1757368 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:00.832891 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057d283-ae35-4921-9020-b9d4d1757368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:00.833331 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057d283-ae35-4921-9020-b9d4d1757368 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:00.834458 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057d283-ae35-4921-9020-b9d4d1757368 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:00.858986 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057d283-ae35-4921-9020-b9d4d1757368 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:00.946179 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 852/1701] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:33:00 2021] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:00.948406 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c57421-6e9c-4925-8b00-95310714a510 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:00.982828 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c57421-6e9c-4925-8b00-95310714a510 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:01.089329 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5df578-8240-48bc-b904-c98f69969c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:01.090057 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5df578-8240-48bc-b904-c98f69969c0c admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:01.090350 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5df578-8240-48bc-b904-c98f69969c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:01.090626 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5df578-8240-48bc-b904-c98f69969c0c admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:01.091744 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5df578-8240-48bc-b904-c98f69969c0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:01.099093 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5df578-8240-48bc-b904-c98f69969c0c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:01.137640 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 850/1702] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:33:00 2021] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:01.141947 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057d283-ae35-4921-9020-b9d4d1757368 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:01.164138 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057d283-ae35-4921-9020-b9d4d1757368 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:01.173792 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb7e4b-76b3-4fe5-9e7d-d5a4496221cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:01.175075 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb7e4b-76b3-4fe5-9e7d-d5a4496221cb admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:01.175375 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb7e4b-76b3-4fe5-9e7d-d5a4496221cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:01.175812 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb7e4b-76b3-4fe5-9e7d-d5a4496221cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:01.176419 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb7e4b-76b3-4fe5-9e7d-d5a4496221cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:01.178082 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb7e4b-76b3-4fe5-9e7d-d5a4496221cb admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:01.204227 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 853/1703] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:01 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:01.210154 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5df578-8240-48bc-b904-c98f69969c0c admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:01.251551 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5df578-8240-48bc-b904-c98f69969c0c admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:01.285428 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae982740-cf90-4878-8daf-1567313ad6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:01.286487 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae982740-cf90-4878-8daf-1567313ad6ef admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:01.286931 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae982740-cf90-4878-8daf-1567313ad6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:01.287455 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae982740-cf90-4878-8daf-1567313ad6ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:01.288179 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae982740-cf90-4878-8daf-1567313ad6ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:01.293245 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae982740-cf90-4878-8daf-1567313ad6ef admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:01.317679 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 851/1704] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:01 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:01.323273 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb7e4b-76b3-4fe5-9e7d-d5a4496221cb admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:01.375130 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb7e4b-76b3-4fe5-9e7d-d5a4496221cb admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:01.384682 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ff4e4-85a1-4e9f-b236-6f5acdf79c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:01.384999 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ff4e4-85a1-4e9f-b236-6f5acdf79c1f admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:01.385286 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ff4e4-85a1-4e9f-b236-6f5acdf79c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:01.385588 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ff4e4-85a1-4e9f-b236-6f5acdf79c1f admin admin] PATH_INFO: `/v3/projects/4365b29543584588a1e14a607e95e668/users/00d81dec84634250b35b8e090620bc8d/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:01.457126 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ff4e4-85a1-4e9f-b236-6f5acdf79c1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4365b29543584588a1e14a607e95e668, user_id=00d81dec84634250b35b8e090620bc8d, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:01.466457 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ff4e4-85a1-4e9f-b236-6f5acdf79c1f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:01.475561 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8849100-a2cd-4818-8a98-1c69ded07c98 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:01.475859 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8849100-a2cd-4818-8a98-1c69ded07c98 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:01.476148 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8849100-a2cd-4818-8a98-1c69ded07c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:01.496254 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 854/1705] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:01 2021] PUT /identity/v3/projects/4365b29543584588a1e14a607e95e668/users/00d81dec84634250b35b8e090620bc8d/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:01.508445 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f6e97-d2cf-493b-a033-e668af901f8b None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:01.509126 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f6e97-d2cf-493b-a033-e668af901f8b None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:01.509659 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f6e97-d2cf-493b-a033-e668af901f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:01.557796 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-e8849100-a2cd-4818-8a98-1c69ded07c98 None None] MFA Rules not processed for user `ec1f566372814a95890d41b260573dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:01.559061 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-e8849100-a2cd-4818-8a98-1c69ded07c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:01.563562 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-4f3f6e97-d2cf-493b-a033-e668af901f8b None None] MFA Rules not processed for user `00d81dec84634250b35b8e090620bc8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:01.564894 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-4f3f6e97-d2cf-493b-a033-e668af901f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:01.695626 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 855/1706] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:01 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:33:01.712228 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f6e97-d2cf-493b-a033-e668af901f8b None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:01.713653 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-4f3f6e97-d2cf-493b-a033-e668af901f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:01.874666 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f6e97-d2cf-493b-a033-e668af901f8b None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:01.879678 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a101a-efac-45d6-8081-9af6f1bb4e21 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32003a40693246d08640bc7ec45adfc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:01.880344 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a101a-efac-45d6-8081-9af6f1bb4e21 service glance] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:01.880686 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a101a-efac-45d6-8081-9af6f1bb4e21 service glance] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:01.881251 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a101a-efac-45d6-8081-9af6f1bb4e21 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:01.891362 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a101a-efac-45d6-8081-9af6f1bb4e21 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:01.892853 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a101a-efac-45d6-8081-9af6f1bb4e21 service glance] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:01.904294 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 856/1707] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:01 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:33:01.905653 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 852/1708] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:01 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:01.915343 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a101a-efac-45d6-8081-9af6f1bb4e21 service glance] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:01.917867 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-259a101a-efac-45d6-8081-9af6f1bb4e21 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:02.009585 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a101a-efac-45d6-8081-9af6f1bb4e21 service glance] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:02.019750 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc26e2f-60d2-49a5-a59c-18995cbe13d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:02.020742 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc26e2f-60d2-49a5-a59c-18995cbe13d7 service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:02.021102 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc26e2f-60d2-49a5-a59c-18995cbe13d7 service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:02.021453 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc26e2f-60d2-49a5-a59c-18995cbe13d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:02.033062 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc26e2f-60d2-49a5-a59c-18995cbe13d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:02.035881 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc26e2f-60d2-49a5-a59c-18995cbe13d7 service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:02.050015 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 857/1709] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:01 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:02.388997 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f0f62-da04-43ce-b076-202e72471c58 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:02.389334 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f0f62-da04-43ce-b076-202e72471c58 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:02.389616 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f0f62-da04-43ce-b076-202e72471c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:02.458255 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-497f0f62-da04-43ce-b076-202e72471c58 None None] MFA Rules not processed for user `7d26a74565b549fc98781cb32ac74bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:02.460701 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-497f0f62-da04-43ce-b076-202e72471c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:02.569531 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 853/1710] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:02 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:02.574583 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc26e2f-60d2-49a5-a59c-18995cbe13d7 service nova] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:02.576124 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-9cc26e2f-60d2-49a5-a59c-18995cbe13d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:02.783427 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f0f62-da04-43ce-b076-202e72471c58 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:02.786201 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-497f0f62-da04-43ce-b076-202e72471c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:02.807657 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc26e2f-60d2-49a5-a59c-18995cbe13d7 service nova] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:02.818364 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f0f62-da04-43ce-b076-202e72471c58 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:02.820989 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a366d8-2a85-423c-96a4-25be9e6aed4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:02.823894 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a366d8-2a85-423c-96a4-25be9e6aed4d admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:02.824177 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a366d8-2a85-423c-96a4-25be9e6aed4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:02.824871 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a366d8-2a85-423c-96a4-25be9e6aed4d admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:02.827438 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a366d8-2a85-423c-96a4-25be9e6aed4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:02.828882 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7569b-ab6e-4ff1-b88e-58f4d51b9ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:02.832622 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a366d8-2a85-423c-96a4-25be9e6aed4d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:02.839985 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7569b-ab6e-4ff1-b88e-58f4d51b9ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:02.840305 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7569b-ab6e-4ff1-b88e-58f4d51b9ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:02.840597 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7569b-ab6e-4ff1-b88e-58f4d51b9ac7 admin admin] PATH_INFO: `/v3/users/08bfbe3428214d2380b19a82c58aa859` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:02.865417 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7569b-ab6e-4ff1-b88e-58f4d51b9ac7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08bfbe3428214d2380b19a82c58aa859)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:02.876561 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7569b-ab6e-4ff1-b88e-58f4d51b9ac7 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:02.898858 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 858/1711] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:33:02 2021] POST /identity/v3/projects => generated 405 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:02.899818 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a366d8-2a85-423c-96a4-25be9e6aed4d admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:03.094907 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-7ce7569b-ab6e-4ff1-b88e-58f4d51b9ac7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08bfbe3428214d2380b19a82c58aa859'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:03.135591 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-7ce7569b-ab6e-4ff1-b88e-58f4d51b9ac7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08bfbe3428214d2380b19a82c58aa859'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:03.142571 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-7ce7569b-ab6e-4ff1-b88e-58f4d51b9ac7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08bfbe3428214d2380b19a82c58aa859'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:03.202216 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-7ce7569b-ab6e-4ff1-b88e-58f4d51b9ac7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08bfbe3428214d2380b19a82c58aa859'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:03.216113 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-7ce7569b-ab6e-4ff1-b88e-58f4d51b9ac7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08bfbe3428214d2380b19a82c58aa859'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:03.234531 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 854/1712] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:33:02 2021] DELETE /identity/v3/users/08bfbe3428214d2380b19a82c58aa859 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:33:03.239894 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b22017-8796-4d6a-98c2-1190b8aec033 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:03.240175 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b22017-8796-4d6a-98c2-1190b8aec033 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:03.240459 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b22017-8796-4d6a-98c2-1190b8aec033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:03.281310 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a366d8-2a85-423c-96a4-25be9e6aed4d admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:03.302717 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-d2b22017-8796-4d6a-98c2-1190b8aec033 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:03.319899 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-d2b22017-8796-4d6a-98c2-1190b8aec033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:03.554174 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 855/1713] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:03.570754 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e206fa-c149-4f89-b423-81b58e822e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:03.571900 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e206fa-c149-4f89-b423-81b58e822e99 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:03.574964 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e206fa-c149-4f89-b423-81b58e822e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:03.575455 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e206fa-c149-4f89-b423-81b58e822e99 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:03.576447 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e206fa-c149-4f89-b423-81b58e822e99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:03.578690 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e206fa-c149-4f89-b423-81b58e822e99 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:03.621786 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b22017-8796-4d6a-98c2-1190b8aec033 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:03.625057 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-d2b22017-8796-4d6a-98c2-1190b8aec033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:03.631812 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 859/1714] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:33:02 2021] POST /identity/v3/users => generated 309 bytes in 732 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:03.634611 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e206fa-c149-4f89-b423-81b58e822e99 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:03.639060 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-d3e206fa-c149-4f89-b423-81b58e822e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:03.673383 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e206fa-c149-4f89-b423-81b58e822e99 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:03.686715 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825283f-94e4-4192-b58b-7572a15ff106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:03.688357 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825283f-94e4-4192-b58b-7572a15ff106 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:03.688760 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825283f-94e4-4192-b58b-7572a15ff106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:03.689399 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825283f-94e4-4192-b58b-7572a15ff106 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:03.690692 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825283f-94e4-4192-b58b-7572a15ff106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:03.696421 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825283f-94e4-4192-b58b-7572a15ff106 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:03.729562 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 860/1715] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:03 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:03.734567 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825283f-94e4-4192-b58b-7572a15ff106 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:03.764715 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825283f-94e4-4192-b58b-7572a15ff106 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:03.777897 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed216dc-9d96-42a3-bfef-d526a96c318b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:03.782784 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed216dc-9d96-42a3-bfef-d526a96c318b admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:03.783193 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed216dc-9d96-42a3-bfef-d526a96c318b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:03.784023 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed216dc-9d96-42a3-bfef-d526a96c318b admin admin] PATH_INFO: `/v3/projects/73063a49586846b9b1f80cebac606333/users/03dd50d958444d778e9181d9a25a207e/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:03.825111 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed216dc-9d96-42a3-bfef-d526a96c318b admin admin] RBAC: Authorizing `identity:create_grant(project_id=73063a49586846b9b1f80cebac606333, user_id=03dd50d958444d778e9181d9a25a207e, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:03.835026 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed216dc-9d96-42a3-bfef-d526a96c318b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:03.868169 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b22017-8796-4d6a-98c2-1190b8aec033 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:03.872068 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 861/1716] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:03 2021] PUT /identity/v3/projects/73063a49586846b9b1f80cebac606333/users/03dd50d958444d778e9181d9a25a207e/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:03.876924 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed216dc-9d96-42a3-bfef-d526a96c318b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:03.995729 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521b5fe-d952-480c-a74d-c814c02c926a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:03.997016 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521b5fe-d952-480c-a74d-c814c02c926a service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:03.997577 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521b5fe-d952-480c-a74d-c814c02c926a service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:04.003499 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521b5fe-d952-480c-a74d-c814c02c926a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:04.040958 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed216dc-9d96-42a3-bfef-d526a96c318b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:04.059954 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2392f42-e3c3-4e33-8ced-106a54696ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:04.061563 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2392f42-e3c3-4e33-8ced-106a54696ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:04.063877 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2392f42-e3c3-4e33-8ced-106a54696ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:04.064333 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2392f42-e3c3-4e33-8ced-106a54696ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:04.065963 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2392f42-e3c3-4e33-8ced-106a54696ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:04.071585 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2392f42-e3c3-4e33-8ced-106a54696ef0 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:04.106503 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 862/1717] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:03 2021] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:04.111417 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20cc08-a8b8-4d96-b699-4e0e58ab3699 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:04.112169 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20cc08-a8b8-4d96-b699-4e0e58ab3699 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:04.114654 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20cc08-a8b8-4d96-b699-4e0e58ab3699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:04.179728 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521b5fe-d952-480c-a74d-c814c02c926a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:04.183878 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521b5fe-d952-480c-a74d-c814c02c926a service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:04.189320 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-0c20cc08-a8b8-4d96-b699-4e0e58ab3699 None None] MFA Rules not processed for user `56895529b11b4236bccb5956a8ccb5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:04.191151 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-0c20cc08-a8b8-4d96-b699-4e0e58ab3699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:04.220745 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 856/1718] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:04.222457 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521b5fe-d952-480c-a74d-c814c02c926a service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:04.244540 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521b5fe-d952-480c-a74d-c814c02c926a service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:04.252978 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723dac5-a8a7-4df0-9177-8e686d9c0619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:04.254388 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723dac5-a8a7-4df0-9177-8e686d9c0619 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:04.254905 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723dac5-a8a7-4df0-9177-8e686d9c0619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:04.255556 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723dac5-a8a7-4df0-9177-8e686d9c0619 admin admin] PATH_INFO: `/v3/projects/73063a49586846b9b1f80cebac606333/users/03dd50d958444d778e9181d9a25a207e/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:04.260824 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723dac5-a8a7-4df0-9177-8e686d9c0619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73063a49586846b9b1f80cebac606333, user_id=03dd50d958444d778e9181d9a25a207e, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:04.266243 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723dac5-a8a7-4df0-9177-8e686d9c0619 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:04.297532 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 857/1719] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:04 2021] PUT /identity/v3/projects/73063a49586846b9b1f80cebac606333/users/03dd50d958444d778e9181d9a25a207e/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:04.428080 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 863/1720] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Oct 27 01:33:04 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:04.437225 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723dac5-a8a7-4df0-9177-8e686d9c0619 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:04.439250 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-9723dac5-a8a7-4df0-9177-8e686d9c0619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:04.663134 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723dac5-a8a7-4df0-9177-8e686d9c0619 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:04.673789 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02cd4a-cc51-4900-b9f6-9d6fe60ad4ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f386f358fdb241f5a529a2cf3d839201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:04.674465 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02cd4a-cc51-4900-b9f6-9d6fe60ad4ad service swift] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:04.674796 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02cd4a-cc51-4900-b9f6-9d6fe60ad4ad service swift] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:04.675082 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02cd4a-cc51-4900-b9f6-9d6fe60ad4ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:04.812529 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02cd4a-cc51-4900-b9f6-9d6fe60ad4ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:04.814352 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d8f1a-246b-4498-a79e-28e36bc04aca None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:04.815319 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d8f1a-246b-4498-a79e-28e36bc04aca None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:04.815447 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02cd4a-cc51-4900-b9f6-9d6fe60ad4ad service swift] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:04.815866 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d8f1a-246b-4498-a79e-28e36bc04aca None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:04.819102 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 864/1721] 10.222.0.25 () {54 vars in 921 bytes} [Wed Oct 27 01:33:04 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:33:04.841033 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 858/1722] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Oct 27 01:33:04 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:33:04.842703 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc0aed-0457-4ba7-bb71-ad04ae9af043 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:04.843447 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc0aed-0457-4ba7-bb71-ad04ae9af043 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:04.843447 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc0aed-0457-4ba7-bb71-ad04ae9af043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:04.907632 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-ecfc0aed-0457-4ba7-bb71-ad04ae9af043 None None] MFA Rules not processed for user `b2f8304b85b64dc4ac58523897306660`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:04.913317 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-ecfc0aed-0457-4ba7-bb71-ad04ae9af043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:05.027085 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3791f-785c-4b05-bbe3-e9b49e3c3019 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:05.027691 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3791f-785c-4b05-bbe3-e9b49e3c3019 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:05.027860 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3791f-785c-4b05-bbe3-e9b49e3c3019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:05.100410 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-aae3791f-785c-4b05-bbe3-e9b49e3c3019 None None] MFA Rules not processed for user `b164b9dd32884e99b0b22eb7c50bdda2`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:05.101726 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-aae3791f-785c-4b05-bbe3-e9b49e3c3019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:05.203050 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 865/1723] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Oct 27 01:33:04 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:33:05.274182 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc0aed-0457-4ba7-bb71-ad04ae9af043 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:05.275811 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-ecfc0aed-0457-4ba7-bb71-ad04ae9af043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:05.282846 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 859/1724] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:05 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:05.302569 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3791f-785c-4b05-bbe3-e9b49e3c3019 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:05.308239 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-aae3791f-785c-4b05-bbe3-e9b49e3c3019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:05.373253 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc0aed-0457-4ba7-bb71-ad04ae9af043 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:05.403662 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626179c-c1e6-4b5e-acdd-96a247881028 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:05.404945 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626179c-c1e6-4b5e-acdd-96a247881028 service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:05.405387 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626179c-c1e6-4b5e-acdd-96a247881028 service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:05.407031 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626179c-c1e6-4b5e-acdd-96a247881028 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:05.420912 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626179c-c1e6-4b5e-acdd-96a247881028 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:05.423734 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626179c-c1e6-4b5e-acdd-96a247881028 service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:05.482342 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 866/1725] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:05 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:05.494111 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3791f-785c-4b05-bbe3-e9b49e3c3019 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:05.510722 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d286d42-b0b2-4928-8833-31b1ce6ac823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:05.511620 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d286d42-b0b2-4928-8833-31b1ce6ac823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:05.511909 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d286d42-b0b2-4928-8833-31b1ce6ac823 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:05.512190 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d286d42-b0b2-4928-8833-31b1ce6ac823 admin admin] PATH_INFO: `/v3/projects/a80442d6910a4823bef80d7421977ad6` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:05.513656 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d286d42-b0b2-4928-8833-31b1ce6ac823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a80442d6910a4823bef80d7421977ad6)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:05.515457 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d286d42-b0b2-4928-8833-31b1ce6ac823 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:05.632617 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-8d286d42-b0b2-4928-8833-31b1ce6ac823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a80442d6910a4823bef80d7421977ad6', 'request_id': 'req-8d286d42-b0b2-4928-8833-31b1ce6ac823'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:05.644090 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-8d286d42-b0b2-4928-8833-31b1ce6ac823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a80442d6910a4823bef80d7421977ad6', 'request_id': 'req-8d286d42-b0b2-4928-8833-31b1ce6ac823'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:05.680195 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-8d286d42-b0b2-4928-8833-31b1ce6ac823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a80442d6910a4823bef80d7421977ad6', 'request_id': 'req-8d286d42-b0b2-4928-8833-31b1ce6ac823'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:05.722268 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-8d286d42-b0b2-4928-8833-31b1ce6ac823 admin admin] The token cache is being invalidate because project a80442d6910a4823bef80d7421977ad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:05.723857 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-8d286d42-b0b2-4928-8833-31b1ce6ac823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:05.725035 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-8d286d42-b0b2-4928-8833-31b1ce6ac823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:05.733981 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 860/1726] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:33:05 2021] DELETE /identity/v3/projects/a80442d6910a4823bef80d7421977ad6 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:05.735914 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626179c-c1e6-4b5e-acdd-96a247881028 service nova] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:05.754194 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626179c-c1e6-4b5e-acdd-96a247881028 service nova] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:05.985252 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a87dfa-66a7-4ba2-8548-ce44cfbaa685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:05.988043 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a87dfa-66a7-4ba2-8548-ce44cfbaa685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:05.990237 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a87dfa-66a7-4ba2-8548-ce44cfbaa685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:05.990742 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a87dfa-66a7-4ba2-8548-ce44cfbaa685 admin admin] PATH_INFO: `/v3/users/9399f1d9bf144fad821c7ac8a5e13377` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:05.992403 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a87dfa-66a7-4ba2-8548-ce44cfbaa685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9399f1d9bf144fad821c7ac8a5e13377)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:05.994900 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a87dfa-66a7-4ba2-8548-ce44cfbaa685 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:06.092865 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-63a87dfa-66a7-4ba2-8548-ce44cfbaa685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9399f1d9bf144fad821c7ac8a5e13377'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:06.111393 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-63a87dfa-66a7-4ba2-8548-ce44cfbaa685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9399f1d9bf144fad821c7ac8a5e13377'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:06.120780 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-63a87dfa-66a7-4ba2-8548-ce44cfbaa685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9399f1d9bf144fad821c7ac8a5e13377'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:06.123752 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-63a87dfa-66a7-4ba2-8548-ce44cfbaa685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9399f1d9bf144fad821c7ac8a5e13377'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:06.152212 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-63a87dfa-66a7-4ba2-8548-ce44cfbaa685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9399f1d9bf144fad821c7ac8a5e13377'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:06.166437 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 867/1727] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:33:05 2021] DELETE /identity/v3/users/9399f1d9bf144fad821c7ac8a5e13377 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:06.773409 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc46ce8-5fc7-40a3-9ec7-8e290a0f2c2d None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:06.774373 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc46ce8-5fc7-40a3-9ec7-8e290a0f2c2d None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:06.774830 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc46ce8-5fc7-40a3-9ec7-8e290a0f2c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:06.831826 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-4fc46ce8-5fc7-40a3-9ec7-8e290a0f2c2d None None] MFA Rules not processed for user `03dd50d958444d778e9181d9a25a207e`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:06.833085 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4fc46ce8-5fc7-40a3-9ec7-8e290a0f2c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:06.983652 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 861/1728] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:06 2021] POST /identity/v3/auth/tokens => generated 3492 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:07.482915 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a87dfa-66a7-4ba2-8548-ce44cfbaa685 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:07.485572 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-63a87dfa-66a7-4ba2-8548-ce44cfbaa685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:07.604528 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a87dfa-66a7-4ba2-8548-ce44cfbaa685 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:07.609815 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd60f2-44fa-4740-ad2e-463b82c163e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:07.610839 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd60f2-44fa-4740-ad2e-463b82c163e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:07.611361 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd60f2-44fa-4740-ad2e-463b82c163e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:07.611741 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd60f2-44fa-4740-ad2e-463b82c163e3 admin admin] PATH_INFO: `/v3/projects/2832186649c24f539923a22eb7a9f7b3` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:07.614961 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd60f2-44fa-4740-ad2e-463b82c163e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2832186649c24f539923a22eb7a9f7b3)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:07.617107 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd60f2-44fa-4740-ad2e-463b82c163e3 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:07.684193 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-39bd60f2-44fa-4740-ad2e-463b82c163e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2832186649c24f539923a22eb7a9f7b3', 'request_id': 'req-39bd60f2-44fa-4740-ad2e-463b82c163e3'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:07.685923 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-39bd60f2-44fa-4740-ad2e-463b82c163e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2832186649c24f539923a22eb7a9f7b3', 'request_id': 'req-39bd60f2-44fa-4740-ad2e-463b82c163e3'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:07.695127 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-39bd60f2-44fa-4740-ad2e-463b82c163e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2832186649c24f539923a22eb7a9f7b3', 'request_id': 'req-39bd60f2-44fa-4740-ad2e-463b82c163e3'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:07.707593 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-39bd60f2-44fa-4740-ad2e-463b82c163e3 admin admin] The token cache is being invalidate because project 2832186649c24f539923a22eb7a9f7b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:07.707970 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-39bd60f2-44fa-4740-ad2e-463b82c163e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:07.708751 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-39bd60f2-44fa-4740-ad2e-463b82c163e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:07.710754 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 868/1729] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:33:07 2021] DELETE /identity/v3/projects/2832186649c24f539923a22eb7a9f7b3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:07.717856 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbccd6-f25f-415f-9c33-d0084868d342 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:07.718359 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbccd6-f25f-415f-9c33-d0084868d342 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:07.719392 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbccd6-f25f-415f-9c33-d0084868d342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:07.744077 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-30dbccd6-f25f-415f-9c33-d0084868d342 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:07.745681 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-30dbccd6-f25f-415f-9c33-d0084868d342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:07.847508 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 862/1730] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:07.855655 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fcc0a-bfd3-4669-8958-7457737e29ae None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:07.856184 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fcc0a-bfd3-4669-8958-7457737e29ae None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:07.856558 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fcc0a-bfd3-4669-8958-7457737e29ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:07.883424 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-713fcc0a-bfd3-4669-8958-7457737e29ae None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:07.885630 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-713fcc0a-bfd3-4669-8958-7457737e29ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:07.915282 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 869/1731] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:07.919279 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbccd6-f25f-415f-9c33-d0084868d342 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:07.943389 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbccd6-f25f-415f-9c33-d0084868d342 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:07.973455 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861a75a-3ff4-4088-9062-63c05e0f72d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:07.976051 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861a75a-3ff4-4088-9062-63c05e0f72d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:07.976342 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861a75a-3ff4-4088-9062-63c05e0f72d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:07.978819 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861a75a-3ff4-4088-9062-63c05e0f72d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:07.979657 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861a75a-3ff4-4088-9062-63c05e0f72d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:33:07.979983 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861a75a-3ff4-4088-9062-63c05e0f72d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:07.983860 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861a75a-3ff4-4088-9062-63c05e0f72d1 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:08.014744 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 863/1732] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:33:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:33:08.019083 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fcc0a-bfd3-4669-8958-7457737e29ae None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:08.033382 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fcc0a-bfd3-4669-8958-7457737e29ae None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:08.040412 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1db2c2-4748-4275-818a-afda8ed6043e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:08.041091 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1db2c2-4748-4275-818a-afda8ed6043e admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:08.041386 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1db2c2-4748-4275-818a-afda8ed6043e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:08.041758 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1db2c2-4748-4275-818a-afda8ed6043e admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:08.042527 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1db2c2-4748-4275-818a-afda8ed6043e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:08.044743 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1db2c2-4748-4275-818a-afda8ed6043e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:08.082971 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 870/1733] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:33:08 2021] POST /identity/v3/projects => generated 387 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:33:08.084398 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861a75a-3ff4-4088-9062-63c05e0f72d1 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:08.095924 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861a75a-3ff4-4088-9062-63c05e0f72d1 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:08.178394 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3d6ed-078c-47c3-9446-a93cbae9c244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:08.179453 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3d6ed-078c-47c3-9446-a93cbae9c244 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:08.180443 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3d6ed-078c-47c3-9446-a93cbae9c244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:08.180959 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3d6ed-078c-47c3-9446-a93cbae9c244 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:08.182352 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3d6ed-078c-47c3-9446-a93cbae9c244 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:08.184510 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3d6ed-078c-47c3-9446-a93cbae9c244 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:08.224468 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 864/1734] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:33:08 2021] POST /identity/v3/users => generated 294 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:08.228754 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1db2c2-4748-4275-818a-afda8ed6043e admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:08.265293 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1db2c2-4748-4275-818a-afda8ed6043e admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:08.276670 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa0e36-c312-4241-9cd3-1f6639b73d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:08.278096 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa0e36-c312-4241-9cd3-1f6639b73d77 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:08.279042 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa0e36-c312-4241-9cd3-1f6639b73d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:08.279823 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa0e36-c312-4241-9cd3-1f6639b73d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:08.281052 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa0e36-c312-4241-9cd3-1f6639b73d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:08.284813 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa0e36-c312-4241-9cd3-1f6639b73d77 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:08.304210 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 871/1735] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:08 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:08.305450 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3d6ed-078c-47c3-9446-a93cbae9c244 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:08.325809 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3d6ed-078c-47c3-9446-a93cbae9c244 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:08.340916 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abccade-8996-4644-9ea1-d31394c87346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:08.341663 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abccade-8996-4644-9ea1-d31394c87346 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:08.341936 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abccade-8996-4644-9ea1-d31394c87346 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:08.342372 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abccade-8996-4644-9ea1-d31394c87346 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:08.352346 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abccade-8996-4644-9ea1-d31394c87346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:08.355004 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abccade-8996-4644-9ea1-d31394c87346 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:08.365789 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 865/1736] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:08 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:08.370197 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa0e36-c312-4241-9cd3-1f6639b73d77 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:08.381744 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa0e36-c312-4241-9cd3-1f6639b73d77 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:08.388192 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01938d10-3b8a-4d75-a497-865fe164c09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:08.389298 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01938d10-3b8a-4d75-a497-865fe164c09d admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:08.389733 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01938d10-3b8a-4d75-a497-865fe164c09d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:08.390158 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01938d10-3b8a-4d75-a497-865fe164c09d admin admin] PATH_INFO: `/v3/projects/e7ef0220e0794ca28e7d815f928f450e/users/4458b9eced314106bc863f0076c1d630/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:08.409700 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01938d10-3b8a-4d75-a497-865fe164c09d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ef0220e0794ca28e7d815f928f450e, user_id=4458b9eced314106bc863f0076c1d630, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:08.413147 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01938d10-3b8a-4d75-a497-865fe164c09d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:08.429319 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 872/1737] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:08 2021] PUT /identity/v3/projects/e7ef0220e0794ca28e7d815f928f450e/users/4458b9eced314106bc863f0076c1d630/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:08.440829 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be61e2a-e03a-4955-8eff-fba1e71dad24 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:08.441547 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be61e2a-e03a-4955-8eff-fba1e71dad24 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:08.441990 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be61e2a-e03a-4955-8eff-fba1e71dad24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:08.487496 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-5be61e2a-e03a-4955-8eff-fba1e71dad24 None None] MFA Rules not processed for user `4458b9eced314106bc863f0076c1d630`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:08.488889 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-5be61e2a-e03a-4955-8eff-fba1e71dad24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:08.577016 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 866/1738] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:08 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:33:08.582897 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01938d10-3b8a-4d75-a497-865fe164c09d admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:08.674629 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01938d10-3b8a-4d75-a497-865fe164c09d admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:08.679808 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b834b8-f08a-4216-aca5-17549e541a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:08.680571 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b834b8-f08a-4216-aca5-17549e541a2f admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:08.680930 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b834b8-f08a-4216-aca5-17549e541a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:08.681691 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b834b8-f08a-4216-aca5-17549e541a2f admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:08.682476 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b834b8-f08a-4216-aca5-17549e541a2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:08.684664 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b834b8-f08a-4216-aca5-17549e541a2f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:08.728700 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820d06b-b974-4dd6-a3e1-3d25432da538 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:08.729000 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820d06b-b974-4dd6-a3e1-3d25432da538 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:08.729287 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820d06b-b974-4dd6-a3e1-3d25432da538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:08.744934 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 873/1739] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:33:08 2021] POST /identity/v3/projects => generated 389 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:08.745943 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b834b8-f08a-4216-aca5-17549e541a2f admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:08.762172 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-6820d06b-b974-4dd6-a3e1-3d25432da538 None None] MFA Rules not processed for user `ec1f566372814a95890d41b260573dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:08.763383 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-6820d06b-b974-4dd6-a3e1-3d25432da538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:08.828322 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 867/1740] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:08 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:08.828506 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b834b8-f08a-4216-aca5-17549e541a2f admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:08.834239 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd9c68-f74b-42b2-be88-b8f35d35a9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:08.834989 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd9c68-f74b-42b2-be88-b8f35d35a9dd admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:08.835397 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd9c68-f74b-42b2-be88-b8f35d35a9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:08.835673 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd9c68-f74b-42b2-be88-b8f35d35a9dd admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:08.836569 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd9c68-f74b-42b2-be88-b8f35d35a9dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:08.838736 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd9c68-f74b-42b2-be88-b8f35d35a9dd admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:08.871716 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 874/1741] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:33:08 2021] POST /identity/v3/users => generated 301 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:08.876023 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820d06b-b974-4dd6-a3e1-3d25432da538 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:08.888145 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd9c68-f74b-42b2-be88-b8f35d35a9dd admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:08.892311 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-8fbd9c68-f74b-42b2-be88-b8f35d35a9dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:08.894288 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820d06b-b974-4dd6-a3e1-3d25432da538 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:08.910543 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd9c68-f74b-42b2-be88-b8f35d35a9dd admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:08.911877 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617d3f1-9693-4d8d-9233-091556f6c3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:08.912627 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617d3f1-9693-4d8d-9233-091556f6c3cb admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:08.912940 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617d3f1-9693-4d8d-9233-091556f6c3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:08.913223 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617d3f1-9693-4d8d-9233-091556f6c3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:08.914118 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617d3f1-9693-4d8d-9233-091556f6c3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:08.916796 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617d3f1-9693-4d8d-9233-091556f6c3cb admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:08.918171 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eda3c9-397d-43ef-b31c-d5a71753c979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:08.919155 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eda3c9-397d-43ef-b31c-d5a71753c979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:08.919558 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eda3c9-397d-43ef-b31c-d5a71753c979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:08.919943 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eda3c9-397d-43ef-b31c-d5a71753c979 admin admin] PATH_INFO: `/v3/users/7d26a74565b549fc98781cb32ac74bd7` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:08.921937 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eda3c9-397d-43ef-b31c-d5a71753c979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d26a74565b549fc98781cb32ac74bd7)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:08.924003 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eda3c9-397d-43ef-b31c-d5a71753c979 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:08.931373 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 868/1742] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:08 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:08.938672 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617d3f1-9693-4d8d-9233-091556f6c3cb admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:08.950068 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617d3f1-9693-4d8d-9233-091556f6c3cb admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:08.956379 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a650c6d-8b42-4ceb-a5c9-f31e40fb6381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:08.957347 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a650c6d-8b42-4ceb-a5c9-f31e40fb6381 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:08.957689 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a650c6d-8b42-4ceb-a5c9-f31e40fb6381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:08.957950 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a650c6d-8b42-4ceb-a5c9-f31e40fb6381 admin admin] PATH_INFO: `/v3/projects/88c0a98ab6364ab3ad789ab39111cd64/users/f5b9fecb1b974c0d8b08129dcbf4819c/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:08.977404 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a650c6d-8b42-4ceb-a5c9-f31e40fb6381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c0a98ab6364ab3ad789ab39111cd64, user_id=f5b9fecb1b974c0d8b08129dcbf4819c, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:08.980292 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a650c6d-8b42-4ceb-a5c9-f31e40fb6381 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:08.985602 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-21eda3c9-397d-43ef-b31c-d5a71753c979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d26a74565b549fc98781cb32ac74bd7'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:08.996436 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-21eda3c9-397d-43ef-b31c-d5a71753c979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d26a74565b549fc98781cb32ac74bd7'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:08.999335 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 869/1743] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:08 2021] PUT /identity/v3/projects/88c0a98ab6364ab3ad789ab39111cd64/users/f5b9fecb1b974c0d8b08129dcbf4819c/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:09.003920 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a650c6d-8b42-4ceb-a5c9-f31e40fb6381 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:09.005966 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-21eda3c9-397d-43ef-b31c-d5a71753c979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d26a74565b549fc98781cb32ac74bd7'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:09.006702 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-21eda3c9-397d-43ef-b31c-d5a71753c979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d26a74565b549fc98781cb32ac74bd7'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:09.020835 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-21eda3c9-397d-43ef-b31c-d5a71753c979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d26a74565b549fc98781cb32ac74bd7'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:09.028954 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 875/1744] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:33:08 2021] DELETE /identity/v3/users/7d26a74565b549fc98781cb32ac74bd7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:33:09.091033 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a650c6d-8b42-4ceb-a5c9-f31e40fb6381 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:09.175747 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e874bc9-47c9-454b-97b5-044d7f4fa40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:09.176623 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e874bc9-47c9-454b-97b5-044d7f4fa40d admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:09.176913 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e874bc9-47c9-454b-97b5-044d7f4fa40d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:09.177199 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e874bc9-47c9-454b-97b5-044d7f4fa40d admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:09.177985 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e874bc9-47c9-454b-97b5-044d7f4fa40d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:09.180129 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e874bc9-47c9-454b-97b5-044d7f4fa40d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:09.199136 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 870/1745] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:09 2021] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:09.203558 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eda3c9-397d-43ef-b31c-d5a71753c979 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:09.205276 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-21eda3c9-397d-43ef-b31c-d5a71753c979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:09.220773 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eda3c9-397d-43ef-b31c-d5a71753c979 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:09.228433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fa28a-6cd5-4eb3-88d5-876ce43c8469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:09.228433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fa28a-6cd5-4eb3-88d5-876ce43c8469 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:09.228433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fa28a-6cd5-4eb3-88d5-876ce43c8469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:09.228433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fa28a-6cd5-4eb3-88d5-876ce43c8469 admin admin] PATH_INFO: `/v3/projects/88c0a98ab6364ab3ad789ab39111cd64/users/f5b9fecb1b974c0d8b08129dcbf4819c/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:09.230260 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e874bc9-47c9-454b-97b5-044d7f4fa40d admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:09.231417 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34fa28a-6cd5-4eb3-88d5-876ce43c8469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c0a98ab6364ab3ad789ab39111cd64, user_id=f5b9fecb1b974c0d8b08129dcbf4819c, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:09.233432 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4e874bc9-47c9-454b-97b5-044d7f4fa40d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:09.236425 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34fa28a-6cd5-4eb3-88d5-876ce43c8469 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:09.251086 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 876/1746] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:09 2021] PUT /identity/v3/projects/88c0a98ab6364ab3ad789ab39111cd64/users/f5b9fecb1b974c0d8b08129dcbf4819c/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:09.264890 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e874bc9-47c9-454b-97b5-044d7f4fa40d admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:09.266941 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be268a68-b2b7-474d-9c3d-47584ba98b1d None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:09.267468 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be268a68-b2b7-474d-9c3d-47584ba98b1d None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:09.267742 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be268a68-b2b7-474d-9c3d-47584ba98b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:09.297996 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-be268a68-b2b7-474d-9c3d-47584ba98b1d None None] MFA Rules not processed for user `f5b9fecb1b974c0d8b08129dcbf4819c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:09.299297 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-be268a68-b2b7-474d-9c3d-47584ba98b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:09.360259 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a837c-63e4-45c0-a078-eb1d90779812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:09.361146 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a837c-63e4-45c0-a078-eb1d90779812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:09.361457 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a837c-63e4-45c0-a078-eb1d90779812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:09.361813 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a837c-63e4-45c0-a078-eb1d90779812 admin admin] PATH_INFO: `/v3/projects/58182ff44b5a48d292366f5905d759cf` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:09.363123 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a837c-63e4-45c0-a078-eb1d90779812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58182ff44b5a48d292366f5905d759cf)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:09.365518 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a837c-63e4-45c0-a078-eb1d90779812 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:09.410777 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 877/1747] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:09 2021] POST /identity/v3/auth/tokens => generated 3476 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:33:09.421400 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be268a68-b2b7-474d-9c3d-47584ba98b1d None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:09.425291 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-be268a68-b2b7-474d-9c3d-47584ba98b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:09.465059 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b74a837c-63e4-45c0-a078-eb1d90779812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58182ff44b5a48d292366f5905d759cf', 'request_id': 'req-b74a837c-63e4-45c0-a078-eb1d90779812'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:09.477142 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b74a837c-63e4-45c0-a078-eb1d90779812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58182ff44b5a48d292366f5905d759cf', 'request_id': 'req-b74a837c-63e4-45c0-a078-eb1d90779812'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:09.496514 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b74a837c-63e4-45c0-a078-eb1d90779812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58182ff44b5a48d292366f5905d759cf', 'request_id': 'req-b74a837c-63e4-45c0-a078-eb1d90779812'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:09.524164 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b74a837c-63e4-45c0-a078-eb1d90779812 admin admin] The token cache is being invalidate because project 58182ff44b5a48d292366f5905d759cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:09.524695 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b74a837c-63e4-45c0-a078-eb1d90779812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:09.525589 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b74a837c-63e4-45c0-a078-eb1d90779812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:09.527364 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 871/1748] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:33:09 2021] DELETE /identity/v3/projects/58182ff44b5a48d292366f5905d759cf => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:09.540879 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a837c-63e4-45c0-a078-eb1d90779812 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:09.544870 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-b74a837c-63e4-45c0-a078-eb1d90779812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:09.576780 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be268a68-b2b7-474d-9c3d-47584ba98b1d None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:09.630755 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a837c-63e4-45c0-a078-eb1d90779812 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:09.636770 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485f752-046b-4149-a0eb-35e42cf23700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:09.637709 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485f752-046b-4149-a0eb-35e42cf23700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:09.637995 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485f752-046b-4149-a0eb-35e42cf23700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:09.638268 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485f752-046b-4149-a0eb-35e42cf23700 admin admin] PATH_INFO: `/v3/users/03dd50d958444d778e9181d9a25a207e` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:09.639803 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485f752-046b-4149-a0eb-35e42cf23700 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03dd50d958444d778e9181d9a25a207e)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:09.642732 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485f752-046b-4149-a0eb-35e42cf23700 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:09.663752 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba868c-d836-4039-94da-4136204b0fd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:09.664585 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba868c-d836-4039-94da-4136204b0fd3 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:09.664805 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba868c-d836-4039-94da-4136204b0fd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:09.665090 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba868c-d836-4039-94da-4136204b0fd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:09.668105 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-2aba868c-d836-4039-94da-4136204b0fd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:09.756907 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba868c-d836-4039-94da-4136204b0fd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:09.758596 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba868c-d836-4039-94da-4136204b0fd3 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:09.769327 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b485f752-046b-4149-a0eb-35e42cf23700 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03dd50d958444d778e9181d9a25a207e'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:09.772579 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 878/1749] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:09 2021] GET /identity/v3/auth/tokens => generated 3476 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:09.791758 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b485f752-046b-4149-a0eb-35e42cf23700 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03dd50d958444d778e9181d9a25a207e'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:09.794193 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b485f752-046b-4149-a0eb-35e42cf23700 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03dd50d958444d778e9181d9a25a207e'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:09.813335 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b485f752-046b-4149-a0eb-35e42cf23700 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03dd50d958444d778e9181d9a25a207e'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:09.858362 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b485f752-046b-4149-a0eb-35e42cf23700 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03dd50d958444d778e9181d9a25a207e'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:09.863505 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 872/1750] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:33:09 2021] DELETE /identity/v3/users/03dd50d958444d778e9181d9a25a207e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:09.968340 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba868c-d836-4039-94da-4136204b0fd3 service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:09.969906 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-2aba868c-d836-4039-94da-4136204b0fd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:09.984012 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba868c-d836-4039-94da-4136204b0fd3 service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:10.054834 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccde14-90d0-44e2-b33d-35f67f3721cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:10.055830 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccde14-90d0-44e2-b33d-35f67f3721cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:10.056379 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccde14-90d0-44e2-b33d-35f67f3721cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:10.056657 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccde14-90d0-44e2-b33d-35f67f3721cb admin admin] PATH_INFO: `/v3/users/4458b9eced314106bc863f0076c1d630` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:10.058015 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccde14-90d0-44e2-b33d-35f67f3721cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4458b9eced314106bc863f0076c1d630)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:10.059910 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccde14-90d0-44e2-b33d-35f67f3721cb admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:10.114592 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485f752-046b-4149-a0eb-35e42cf23700 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:10.116343 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-b485f752-046b-4149-a0eb-35e42cf23700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:10.122470 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-3bccde14-90d0-44e2-b33d-35f67f3721cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4458b9eced314106bc863f0076c1d630'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:10.133354 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-3bccde14-90d0-44e2-b33d-35f67f3721cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4458b9eced314106bc863f0076c1d630'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:10.140555 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485f752-046b-4149-a0eb-35e42cf23700 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:10.145669 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-3bccde14-90d0-44e2-b33d-35f67f3721cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4458b9eced314106bc863f0076c1d630'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:10.146379 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-3bccde14-90d0-44e2-b33d-35f67f3721cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4458b9eced314106bc863f0076c1d630'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:10.153266 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0ccc5-a7dd-4f43-927f-013ae01412a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:10.155135 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0ccc5-a7dd-4f43-927f-013ae01412a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:10.155593 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0ccc5-a7dd-4f43-927f-013ae01412a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:10.156369 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0ccc5-a7dd-4f43-927f-013ae01412a6 admin admin] PATH_INFO: `/v3/projects/73063a49586846b9b1f80cebac606333` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:10.160212 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0ccc5-a7dd-4f43-927f-013ae01412a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73063a49586846b9b1f80cebac606333)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:10.160444 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-3bccde14-90d0-44e2-b33d-35f67f3721cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4458b9eced314106bc863f0076c1d630'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:10.163572 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0ccc5-a7dd-4f43-927f-013ae01412a6 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:10.170008 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 879/1751] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:33:09 2021] DELETE /identity/v3/users/4458b9eced314106bc863f0076c1d630 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:10.175877 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48c21e-4b23-49f8-886b-1b23190c6024 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:10.176488 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48c21e-4b23-49f8-886b-1b23190c6024 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:10.177439 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48c21e-4b23-49f8-886b-1b23190c6024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:10.198867 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-0d48c21e-4b23-49f8-886b-1b23190c6024 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:10.200755 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-0d48c21e-4b23-49f8-886b-1b23190c6024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:10.227127 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-80a0ccc5-a7dd-4f43-927f-013ae01412a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73063a49586846b9b1f80cebac606333', 'request_id': 'req-80a0ccc5-a7dd-4f43-927f-013ae01412a6'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:10.234051 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-80a0ccc5-a7dd-4f43-927f-013ae01412a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73063a49586846b9b1f80cebac606333', 'request_id': 'req-80a0ccc5-a7dd-4f43-927f-013ae01412a6'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:10.246862 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-80a0ccc5-a7dd-4f43-927f-013ae01412a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73063a49586846b9b1f80cebac606333', 'request_id': 'req-80a0ccc5-a7dd-4f43-927f-013ae01412a6'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:10.260614 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-80a0ccc5-a7dd-4f43-927f-013ae01412a6 admin admin] The token cache is being invalidate because project 73063a49586846b9b1f80cebac606333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:10.260911 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-80a0ccc5-a7dd-4f43-927f-013ae01412a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:10.261610 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-80a0ccc5-a7dd-4f43-927f-013ae01412a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:10.267786 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 873/1752] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:33:10 2021] DELETE /identity/v3/projects/73063a49586846b9b1f80cebac606333 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:10.269231 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb26028-5934-4aad-9803-23c379037a9b None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:10.269617 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb26028-5934-4aad-9803-23c379037a9b None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:10.269911 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb26028-5934-4aad-9803-23c379037a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:10.303567 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 880/1753] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:10.307263 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-bcb26028-5934-4aad-9803-23c379037a9b None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:10.307871 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-bcb26028-5934-4aad-9803-23c379037a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:10.315694 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48c21e-4b23-49f8-886b-1b23190c6024 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:10.317304 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-0d48c21e-4b23-49f8-886b-1b23190c6024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:10.392315 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48c21e-4b23-49f8-886b-1b23190c6024 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:10.401146 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 874/1754] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:10.409192 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf9a81-3664-4ce0-a7e6-36c7f773056c None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:10.416548 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf9a81-3664-4ce0-a7e6-36c7f773056c None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:10.420366 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf9a81-3664-4ce0-a7e6-36c7f773056c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:10.453837 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-1edf9a81-3664-4ce0-a7e6-36c7f773056c None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:10.454954 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-1edf9a81-3664-4ce0-a7e6-36c7f773056c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:10.461468 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5926bd0-cf21-4a4c-9315-9a11c56153e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:10.462189 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5926bd0-cf21-4a4c-9315-9a11c56153e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:10.462518 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5926bd0-cf21-4a4c-9315-9a11c56153e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:10.462810 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5926bd0-cf21-4a4c-9315-9a11c56153e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:10.466119 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 875/1755] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:33:10.470503 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf9a81-3664-4ce0-a7e6-36c7f773056c None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:10.476831 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5926bd0-cf21-4a4c-9315-9a11c56153e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:10.478624 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5926bd0-cf21-4a4c-9315-9a11c56153e2 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:10.482376 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf9a81-3664-4ce0-a7e6-36c7f773056c None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:10.488925 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53186fa-11c7-4c61-b866-9ca19bb7e9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:10.489733 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53186fa-11c7-4c61-b866-9ca19bb7e9bf admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:10.490089 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53186fa-11c7-4c61-b866-9ca19bb7e9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:10.490275 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53186fa-11c7-4c61-b866-9ca19bb7e9bf admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:10.491058 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53186fa-11c7-4c61-b866-9ca19bb7e9bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:33:10.491171 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 881/1756] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:10.491381 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53186fa-11c7-4c61-b866-9ca19bb7e9bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:10.493297 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53186fa-11c7-4c61-b866-9ca19bb7e9bf admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:10.509404 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 876/1757] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:33:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:33:10.514348 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5926bd0-cf21-4a4c-9315-9a11c56153e2 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:10.527569 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5926bd0-cf21-4a4c-9315-9a11c56153e2 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:10.535295 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab376ec1-ea83-4df2-bf86-76233f38ff1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:10.536093 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab376ec1-ea83-4df2-bf86-76233f38ff1e admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:10.536520 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab376ec1-ea83-4df2-bf86-76233f38ff1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:10.536819 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab376ec1-ea83-4df2-bf86-76233f38ff1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:10.537716 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab376ec1-ea83-4df2-bf86-76233f38ff1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:10.540292 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab376ec1-ea83-4df2-bf86-76233f38ff1e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:10.580539 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 882/1758] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:33:10 2021] POST /identity/v3/projects => generated 381 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:33:10.582318 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53186fa-11c7-4c61-b866-9ca19bb7e9bf admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:10.593031 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53186fa-11c7-4c61-b866-9ca19bb7e9bf admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:10.696420 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846eac0-435c-43ff-9e4c-949059e394f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:10.697099 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846eac0-435c-43ff-9e4c-949059e394f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:10.697400 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846eac0-435c-43ff-9e4c-949059e394f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:10.697713 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846eac0-435c-43ff-9e4c-949059e394f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:10.698497 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e846eac0-435c-43ff-9e4c-949059e394f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:10.700424 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e846eac0-435c-43ff-9e4c-949059e394f8 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:10.724104 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 877/1759] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:33:10 2021] POST /identity/v3/users => generated 291 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:10.726685 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab376ec1-ea83-4df2-bf86-76233f38ff1e admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:10.747676 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab376ec1-ea83-4df2-bf86-76233f38ff1e admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:10.753029 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243b66b-fe60-484d-8e9f-85f6135e5359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:10.753730 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243b66b-fe60-484d-8e9f-85f6135e5359 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:10.754018 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243b66b-fe60-484d-8e9f-85f6135e5359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:10.754298 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243b66b-fe60-484d-8e9f-85f6135e5359 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:10.755030 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243b66b-fe60-484d-8e9f-85f6135e5359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:10.756657 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243b66b-fe60-484d-8e9f-85f6135e5359 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:10.767322 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 883/1760] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:10 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:10.772415 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846eac0-435c-43ff-9e4c-949059e394f8 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:10.784831 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846eac0-435c-43ff-9e4c-949059e394f8 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:10.791426 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c74c4-a301-4ad0-8c14-c303acbf5f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:10.792121 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c74c4-a301-4ad0-8c14-c303acbf5f37 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:10.792408 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c74c4-a301-4ad0-8c14-c303acbf5f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:10.792685 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c74c4-a301-4ad0-8c14-c303acbf5f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:10.793420 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c74c4-a301-4ad0-8c14-c303acbf5f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:10.795032 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c74c4-a301-4ad0-8c14-c303acbf5f37 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:10.799817 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243b66b-fe60-484d-8e9f-85f6135e5359 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:10.801628 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-1243b66b-fe60-484d-8e9f-85f6135e5359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:10.809515 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 878/1761] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:10 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:10.814694 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c74c4-a301-4ad0-8c14-c303acbf5f37 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:10.820009 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243b66b-fe60-484d-8e9f-85f6135e5359 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:10.825786 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5862e38-393d-4512-a8af-64aabcef2789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:10.826278 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c74c4-a301-4ad0-8c14-c303acbf5f37 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:10.826543 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5862e38-393d-4512-a8af-64aabcef2789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:10.826787 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5862e38-393d-4512-a8af-64aabcef2789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:10.827046 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5862e38-393d-4512-a8af-64aabcef2789 admin admin] PATH_INFO: `/v3/projects/e7ef0220e0794ca28e7d815f928f450e` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:10.828249 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5862e38-393d-4512-a8af-64aabcef2789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7ef0220e0794ca28e7d815f928f450e)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:10.830174 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5862e38-393d-4512-a8af-64aabcef2789 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:10.832262 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648ef2e-ae85-41cd-9c98-f65a773bf12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:10.833176 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648ef2e-ae85-41cd-9c98-f65a773bf12e admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:10.833463 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648ef2e-ae85-41cd-9c98-f65a773bf12e admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:10.833780 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648ef2e-ae85-41cd-9c98-f65a773bf12e admin admin] PATH_INFO: `/v3/projects/3019a35a6239472a94bc23a5dc2c5a63/users/725d12e9a59046238cfeee2023d450c0/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:10.848075 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648ef2e-ae85-41cd-9c98-f65a773bf12e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3019a35a6239472a94bc23a5dc2c5a63, user_id=725d12e9a59046238cfeee2023d450c0, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:10.850760 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648ef2e-ae85-41cd-9c98-f65a773bf12e admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:10.863721 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 879/1762] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:10 2021] PUT /identity/v3/projects/3019a35a6239472a94bc23a5dc2c5a63/users/725d12e9a59046238cfeee2023d450c0/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:10.877064 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d107f3-ca3b-49f4-89c7-70f810008a7b None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:10.877375 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d107f3-ca3b-49f4-89c7-70f810008a7b None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:10.878308 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d107f3-ca3b-49f4-89c7-70f810008a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:10.888838 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-a5862e38-393d-4512-a8af-64aabcef2789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7ef0220e0794ca28e7d815f928f450e', 'request_id': 'req-a5862e38-393d-4512-a8af-64aabcef2789'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:10.897679 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-a5862e38-393d-4512-a8af-64aabcef2789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7ef0220e0794ca28e7d815f928f450e', 'request_id': 'req-a5862e38-393d-4512-a8af-64aabcef2789'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:10.906225 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-a5862e38-393d-4512-a8af-64aabcef2789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7ef0220e0794ca28e7d815f928f450e', 'request_id': 'req-a5862e38-393d-4512-a8af-64aabcef2789'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:10.911532 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-88d107f3-ca3b-49f4-89c7-70f810008a7b None None] MFA Rules not processed for user `725d12e9a59046238cfeee2023d450c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:10.912936 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-88d107f3-ca3b-49f4-89c7-70f810008a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:10.917902 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-a5862e38-393d-4512-a8af-64aabcef2789 admin admin] The token cache is being invalidate because project e7ef0220e0794ca28e7d815f928f450e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:10.918389 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-a5862e38-393d-4512-a8af-64aabcef2789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:10.919151 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-a5862e38-393d-4512-a8af-64aabcef2789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:10.920806 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 884/1763] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:33:10 2021] DELETE /identity/v3/projects/e7ef0220e0794ca28e7d815f928f450e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:10.924514 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5862e38-393d-4512-a8af-64aabcef2789 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:10.925828 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-a5862e38-393d-4512-a8af-64aabcef2789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:10.976727 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 880/1764] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:10 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:10.981093 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d107f3-ca3b-49f4-89c7-70f810008a7b None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:10.982382 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-88d107f3-ca3b-49f4-89c7-70f810008a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:10.990016 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5862e38-393d-4512-a8af-64aabcef2789 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:10.995154 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d107f3-ca3b-49f4-89c7-70f810008a7b None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:10.995337 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0020e-5471-4ccb-b54c-6bddd82ef075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:10.996148 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0020e-5471-4ccb-b54c-6bddd82ef075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:10.996433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0020e-5471-4ccb-b54c-6bddd82ef075 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:10.996709 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0020e-5471-4ccb-b54c-6bddd82ef075 admin admin] PATH_INFO: `/v3/users/f5b9fecb1b974c0d8b08129dcbf4819c` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:10.997960 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0020e-5471-4ccb-b54c-6bddd82ef075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5b9fecb1b974c0d8b08129dcbf4819c)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:10.999887 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0020e-5471-4ccb-b54c-6bddd82ef075 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:11.000089 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a483c83-9dd7-4b42-95fb-16229fa2b920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:11.000940 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a483c83-9dd7-4b42-95fb-16229fa2b920 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:11.001232 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a483c83-9dd7-4b42-95fb-16229fa2b920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:11.001615 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a483c83-9dd7-4b42-95fb-16229fa2b920 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:11.002276 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a483c83-9dd7-4b42-95fb-16229fa2b920 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:11.004753 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a483c83-9dd7-4b42-95fb-16229fa2b920 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:11.033521 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 881/1765] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:33:10 2021] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:33:11.036936 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a483c83-9dd7-4b42-95fb-16229fa2b920 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:11.058183 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-b7e0020e-5471-4ccb-b54c-6bddd82ef075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5b9fecb1b974c0d8b08129dcbf4819c'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:11.068334 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-b7e0020e-5471-4ccb-b54c-6bddd82ef075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5b9fecb1b974c0d8b08129dcbf4819c'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:11.076569 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-b7e0020e-5471-4ccb-b54c-6bddd82ef075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5b9fecb1b974c0d8b08129dcbf4819c'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:11.077304 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-b7e0020e-5471-4ccb-b54c-6bddd82ef075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5b9fecb1b974c0d8b08129dcbf4819c'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:11.091858 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-b7e0020e-5471-4ccb-b54c-6bddd82ef075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5b9fecb1b974c0d8b08129dcbf4819c'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:11.099677 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 885/1766] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:33:10 2021] DELETE /identity/v3/users/f5b9fecb1b974c0d8b08129dcbf4819c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:33:11.104970 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a483c83-9dd7-4b42-95fb-16229fa2b920 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:11.179676 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3b287-7964-4b4b-a8b7-438e214300d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:11.180321 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3b287-7964-4b4b-a8b7-438e214300d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:11.180407 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3b287-7964-4b4b-a8b7-438e214300d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:11.180949 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3b287-7964-4b4b-a8b7-438e214300d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:11.181775 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3b287-7964-4b4b-a8b7-438e214300d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:11.183688 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3b287-7964-4b4b-a8b7-438e214300d1 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:11.208097 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 882/1767] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:33:11 2021] POST /identity/v3/users => generated 296 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:11.209399 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0020e-5471-4ccb-b54c-6bddd82ef075 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:11.211089 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-b7e0020e-5471-4ccb-b54c-6bddd82ef075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:11.224835 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0020e-5471-4ccb-b54c-6bddd82ef075 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:11.231521 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6bf07-234d-4f27-8bf4-35509baf9d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:11.232516 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6bf07-234d-4f27-8bf4-35509baf9d4f admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:11.232628 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6bf07-234d-4f27-8bf4-35509baf9d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:11.233025 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6bf07-234d-4f27-8bf4-35509baf9d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:11.233940 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6bf07-234d-4f27-8bf4-35509baf9d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:11.235648 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6bf07-234d-4f27-8bf4-35509baf9d4f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:11.255956 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 886/1768] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:11 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:11.257102 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3b287-7964-4b4b-a8b7-438e214300d1 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:11.270198 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3b287-7964-4b4b-a8b7-438e214300d1 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:11.275035 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af2b23-214c-4e81-a9ad-5bde61abb85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:11.276034 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af2b23-214c-4e81-a9ad-5bde61abb85b admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:11.276326 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af2b23-214c-4e81-a9ad-5bde61abb85b admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:11.276605 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af2b23-214c-4e81-a9ad-5bde61abb85b admin admin] PATH_INFO: `/v3/projects/43029cf2fa784b69b5f03843f5c728d7/users/9c8469e9b1314f1eb98d8a9dfbecef48/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:11.293140 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af2b23-214c-4e81-a9ad-5bde61abb85b admin admin] RBAC: Authorizing `identity:create_grant(project_id=43029cf2fa784b69b5f03843f5c728d7, user_id=9c8469e9b1314f1eb98d8a9dfbecef48, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:11.295845 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af2b23-214c-4e81-a9ad-5bde61abb85b admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:11.311385 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 883/1769] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:11 2021] PUT /identity/v3/projects/43029cf2fa784b69b5f03843f5c728d7/users/9c8469e9b1314f1eb98d8a9dfbecef48/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:33:11.316099 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6bf07-234d-4f27-8bf4-35509baf9d4f admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:11.331115 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6bf07-234d-4f27-8bf4-35509baf9d4f admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:11.389098 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0a628-8c6f-4339-a01c-c56f0e9ffd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:11.389876 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0a628-8c6f-4339-a01c-c56f0e9ffd53 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:11.390162 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0a628-8c6f-4339-a01c-c56f0e9ffd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:11.390441 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0a628-8c6f-4339-a01c-c56f0e9ffd53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:11.391175 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0a628-8c6f-4339-a01c-c56f0e9ffd53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:11.392767 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0a628-8c6f-4339-a01c-c56f0e9ffd53 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:11.403601 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 887/1770] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:11 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:11.409771 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af2b23-214c-4e81-a9ad-5bde61abb85b admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:11.421090 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af2b23-214c-4e81-a9ad-5bde61abb85b admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:11.427306 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ea028-781f-4277-9eb8-864c93bedfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:11.428242 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ea028-781f-4277-9eb8-864c93bedfbb admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:11.428525 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ea028-781f-4277-9eb8-864c93bedfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:11.428958 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ea028-781f-4277-9eb8-864c93bedfbb admin admin] PATH_INFO: `/v3/projects/43029cf2fa784b69b5f03843f5c728d7/users/9c8469e9b1314f1eb98d8a9dfbecef48/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:11.431823 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ea028-781f-4277-9eb8-864c93bedfbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=43029cf2fa784b69b5f03843f5c728d7, user_id=9c8469e9b1314f1eb98d8a9dfbecef48, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:11.436533 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0a628-8c6f-4339-a01c-c56f0e9ffd53 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:11.437525 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ea028-781f-4277-9eb8-864c93bedfbb admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:11.440640 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-b6e0a628-8c6f-4339-a01c-c56f0e9ffd53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:11.456395 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0a628-8c6f-4339-a01c-c56f0e9ffd53 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:11.468115 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 884/1771] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:11 2021] PUT /identity/v3/projects/43029cf2fa784b69b5f03843f5c728d7/users/9c8469e9b1314f1eb98d8a9dfbecef48/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:11.470798 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe8b08-79d0-4590-9e04-52741227b23d None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:11.477585 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe8b08-79d0-4590-9e04-52741227b23d None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:11.478488 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe8b08-79d0-4590-9e04-52741227b23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:11.509277 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-4ffe8b08-79d0-4590-9e04-52741227b23d None None] MFA Rules not processed for user `9c8469e9b1314f1eb98d8a9dfbecef48`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:11.510648 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4ffe8b08-79d0-4590-9e04-52741227b23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:11.528761 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef3a92-1c32-4551-ba05-467179af8a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:11.529574 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef3a92-1c32-4551-ba05-467179af8a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:11.529861 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef3a92-1c32-4551-ba05-467179af8a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:11.530148 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef3a92-1c32-4551-ba05-467179af8a2a admin admin] PATH_INFO: `/v3/projects/88c0a98ab6364ab3ad789ab39111cd64` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:11.531372 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef3a92-1c32-4551-ba05-467179af8a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c0a98ab6364ab3ad789ab39111cd64)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:11.533353 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef3a92-1c32-4551-ba05-467179af8a2a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:11.590111 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-2bef3a92-1c32-4551-ba05-467179af8a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c0a98ab6364ab3ad789ab39111cd64', 'request_id': 'req-2bef3a92-1c32-4551-ba05-467179af8a2a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:11.592013 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 885/1772] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:11 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:33:11.596852 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-2bef3a92-1c32-4551-ba05-467179af8a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c0a98ab6364ab3ad789ab39111cd64', 'request_id': 'req-2bef3a92-1c32-4551-ba05-467179af8a2a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:11.597906 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe8b08-79d0-4590-9e04-52741227b23d None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:11.605083 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-2bef3a92-1c32-4551-ba05-467179af8a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c0a98ab6364ab3ad789ab39111cd64', 'request_id': 'req-2bef3a92-1c32-4551-ba05-467179af8a2a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:11.611511 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe8b08-79d0-4590-9e04-52741227b23d None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:11.617428 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-2bef3a92-1c32-4551-ba05-467179af8a2a admin admin] The token cache is being invalidate because project 88c0a98ab6364ab3ad789ab39111cd64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:11.617753 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-2bef3a92-1c32-4551-ba05-467179af8a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:11.618407 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-2bef3a92-1c32-4551-ba05-467179af8a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:11.620178 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 888/1773] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:33:11 2021] DELETE /identity/v3/projects/88c0a98ab6364ab3ad789ab39111cd64 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:11.625599 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff6079-4b63-470a-aaff-d3dda479b765 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:11.625899 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff6079-4b63-470a-aaff-d3dda479b765 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:11.626186 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff6079-4b63-470a-aaff-d3dda479b765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:11.645029 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-12ff6079-4b63-470a-aaff-d3dda479b765 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:11.646266 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-12ff6079-4b63-470a-aaff-d3dda479b765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:11.666118 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bad365-b47f-4c99-ae09-39d8be226920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:11.667049 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bad365-b47f-4c99-ae09-39d8be226920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:11.667391 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bad365-b47f-4c99-ae09-39d8be226920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:11.667613 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bad365-b47f-4c99-ae09-39d8be226920 admin admin] PATH_INFO: `/v3/users/725d12e9a59046238cfeee2023d450c0` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:11.668831 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bad365-b47f-4c99-ae09-39d8be226920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=725d12e9a59046238cfeee2023d450c0)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:11.670829 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bad365-b47f-4c99-ae09-39d8be226920 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:11.713229 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 889/1774] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:33:11.715554 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386b06b-72e7-48ed-b46e-24fa707f5b15 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:11.715852 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386b06b-72e7-48ed-b46e-24fa707f5b15 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:11.716132 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386b06b-72e7-48ed-b46e-24fa707f5b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:11.737232 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-5386b06b-72e7-48ed-b46e-24fa707f5b15 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:11.738716 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-5386b06b-72e7-48ed-b46e-24fa707f5b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:11.740653 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-56bad365-b47f-4c99-ae09-39d8be226920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '725d12e9a59046238cfeee2023d450c0'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:11.747629 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 890/1775] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:11.748593 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-56bad365-b47f-4c99-ae09-39d8be226920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '725d12e9a59046238cfeee2023d450c0'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:11.749380 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-56bad365-b47f-4c99-ae09-39d8be226920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '725d12e9a59046238cfeee2023d450c0'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:11.751989 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386b06b-72e7-48ed-b46e-24fa707f5b15 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:11.762692 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386b06b-72e7-48ed-b46e-24fa707f5b15 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:11.763354 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-56bad365-b47f-4c99-ae09-39d8be226920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '725d12e9a59046238cfeee2023d450c0'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:11.767479 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaae22a-beda-414b-8b9b-c75504a90fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:11.768126 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaae22a-beda-414b-8b9b-c75504a90fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:11.768941 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaae22a-beda-414b-8b9b-c75504a90fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:11.769223 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaae22a-beda-414b-8b9b-c75504a90fe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:11.769987 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaae22a-beda-414b-8b9b-c75504a90fe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:33:11.770307 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaae22a-beda-414b-8b9b-c75504a90fe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:11.771861 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaae22a-beda-414b-8b9b-c75504a90fe4 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:11.772237 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-56bad365-b47f-4c99-ae09-39d8be226920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '725d12e9a59046238cfeee2023d450c0'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:11.778554 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 886/1776] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:33:11 2021] DELETE /identity/v3/users/725d12e9a59046238cfeee2023d450c0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:33:11.783783 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57551f7b-56c4-45d2-98f7-7aeba93b7eb9 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:11.784087 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57551f7b-56c4-45d2-98f7-7aeba93b7eb9 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:11.784601 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57551f7b-56c4-45d2-98f7-7aeba93b7eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:11.785029 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 891/1777] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:33:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:33:11.789365 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaae22a-beda-414b-8b9b-c75504a90fe4 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:11.791524 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-6aaae22a-beda-414b-8b9b-c75504a90fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:11.803319 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-57551f7b-56c4-45d2-98f7-7aeba93b7eb9 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:11.803881 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaae22a-beda-414b-8b9b-c75504a90fe4 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:11.804617 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-57551f7b-56c4-45d2-98f7-7aeba93b7eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:11.864711 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc58fb-de01-4909-a0b9-04cecaeb87bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:11.865415 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc58fb-de01-4909-a0b9-04cecaeb87bf admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:11.865733 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc58fb-de01-4909-a0b9-04cecaeb87bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:11.865892 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 887/1778] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:11.866033 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc58fb-de01-4909-a0b9-04cecaeb87bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:11.866712 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc58fb-de01-4909-a0b9-04cecaeb87bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:11.868743 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc58fb-de01-4909-a0b9-04cecaeb87bf admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:11.875935 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57551f7b-56c4-45d2-98f7-7aeba93b7eb9 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:11.878330 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-57551f7b-56c4-45d2-98f7-7aeba93b7eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:11.901059 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 892/1779] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:33:11 2021] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:33:11.902208 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc58fb-de01-4909-a0b9-04cecaeb87bf admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:11.936769 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57551f7b-56c4-45d2-98f7-7aeba93b7eb9 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:11.976664 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc58fb-de01-4909-a0b9-04cecaeb87bf admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:11.981636 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86945b7-37fd-4e35-b81c-a6561b10173a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:11.982316 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86945b7-37fd-4e35-b81c-a6561b10173a admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:11.982604 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86945b7-37fd-4e35-b81c-a6561b10173a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:11.982885 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86945b7-37fd-4e35-b81c-a6561b10173a admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:11.983599 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86945b7-37fd-4e35-b81c-a6561b10173a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:11.985525 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86945b7-37fd-4e35-b81c-a6561b10173a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:11.996678 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818937f-78f6-4883-9cc5-c9a94ac30d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:11.997318 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818937f-78f6-4883-9cc5-c9a94ac30d67 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:11.997673 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818937f-78f6-4883-9cc5-c9a94ac30d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:11.998057 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818937f-78f6-4883-9cc5-c9a94ac30d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:12.007306 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 893/1780] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:33:11 2021] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:12.008889 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818937f-78f6-4883-9cc5-c9a94ac30d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:12.010372 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818937f-78f6-4883-9cc5-c9a94ac30d67 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:12.011271 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86945b7-37fd-4e35-b81c-a6561b10173a admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:12.019896 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 888/1781] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:33:12.020903 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86945b7-37fd-4e35-b81c-a6561b10173a admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:12.025512 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf06e3-f491-48ee-8dcd-d43f343819d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:12.026173 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf06e3-f491-48ee-8dcd-d43f343819d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:12.026458 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf06e3-f491-48ee-8dcd-d43f343819d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:12.026739 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf06e3-f491-48ee-8dcd-d43f343819d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:12.027476 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf06e3-f491-48ee-8dcd-d43f343819d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:12.029072 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf06e3-f491-48ee-8dcd-d43f343819d2 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:12.039079 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 894/1782] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:12 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:33:12.042918 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818937f-78f6-4883-9cc5-c9a94ac30d67 service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:12.053331 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818937f-78f6-4883-9cc5-c9a94ac30d67 service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:12.058827 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61fbc8e-356e-4336-a8e6-f5dee1e4c006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:12.059493 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fbc8e-356e-4336-a8e6-f5dee1e4c006 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:12.060209 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fbc8e-356e-4336-a8e6-f5dee1e4c006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:12.060546 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fbc8e-356e-4336-a8e6-f5dee1e4c006 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:12.061231 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61fbc8e-356e-4336-a8e6-f5dee1e4c006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:12.062843 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61fbc8e-356e-4336-a8e6-f5dee1e4c006 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:12.076443 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 889/1783] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:12 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:33:12.077745 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf06e3-f491-48ee-8dcd-d43f343819d2 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:12.088165 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf06e3-f491-48ee-8dcd-d43f343819d2 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:12.093117 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc07079-eee7-4cd6-be6c-8293db4c5053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:12.094135 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc07079-eee7-4cd6-be6c-8293db4c5053 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:12.095133 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc07079-eee7-4cd6-be6c-8293db4c5053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:12.095133 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc07079-eee7-4cd6-be6c-8293db4c5053 admin admin] PATH_INFO: `/v3/projects/420e14da703f4b1eacb0d95179a412f1/users/bd91126cf45246e7bff3f96c7e4a6e8e/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:12.111114 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc07079-eee7-4cd6-be6c-8293db4c5053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=420e14da703f4b1eacb0d95179a412f1, user_id=bd91126cf45246e7bff3f96c7e4a6e8e, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:12.114315 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc07079-eee7-4cd6-be6c-8293db4c5053 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:12.128609 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 895/1784] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:12 2021] PUT /identity/v3/projects/420e14da703f4b1eacb0d95179a412f1/users/bd91126cf45246e7bff3f96c7e4a6e8e/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:33:12.140056 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa4329-977a-4f50-b8b2-84b8c13d8ecb None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:12.140347 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa4329-977a-4f50-b8b2-84b8c13d8ecb None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:12.140629 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa4329-977a-4f50-b8b2-84b8c13d8ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:12.170154 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-1dfa4329-977a-4f50-b8b2-84b8c13d8ecb None None] MFA Rules not processed for user `bd91126cf45246e7bff3f96c7e4a6e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:12.171441 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-1dfa4329-977a-4f50-b8b2-84b8c13d8ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:12.252067 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 890/1785] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:12 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:33:12.257320 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc07079-eee7-4cd6-be6c-8293db4c5053 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:12.304092 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa4329-977a-4f50-b8b2-84b8c13d8ecb None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:12.305897 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-1dfa4329-977a-4f50-b8b2-84b8c13d8ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:12.347354 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc07079-eee7-4cd6-be6c-8293db4c5053 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:12.360157 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85884cce-6e38-46fd-a724-813e1e3da331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:12.361085 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85884cce-6e38-46fd-a724-813e1e3da331 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:12.361568 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85884cce-6e38-46fd-a724-813e1e3da331 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:12.362655 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85884cce-6e38-46fd-a724-813e1e3da331 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:12.363422 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85884cce-6e38-46fd-a724-813e1e3da331 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:12.366057 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85884cce-6e38-46fd-a724-813e1e3da331 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:12.394708 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa4329-977a-4f50-b8b2-84b8c13d8ecb None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:12.397517 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 896/1786] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:33:12 2021] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:33:12.399846 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85884cce-6e38-46fd-a724-813e1e3da331 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:12.473961 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6751b9-b3a7-458e-8462-ab25116f840f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:12.474145 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85884cce-6e38-46fd-a724-813e1e3da331 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:12.474826 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6751b9-b3a7-458e-8462-ab25116f840f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:12.475108 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6751b9-b3a7-458e-8462-ab25116f840f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:12.475385 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6751b9-b3a7-458e-8462-ab25116f840f admin admin] PATH_INFO: `/v3/projects/3019a35a6239472a94bc23a5dc2c5a63` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:12.476550 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6751b9-b3a7-458e-8462-ab25116f840f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3019a35a6239472a94bc23a5dc2c5a63)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:12.478473 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6751b9-b3a7-458e-8462-ab25116f840f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:12.478961 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c9487-6ab5-4430-b508-5522060bab6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:12.479634 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c9487-6ab5-4430-b508-5522060bab6b admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:12.479925 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c9487-6ab5-4430-b508-5522060bab6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:12.480201 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c9487-6ab5-4430-b508-5522060bab6b admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:12.480964 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c9487-6ab5-4430-b508-5522060bab6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:12.483223 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c9487-6ab5-4430-b508-5522060bab6b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:12.506578 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 897/1787] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:33:12 2021] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:33:12.510482 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c9487-6ab5-4430-b508-5522060bab6b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:12.521389 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c9487-6ab5-4430-b508-5522060bab6b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:12.532530 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4d6751b9-b3a7-458e-8462-ab25116f840f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3019a35a6239472a94bc23a5dc2c5a63', 'request_id': 'req-4d6751b9-b3a7-458e-8462-ab25116f840f'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:12.537995 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4d6751b9-b3a7-458e-8462-ab25116f840f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3019a35a6239472a94bc23a5dc2c5a63', 'request_id': 'req-4d6751b9-b3a7-458e-8462-ab25116f840f'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:12.545518 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4d6751b9-b3a7-458e-8462-ab25116f840f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3019a35a6239472a94bc23a5dc2c5a63', 'request_id': 'req-4d6751b9-b3a7-458e-8462-ab25116f840f'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:12.556690 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4d6751b9-b3a7-458e-8462-ab25116f840f admin admin] The token cache is being invalidate because project 3019a35a6239472a94bc23a5dc2c5a63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:12.556979 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4d6751b9-b3a7-458e-8462-ab25116f840f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:12.557657 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4d6751b9-b3a7-458e-8462-ab25116f840f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:12.559202 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 891/1788] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:33:12 2021] DELETE /identity/v3/projects/3019a35a6239472a94bc23a5dc2c5a63 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:12.563137 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6751b9-b3a7-458e-8462-ab25116f840f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:12.564433 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4d6751b9-b3a7-458e-8462-ab25116f840f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:12.578322 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4ccb3-97a1-4259-ae89-d44a74dc2436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:12.578985 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4ccb3-97a1-4259-ae89-d44a74dc2436 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:12.579271 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4ccb3-97a1-4259-ae89-d44a74dc2436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:12.579550 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4ccb3-97a1-4259-ae89-d44a74dc2436 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:12.580281 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4ccb3-97a1-4259-ae89-d44a74dc2436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:12.582584 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4ccb3-97a1-4259-ae89-d44a74dc2436 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:12.592546 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 898/1789] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:12 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:33:12.596317 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4ccb3-97a1-4259-ae89-d44a74dc2436 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:12.598046 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-40d4ccb3-97a1-4259-ae89-d44a74dc2436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:12.609851 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4ccb3-97a1-4259-ae89-d44a74dc2436 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:12.614960 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803f8a6-7720-4481-ab89-581ac1cc722d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:12.615828 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803f8a6-7720-4481-ab89-581ac1cc722d admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:12.617567 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803f8a6-7720-4481-ab89-581ac1cc722d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:12.617567 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803f8a6-7720-4481-ab89-581ac1cc722d admin admin] PATH_INFO: `/v3/projects/4e14aa8d3e934db6a1505493c92a5e0d/users/31401f753c074ea1b4e7fd68090fe25c/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:12.626980 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6751b9-b3a7-458e-8462-ab25116f840f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:12.632792 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3ee4b-760a-4fd5-9ccc-41866a56c4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:12.633702 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3ee4b-760a-4fd5-9ccc-41866a56c4af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:12.633988 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3ee4b-760a-4fd5-9ccc-41866a56c4af admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:12.634267 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3ee4b-760a-4fd5-9ccc-41866a56c4af admin admin] PATH_INFO: `/v3/users/9c8469e9b1314f1eb98d8a9dfbecef48` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:12.635508 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3ee4b-760a-4fd5-9ccc-41866a56c4af admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c8469e9b1314f1eb98d8a9dfbecef48)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:12.636017 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803f8a6-7720-4481-ab89-581ac1cc722d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e14aa8d3e934db6a1505493c92a5e0d, user_id=31401f753c074ea1b4e7fd68090fe25c, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:12.637413 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3ee4b-760a-4fd5-9ccc-41866a56c4af admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:12.638898 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803f8a6-7720-4481-ab89-581ac1cc722d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:12.657402 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 899/1790] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:12 2021] PUT /identity/v3/projects/4e14aa8d3e934db6a1505493c92a5e0d/users/31401f753c074ea1b4e7fd68090fe25c/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:33:12.658482 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803f8a6-7720-4481-ab89-581ac1cc722d admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:12.701576 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4bb3ee4b-760a-4fd5-9ccc-41866a56c4af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c8469e9b1314f1eb98d8a9dfbecef48'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:12.709898 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4bb3ee4b-760a-4fd5-9ccc-41866a56c4af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c8469e9b1314f1eb98d8a9dfbecef48'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:12.710797 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4bb3ee4b-760a-4fd5-9ccc-41866a56c4af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c8469e9b1314f1eb98d8a9dfbecef48'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:12.724255 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4bb3ee4b-760a-4fd5-9ccc-41866a56c4af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c8469e9b1314f1eb98d8a9dfbecef48'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:12.726598 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803f8a6-7720-4481-ab89-581ac1cc722d admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:12.732292 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98f48c-46b0-4cba-932f-bb15a1fb521f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:12.733036 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98f48c-46b0-4cba-932f-bb15a1fb521f admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:12.733323 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98f48c-46b0-4cba-932f-bb15a1fb521f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:12.733673 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98f48c-46b0-4cba-932f-bb15a1fb521f admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:12.734232 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4bb3ee4b-760a-4fd5-9ccc-41866a56c4af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c8469e9b1314f1eb98d8a9dfbecef48'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:12.734646 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98f48c-46b0-4cba-932f-bb15a1fb521f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:12.736296 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98f48c-46b0-4cba-932f-bb15a1fb521f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:12.743128 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 892/1791] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:33:12 2021] DELETE /identity/v3/users/9c8469e9b1314f1eb98d8a9dfbecef48 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:33:12.751365 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 900/1792] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:12 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:33:12.757523 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3ee4b-760a-4fd5-9ccc-41866a56c4af admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:12.761287 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4bb3ee4b-760a-4fd5-9ccc-41866a56c4af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:12.847910 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3ee4b-760a-4fd5-9ccc-41866a56c4af admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:12.855740 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54664a41-ad8f-458a-be63-11fdc7f6d82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:12.856634 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54664a41-ad8f-458a-be63-11fdc7f6d82a admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:12.856922 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54664a41-ad8f-458a-be63-11fdc7f6d82a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:12.857203 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54664a41-ad8f-458a-be63-11fdc7f6d82a admin admin] PATH_INFO: `/v3/projects/4e14aa8d3e934db6a1505493c92a5e0d/users/31401f753c074ea1b4e7fd68090fe25c/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:12.860084 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54664a41-ad8f-458a-be63-11fdc7f6d82a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e14aa8d3e934db6a1505493c92a5e0d, user_id=31401f753c074ea1b4e7fd68090fe25c, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:12.863515 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54664a41-ad8f-458a-be63-11fdc7f6d82a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:12.877577 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 893/1793] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:12 2021] PUT /identity/v3/projects/4e14aa8d3e934db6a1505493c92a5e0d/users/31401f753c074ea1b4e7fd68090fe25c/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:12.886707 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3a2bf-2432-4b42-a2ca-d356fec1d8e2 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:12.887239 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3a2bf-2432-4b42-a2ca-d356fec1d8e2 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:12.887535 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3a2bf-2432-4b42-a2ca-d356fec1d8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:12.918331 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-05d3a2bf-2432-4b42-a2ca-d356fec1d8e2 None None] MFA Rules not processed for user `31401f753c074ea1b4e7fd68090fe25c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:12.919721 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-05d3a2bf-2432-4b42-a2ca-d356fec1d8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:13.062826 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 901/1794] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:12 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:33:13.068378 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54664a41-ad8f-458a-be63-11fdc7f6d82a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:13.070498 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-54664a41-ad8f-458a-be63-11fdc7f6d82a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:13.228161 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54664a41-ad8f-458a-be63-11fdc7f6d82a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:13.233609 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c2b8f-f556-4de6-9790-ed6829479b15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:13.234291 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c2b8f-f556-4de6-9790-ed6829479b15 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:13.234581 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c2b8f-f556-4de6-9790-ed6829479b15 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:13.234868 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c2b8f-f556-4de6-9790-ed6829479b15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:13.236869 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-f43c2b8f-f556-4de6-9790-ed6829479b15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:13.334588 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c2b8f-f556-4de6-9790-ed6829479b15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:13.336332 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c2b8f-f556-4de6-9790-ed6829479b15 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:13.350307 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 894/1795] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:13 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:13.510952 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3a2bf-2432-4b42-a2ca-d356fec1d8e2 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:13.512273 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-05d3a2bf-2432-4b42-a2ca-d356fec1d8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:13.687704 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3a2bf-2432-4b42-a2ca-d356fec1d8e2 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:13.699432 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ece66-b2e3-4b0c-a8e5-a27288693eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:13.702566 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ece66-b2e3-4b0c-a8e5-a27288693eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:13.702880 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ece66-b2e3-4b0c-a8e5-a27288693eff admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:13.704479 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ece66-b2e3-4b0c-a8e5-a27288693eff admin admin] PATH_INFO: `/v3/projects/43029cf2fa784b69b5f03843f5c728d7` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:13.708138 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ece66-b2e3-4b0c-a8e5-a27288693eff admin admin] RBAC: Authorizing `identity:delete_project(project_id=43029cf2fa784b69b5f03843f5c728d7)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:13.760966 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ece66-b2e3-4b0c-a8e5-a27288693eff admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:13.858415 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-af5ece66-b2e3-4b0c-a8e5-a27288693eff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43029cf2fa784b69b5f03843f5c728d7', 'request_id': 'req-af5ece66-b2e3-4b0c-a8e5-a27288693eff'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:13.867443 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-af5ece66-b2e3-4b0c-a8e5-a27288693eff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43029cf2fa784b69b5f03843f5c728d7', 'request_id': 'req-af5ece66-b2e3-4b0c-a8e5-a27288693eff'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:13.878665 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-af5ece66-b2e3-4b0c-a8e5-a27288693eff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43029cf2fa784b69b5f03843f5c728d7', 'request_id': 'req-af5ece66-b2e3-4b0c-a8e5-a27288693eff'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:13.895170 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-af5ece66-b2e3-4b0c-a8e5-a27288693eff admin admin] The token cache is being invalidate because project 43029cf2fa784b69b5f03843f5c728d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:13.895684 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-af5ece66-b2e3-4b0c-a8e5-a27288693eff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:13.897212 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-af5ece66-b2e3-4b0c-a8e5-a27288693eff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:13.907820 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 902/1796] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:33:13 2021] DELETE /identity/v3/projects/43029cf2fa784b69b5f03843f5c728d7 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:13.911120 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f0cc3-d4d1-4517-9145-664dead8c3c1 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:13.911419 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f0cc3-d4d1-4517-9145-664dead8c3c1 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:13.911705 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f0cc3-d4d1-4517-9145-664dead8c3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:13.979038 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-c00f0cc3-d4d1-4517-9145-664dead8c3c1 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:13.980266 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-c00f0cc3-d4d1-4517-9145-664dead8c3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:14.160318 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 895/1797] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:14.162455 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1e955-e4b2-427e-8655-6236a74459a7 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:14.162879 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1e955-e4b2-427e-8655-6236a74459a7 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:14.163430 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1e955-e4b2-427e-8655-6236a74459a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:14.187387 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-91f1e955-e4b2-427e-8655-6236a74459a7 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:14.189269 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-91f1e955-e4b2-427e-8655-6236a74459a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:14.199574 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 903/1798] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:14.203593 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f0cc3-d4d1-4517-9145-664dead8c3c1 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:14.239427 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f0cc3-d4d1-4517-9145-664dead8c3c1 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:14.249824 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13aa4df-0769-4c24-b024-b863ae9238fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:14.250414 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13aa4df-0769-4c24-b024-b863ae9238fc admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:14.250907 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13aa4df-0769-4c24-b024-b863ae9238fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:14.251343 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13aa4df-0769-4c24-b024-b863ae9238fc admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:14.252387 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13aa4df-0769-4c24-b024-b863ae9238fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:33:14.252949 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13aa4df-0769-4c24-b024-b863ae9238fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:14.255784 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13aa4df-0769-4c24-b024-b863ae9238fc admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:14.275666 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 896/1799] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:33:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:33:14.281225 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1e955-e4b2-427e-8655-6236a74459a7 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:14.292756 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1e955-e4b2-427e-8655-6236a74459a7 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:14.299497 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9062335-09b7-4e6a-9470-6903250636d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:14.300359 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9062335-09b7-4e6a-9470-6903250636d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:14.300844 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9062335-09b7-4e6a-9470-6903250636d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:14.301207 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9062335-09b7-4e6a-9470-6903250636d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:14.301989 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9062335-09b7-4e6a-9470-6903250636d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:14.304127 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9062335-09b7-4e6a-9470-6903250636d7 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:14.345359 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 904/1800] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:33:14 2021] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:14.352138 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13aa4df-0769-4c24-b024-b863ae9238fc admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:14.374012 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13aa4df-0769-4c24-b024-b863ae9238fc admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:14.467025 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e81869-b1f3-4752-b158-b97926362068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:14.467833 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e81869-b1f3-4752-b158-b97926362068 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:14.468186 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e81869-b1f3-4752-b158-b97926362068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:14.468572 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e81869-b1f3-4752-b158-b97926362068 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:14.470403 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e81869-b1f3-4752-b158-b97926362068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:14.471907 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e81869-b1f3-4752-b158-b97926362068 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:14.500698 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 897/1801] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:33:14 2021] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:14.505293 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9062335-09b7-4e6a-9470-6903250636d7 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:14.521471 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9062335-09b7-4e6a-9470-6903250636d7 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:14.526597 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10d65b-6ac0-4f76-9192-1a5447bd354e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:14.527395 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10d65b-6ac0-4f76-9192-1a5447bd354e admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:14.528150 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10d65b-6ac0-4f76-9192-1a5447bd354e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:14.528150 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10d65b-6ac0-4f76-9192-1a5447bd354e admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:14.528698 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10d65b-6ac0-4f76-9192-1a5447bd354e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:14.530734 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10d65b-6ac0-4f76-9192-1a5447bd354e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:14.545987 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 905/1802] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:14 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:14.550739 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e81869-b1f3-4752-b158-b97926362068 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:14.565531 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e81869-b1f3-4752-b158-b97926362068 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:14.578258 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512c840-67e9-415f-80ec-6014bdd8fe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:14.578748 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512c840-67e9-415f-80ec-6014bdd8fe74 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:14.579784 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512c840-67e9-415f-80ec-6014bdd8fe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:14.579784 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512c840-67e9-415f-80ec-6014bdd8fe74 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:14.580073 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512c840-67e9-415f-80ec-6014bdd8fe74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:14.582095 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512c840-67e9-415f-80ec-6014bdd8fe74 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:14.592992 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 898/1803] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:14 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:14.598776 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10d65b-6ac0-4f76-9192-1a5447bd354e admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:14.610704 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10d65b-6ac0-4f76-9192-1a5447bd354e admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:14.616030 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156b479-7869-4981-96cf-1087bdfa438e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:14.617444 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156b479-7869-4981-96cf-1087bdfa438e admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:14.617444 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156b479-7869-4981-96cf-1087bdfa438e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:14.617759 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156b479-7869-4981-96cf-1087bdfa438e admin admin] PATH_INFO: `/v3/projects/1afda2a3a1ff4d7baca72339058c0103/users/4aa072e5f17c46dd84343cbb37247fed/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:14.635095 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156b479-7869-4981-96cf-1087bdfa438e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1afda2a3a1ff4d7baca72339058c0103, user_id=4aa072e5f17c46dd84343cbb37247fed, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:14.637915 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156b479-7869-4981-96cf-1087bdfa438e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:14.657560 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 906/1804] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:14 2021] PUT /identity/v3/projects/1afda2a3a1ff4d7baca72339058c0103/users/4aa072e5f17c46dd84343cbb37247fed/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:14.671048 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aad107-39dd-42f2-a9fb-272406c1d08b None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:14.672249 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aad107-39dd-42f2-a9fb-272406c1d08b None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:14.673108 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aad107-39dd-42f2-a9fb-272406c1d08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:14.764131 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-28aad107-39dd-42f2-a9fb-272406c1d08b None None] MFA Rules not processed for user `4aa072e5f17c46dd84343cbb37247fed`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:14.765770 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-28aad107-39dd-42f2-a9fb-272406c1d08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:14.868081 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 899/1805] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:14 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:14.868270 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156b479-7869-4981-96cf-1087bdfa438e admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:14.966547 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156b479-7869-4981-96cf-1087bdfa438e admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:14.972478 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66b557-874b-430b-9078-3c2e544043c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:14.973355 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66b557-874b-430b-9078-3c2e544043c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:14.973741 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66b557-874b-430b-9078-3c2e544043c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:14.973978 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66b557-874b-430b-9078-3c2e544043c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:14.974693 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66b557-874b-430b-9078-3c2e544043c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:14.976799 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66b557-874b-430b-9078-3c2e544043c1 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:15.016631 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 907/1806] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:33:14 2021] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:15.021598 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aad107-39dd-42f2-a9fb-272406c1d08b None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:15.038516 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aad107-39dd-42f2-a9fb-272406c1d08b None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:15.182431 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77658f2-eed7-440a-b469-05fc46b57bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:15.183174 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77658f2-eed7-440a-b469-05fc46b57bcf admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:15.183465 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77658f2-eed7-440a-b469-05fc46b57bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:15.183751 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77658f2-eed7-440a-b469-05fc46b57bcf admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:15.184642 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77658f2-eed7-440a-b469-05fc46b57bcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:15.189533 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77658f2-eed7-440a-b469-05fc46b57bcf admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:15.247137 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 900/1807] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:33:15 2021] POST /identity/v3/users => generated 290 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:15.250999 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66b557-874b-430b-9078-3c2e544043c1 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:15.275429 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66b557-874b-430b-9078-3c2e544043c1 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:15.285265 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5718c5-ee4b-4287-b2d9-1976b878a626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:15.285997 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5718c5-ee4b-4287-b2d9-1976b878a626 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:15.286287 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5718c5-ee4b-4287-b2d9-1976b878a626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:15.286570 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5718c5-ee4b-4287-b2d9-1976b878a626 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:15.287322 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5718c5-ee4b-4287-b2d9-1976b878a626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:15.288929 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5718c5-ee4b-4287-b2d9-1976b878a626 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:15.322244 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 908/1808] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:15 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:15.329344 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77658f2-eed7-440a-b469-05fc46b57bcf admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:15.357111 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77658f2-eed7-440a-b469-05fc46b57bcf admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:15.363480 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98126c63-220a-4860-b790-5ed5db87c48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:15.364233 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98126c63-220a-4860-b790-5ed5db87c48b admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:15.364442 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98126c63-220a-4860-b790-5ed5db87c48b admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:15.364723 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98126c63-220a-4860-b790-5ed5db87c48b admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:15.365468 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98126c63-220a-4860-b790-5ed5db87c48b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:15.367560 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98126c63-220a-4860-b790-5ed5db87c48b admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:15.381541 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 901/1809] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:15 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:15.386286 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5718c5-ee4b-4287-b2d9-1976b878a626 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:15.401799 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5718c5-ee4b-4287-b2d9-1976b878a626 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:15.408520 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eda94a-0caf-4d5b-bbf7-4ec9716962bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:15.415229 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eda94a-0caf-4d5b-bbf7-4ec9716962bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:15.415551 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eda94a-0caf-4d5b-bbf7-4ec9716962bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:15.415845 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eda94a-0caf-4d5b-bbf7-4ec9716962bc admin admin] PATH_INFO: `/v3/projects/97c2c25553d2446880af4b62651a5caa/users/44288603f5a84e289338a4037b66a29a/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:15.467303 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eda94a-0caf-4d5b-bbf7-4ec9716962bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c2c25553d2446880af4b62651a5caa, user_id=44288603f5a84e289338a4037b66a29a, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:15.471447 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eda94a-0caf-4d5b-bbf7-4ec9716962bc admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:15.521964 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 909/1810] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:15 2021] PUT /identity/v3/projects/97c2c25553d2446880af4b62651a5caa/users/44288603f5a84e289338a4037b66a29a/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:33:15.526911 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b89e8-fa0b-4ff4-8481-e34c781f5400 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:15.527194 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b89e8-fa0b-4ff4-8481-e34c781f5400 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:15.527485 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b89e8-fa0b-4ff4-8481-e34c781f5400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:15.587923 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-191b89e8-fa0b-4ff4-8481-e34c781f5400 None None] MFA Rules not processed for user `44288603f5a84e289338a4037b66a29a`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:15.589950 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-191b89e8-fa0b-4ff4-8481-e34c781f5400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:15.755376 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 902/1811] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:15 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:15.759027 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eda94a-0caf-4d5b-bbf7-4ec9716962bc admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:15.902164 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eda94a-0caf-4d5b-bbf7-4ec9716962bc admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:15.907587 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9b8b0-f12b-4485-86cc-320b66c2cfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:15.908673 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9b8b0-f12b-4485-86cc-320b66c2cfab admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:15.909705 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9b8b0-f12b-4485-86cc-320b66c2cfab admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:15.910349 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9b8b0-f12b-4485-86cc-320b66c2cfab admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:15.912371 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9b8b0-f12b-4485-86cc-320b66c2cfab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:15.915239 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9b8b0-f12b-4485-86cc-320b66c2cfab admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:15.991927 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 910/1812] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:33:15 2021] POST /identity/v3/projects => generated 379 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:15.992157 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b89e8-fa0b-4ff4-8481-e34c781f5400 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:16.016251 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b89e8-fa0b-4ff4-8481-e34c781f5400 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:16.131866 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0472cd6-4a93-4804-8d39-0d19678dafae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:16.134530 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0472cd6-4a93-4804-8d39-0d19678dafae admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:16.134817 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0472cd6-4a93-4804-8d39-0d19678dafae admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:16.135102 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0472cd6-4a93-4804-8d39-0d19678dafae admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:16.136049 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0472cd6-4a93-4804-8d39-0d19678dafae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:16.139249 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0472cd6-4a93-4804-8d39-0d19678dafae admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:16.200243 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 903/1813] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:33:15 2021] POST /identity/v3/users => generated 296 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:16.209054 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9b8b0-f12b-4485-86cc-320b66c2cfab admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:16.256409 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9b8b0-f12b-4485-86cc-320b66c2cfab admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:16.275374 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10896c9-d797-46f9-9ed8-19329f866c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:16.276289 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10896c9-d797-46f9-9ed8-19329f866c2d admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:16.276735 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10896c9-d797-46f9-9ed8-19329f866c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:16.277166 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10896c9-d797-46f9-9ed8-19329f866c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:16.278350 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10896c9-d797-46f9-9ed8-19329f866c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:16.280652 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10896c9-d797-46f9-9ed8-19329f866c2d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:16.303754 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0472cd6-4a93-4804-8d39-0d19678dafae admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:16.315494 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 911/1814] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:16 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:16.317144 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0472cd6-4a93-4804-8d39-0d19678dafae admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:16.323060 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f22a35-8b33-4f8d-9ba9-477de328cf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:16.324348 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f22a35-8b33-4f8d-9ba9-477de328cf1f admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:16.324849 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f22a35-8b33-4f8d-9ba9-477de328cf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:16.325275 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f22a35-8b33-4f8d-9ba9-477de328cf1f admin admin] PATH_INFO: `/v3/projects/d32f96ab3f5848c580519702d2f086e5/users/74b9e44791144964a87d16ea6c0abbbd/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:16.344987 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f22a35-8b33-4f8d-9ba9-477de328cf1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d32f96ab3f5848c580519702d2f086e5, user_id=74b9e44791144964a87d16ea6c0abbbd, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:16.349400 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f22a35-8b33-4f8d-9ba9-477de328cf1f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:16.387358 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 904/1815] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:16 2021] PUT /identity/v3/projects/d32f96ab3f5848c580519702d2f086e5/users/74b9e44791144964a87d16ea6c0abbbd/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:16.392819 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10896c9-d797-46f9-9ed8-19329f866c2d admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:16.415483 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10896c9-d797-46f9-9ed8-19329f866c2d admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:16.457002 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1bf46-0fcd-4d3d-b34d-44c78bdec584 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:16.457727 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1bf46-0fcd-4d3d-b34d-44c78bdec584 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:16.458854 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1bf46-0fcd-4d3d-b34d-44c78bdec584 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:16.462810 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 905/1816] 10.222.0.25 () {54 vars in 921 bytes} [Wed Oct 27 01:33:16 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:33:16.505030 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2b385-afc4-464f-a2c7-1d15f74fe86d None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:16.506958 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2b385-afc4-464f-a2c7-1d15f74fe86d None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:16.507354 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2b385-afc4-464f-a2c7-1d15f74fe86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:16.607897 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-bba2b385-afc4-464f-a2c7-1d15f74fe86d None None] MFA Rules not processed for user `b2f8304b85b64dc4ac58523897306660`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:16.611261 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-bba2b385-afc4-464f-a2c7-1d15f74fe86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:16.628751 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc332ce9-feea-4e49-8b5a-43b55b1c35c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:16.629451 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc332ce9-feea-4e49-8b5a-43b55b1c35c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:16.629821 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc332ce9-feea-4e49-8b5a-43b55b1c35c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:16.630104 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc332ce9-feea-4e49-8b5a-43b55b1c35c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:16.630881 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc332ce9-feea-4e49-8b5a-43b55b1c35c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:16.632499 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc332ce9-feea-4e49-8b5a-43b55b1c35c7 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:16.659430 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 912/1817] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:16 2021] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:16.660326 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc332ce9-feea-4e49-8b5a-43b55b1c35c7 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:16.667538 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-fc332ce9-feea-4e49-8b5a-43b55b1c35c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:16.697429 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc332ce9-feea-4e49-8b5a-43b55b1c35c7 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:16.714362 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e9971-fb9f-45b6-8bca-08ca2afc6aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:16.715053 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e9971-fb9f-45b6-8bca-08ca2afc6aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:16.715344 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e9971-fb9f-45b6-8bca-08ca2afc6aca admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:16.715605 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e9971-fb9f-45b6-8bca-08ca2afc6aca admin admin] PATH_INFO: `/v3/users/bd91126cf45246e7bff3f96c7e4a6e8e` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:16.716871 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e9971-fb9f-45b6-8bca-08ca2afc6aca admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd91126cf45246e7bff3f96c7e4a6e8e)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:16.718886 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e9971-fb9f-45b6-8bca-08ca2afc6aca admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:16.769355 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 906/1818] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Oct 27 01:33:16 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:33:16.770718 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2b385-afc4-464f-a2c7-1d15f74fe86d None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:16.795456 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2b385-afc4-464f-a2c7-1d15f74fe86d None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:16.813013 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69eae0c-2c27-4dc1-80dd-c0d8f97fd088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:16.813998 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69eae0c-2c27-4dc1-80dd-c0d8f97fd088 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:16.814272 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69eae0c-2c27-4dc1-80dd-c0d8f97fd088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:16.814575 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69eae0c-2c27-4dc1-80dd-c0d8f97fd088 admin admin] PATH_INFO: `/v3/projects/d32f96ab3f5848c580519702d2f086e5/users/74b9e44791144964a87d16ea6c0abbbd/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:16.821527 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-417e9971-fb9f-45b6-8bca-08ca2afc6aca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd91126cf45246e7bff3f96c7e4a6e8e'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:16.829216 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69eae0c-2c27-4dc1-80dd-c0d8f97fd088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d32f96ab3f5848c580519702d2f086e5, user_id=74b9e44791144964a87d16ea6c0abbbd, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:16.832166 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69eae0c-2c27-4dc1-80dd-c0d8f97fd088 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:16.832940 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-417e9971-fb9f-45b6-8bca-08ca2afc6aca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd91126cf45246e7bff3f96c7e4a6e8e'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:16.842851 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-417e9971-fb9f-45b6-8bca-08ca2afc6aca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd91126cf45246e7bff3f96c7e4a6e8e'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:16.844413 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-417e9971-fb9f-45b6-8bca-08ca2afc6aca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd91126cf45246e7bff3f96c7e4a6e8e'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:16.871643 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 907/1819] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:16 2021] PUT /identity/v3/projects/d32f96ab3f5848c580519702d2f086e5/users/74b9e44791144964a87d16ea6c0abbbd/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:16.871643 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69eae0c-2c27-4dc1-80dd-c0d8f97fd088 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:16.874215 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-b69eae0c-2c27-4dc1-80dd-c0d8f97fd088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:16.878810 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-417e9971-fb9f-45b6-8bca-08ca2afc6aca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd91126cf45246e7bff3f96c7e4a6e8e'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:16.917092 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 913/1820] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:33:16 2021] DELETE /identity/v3/users/bd91126cf45246e7bff3f96c7e4a6e8e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:16.918641 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8b9cd-2a30-4bd5-a2c2-4a28225c6f37 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:16.919315 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8b9cd-2a30-4bd5-a2c2-4a28225c6f37 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:16.919706 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8b9cd-2a30-4bd5-a2c2-4a28225c6f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:16.985108 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-3cf8b9cd-2a30-4bd5-a2c2-4a28225c6f37 None None] MFA Rules not processed for user `74b9e44791144964a87d16ea6c0abbbd`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:16.987237 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-3cf8b9cd-2a30-4bd5-a2c2-4a28225c6f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:17.053819 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69eae0c-2c27-4dc1-80dd-c0d8f97fd088 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:17.242332 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5cd1f-081d-4bb2-88b2-0aae6371512c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:17.243210 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5cd1f-081d-4bb2-88b2-0aae6371512c service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:17.243506 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5cd1f-081d-4bb2-88b2-0aae6371512c service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:17.243793 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5cd1f-081d-4bb2-88b2-0aae6371512c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:17.250801 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-a3c5cd1f-081d-4bb2-88b2-0aae6371512c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:17.259407 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 914/1821] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:16 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:17.267921 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a98f5-b336-49fe-a4e7-85f010a444fe None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:17.273453 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a98f5-b336-49fe-a4e7-85f010a444fe None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:17.273803 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a98f5-b336-49fe-a4e7-85f010a444fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:17.291940 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5cd1f-081d-4bb2-88b2-0aae6371512c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:17.295740 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5cd1f-081d-4bb2-88b2-0aae6371512c service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:17.312659 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-d46a98f5-b336-49fe-a4e7-85f010a444fe None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:17.314005 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-d46a98f5-b336-49fe-a4e7-85f010a444fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:17.323548 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 908/1822] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:16 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:17.325458 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5cd1f-081d-4bb2-88b2-0aae6371512c service nova] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:17.327095 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-a3c5cd1f-081d-4bb2-88b2-0aae6371512c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:17.458831 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5cd1f-081d-4bb2-88b2-0aae6371512c service nova] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:17.463579 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463e0b7-73ef-4c4a-986a-95f7a5e3a252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:17.464498 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463e0b7-73ef-4c4a-986a-95f7a5e3a252 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:17.464997 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463e0b7-73ef-4c4a-986a-95f7a5e3a252 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:17.465516 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463e0b7-73ef-4c4a-986a-95f7a5e3a252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:17.467175 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 915/1823] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:17.479728 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463e0b7-73ef-4c4a-986a-95f7a5e3a252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:17.485332 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463e0b7-73ef-4c4a-986a-95f7a5e3a252 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:17.527383 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 909/1824] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:17 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:17.536806 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a98f5-b336-49fe-a4e7-85f010a444fe None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:17.536806 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-d46a98f5-b336-49fe-a4e7-85f010a444fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:17.574550 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463e0b7-73ef-4c4a-986a-95f7a5e3a252 service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:17.592729 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463e0b7-73ef-4c4a-986a-95f7a5e3a252 service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:17.608977 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea4b23-5baa-4a2e-ae58-02cac14f0e2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:17.610071 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea4b23-5baa-4a2e-ae58-02cac14f0e2d service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:17.612522 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea4b23-5baa-4a2e-ae58-02cac14f0e2d service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:17.614983 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea4b23-5baa-4a2e-ae58-02cac14f0e2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:17.626160 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-10ea4b23-5baa-4a2e-ae58-02cac14f0e2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:17.647934 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a98f5-b336-49fe-a4e7-85f010a444fe None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:17.653210 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8416ee3-52fb-4f5c-ba09-504968911c81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:17.653914 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8416ee3-52fb-4f5c-ba09-504968911c81 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:17.655004 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8416ee3-52fb-4f5c-ba09-504968911c81 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:17.656518 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8416ee3-52fb-4f5c-ba09-504968911c81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:17.683137 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8416ee3-52fb-4f5c-ba09-504968911c81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:17.687347 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8416ee3-52fb-4f5c-ba09-504968911c81 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:17.723768 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 916/1825] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:17.778991 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea4b23-5baa-4a2e-ae58-02cac14f0e2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:17.782238 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea4b23-5baa-4a2e-ae58-02cac14f0e2d service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:17.810173 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 910/1826] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:17 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:18.478907 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8416ee3-52fb-4f5c-ba09-504968911c81 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:18.481814 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-e8416ee3-52fb-4f5c-ba09-504968911c81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:18.495188 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8416ee3-52fb-4f5c-ba09-504968911c81 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:18.499813 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240b18e-a751-4510-9ba3-b962a09d0cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:18.500682 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240b18e-a751-4510-9ba3-b962a09d0cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:18.500969 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240b18e-a751-4510-9ba3-b962a09d0cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:18.501249 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240b18e-a751-4510-9ba3-b962a09d0cc6 admin admin] PATH_INFO: `/v3/projects/420e14da703f4b1eacb0d95179a412f1` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:18.502516 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240b18e-a751-4510-9ba3-b962a09d0cc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=420e14da703f4b1eacb0d95179a412f1)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:18.504538 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240b18e-a751-4510-9ba3-b962a09d0cc6 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:18.556759 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-c240b18e-a751-4510-9ba3-b962a09d0cc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '420e14da703f4b1eacb0d95179a412f1', 'request_id': 'req-c240b18e-a751-4510-9ba3-b962a09d0cc6'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:18.562916 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-c240b18e-a751-4510-9ba3-b962a09d0cc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '420e14da703f4b1eacb0d95179a412f1', 'request_id': 'req-c240b18e-a751-4510-9ba3-b962a09d0cc6'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:18.571639 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-c240b18e-a751-4510-9ba3-b962a09d0cc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '420e14da703f4b1eacb0d95179a412f1', 'request_id': 'req-c240b18e-a751-4510-9ba3-b962a09d0cc6'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:18.587583 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-c240b18e-a751-4510-9ba3-b962a09d0cc6 admin admin] The token cache is being invalidate because project 420e14da703f4b1eacb0d95179a412f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:18.587899 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-c240b18e-a751-4510-9ba3-b962a09d0cc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:18.588564 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-c240b18e-a751-4510-9ba3-b962a09d0cc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:18.590201 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 917/1827] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:33:18 2021] DELETE /identity/v3/projects/420e14da703f4b1eacb0d95179a412f1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:33:18.594281 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea4b23-5baa-4a2e-ae58-02cac14f0e2d service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:18.605037 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea4b23-5baa-4a2e-ae58-02cac14f0e2d service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:18.665785 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830de36-b0dd-4d8e-b962-72c38815cb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:18.666824 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830de36-b0dd-4d8e-b962-72c38815cb18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:18.667109 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830de36-b0dd-4d8e-b962-72c38815cb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:18.667383 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830de36-b0dd-4d8e-b962-72c38815cb18 admin admin] PATH_INFO: `/v3/users/31401f753c074ea1b4e7fd68090fe25c` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:18.668651 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830de36-b0dd-4d8e-b962-72c38815cb18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31401f753c074ea1b4e7fd68090fe25c)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:18.670848 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830de36-b0dd-4d8e-b962-72c38815cb18 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:18.718786 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-2830de36-b0dd-4d8e-b962-72c38815cb18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31401f753c074ea1b4e7fd68090fe25c'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:18.725846 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-2830de36-b0dd-4d8e-b962-72c38815cb18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31401f753c074ea1b4e7fd68090fe25c'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:18.726535 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-2830de36-b0dd-4d8e-b962-72c38815cb18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31401f753c074ea1b4e7fd68090fe25c'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:18.738777 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-2830de36-b0dd-4d8e-b962-72c38815cb18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31401f753c074ea1b4e7fd68090fe25c'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:18.746354 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-2830de36-b0dd-4d8e-b962-72c38815cb18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31401f753c074ea1b4e7fd68090fe25c'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:18.753835 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 911/1828] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:33:18 2021] DELETE /identity/v3/users/31401f753c074ea1b4e7fd68090fe25c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:33:19.532067 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240b18e-a751-4510-9ba3-b962a09d0cc6 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:19.533263 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-c240b18e-a751-4510-9ba3-b962a09d0cc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:19.546588 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240b18e-a751-4510-9ba3-b962a09d0cc6 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:19.606615 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e1856-e3d6-4b6f-a4cc-a97e55d2007f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:19.607707 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e1856-e3d6-4b6f-a4cc-a97e55d2007f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:19.608146 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e1856-e3d6-4b6f-a4cc-a97e55d2007f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:19.608593 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e1856-e3d6-4b6f-a4cc-a97e55d2007f admin admin] PATH_INFO: `/v3/projects/4e14aa8d3e934db6a1505493c92a5e0d` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:19.610218 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e1856-e3d6-4b6f-a4cc-a97e55d2007f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e14aa8d3e934db6a1505493c92a5e0d)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:19.612506 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e1856-e3d6-4b6f-a4cc-a97e55d2007f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:19.700080 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-5f7e1856-e3d6-4b6f-a4cc-a97e55d2007f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e14aa8d3e934db6a1505493c92a5e0d', 'request_id': 'req-5f7e1856-e3d6-4b6f-a4cc-a97e55d2007f'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:19.710106 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-5f7e1856-e3d6-4b6f-a4cc-a97e55d2007f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e14aa8d3e934db6a1505493c92a5e0d', 'request_id': 'req-5f7e1856-e3d6-4b6f-a4cc-a97e55d2007f'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:19.723732 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-5f7e1856-e3d6-4b6f-a4cc-a97e55d2007f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e14aa8d3e934db6a1505493c92a5e0d', 'request_id': 'req-5f7e1856-e3d6-4b6f-a4cc-a97e55d2007f'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:19.746101 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-5f7e1856-e3d6-4b6f-a4cc-a97e55d2007f admin admin] The token cache is being invalidate because project 4e14aa8d3e934db6a1505493c92a5e0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:19.746724 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-5f7e1856-e3d6-4b6f-a4cc-a97e55d2007f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:19.747246 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-5f7e1856-e3d6-4b6f-a4cc-a97e55d2007f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:19.749319 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 918/1829] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:33:19 2021] DELETE /identity/v3/projects/4e14aa8d3e934db6a1505493c92a5e0d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:19.754871 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9e678-9a80-4db8-8e2f-1de1ee4b3dd3 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:19.755353 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9e678-9a80-4db8-8e2f-1de1ee4b3dd3 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:19.755573 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9e678-9a80-4db8-8e2f-1de1ee4b3dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:19.780370 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-bdc9e678-9a80-4db8-8e2f-1de1ee4b3dd3 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:19.781757 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-bdc9e678-9a80-4db8-8e2f-1de1ee4b3dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:19.875932 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 912/1830] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:19.895601 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b2080-bfb3-46ee-ad2e-b9b3d4f1b71c None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:19.895967 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b2080-bfb3-46ee-ad2e-b9b3d4f1b71c None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:19.896197 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b2080-bfb3-46ee-ad2e-b9b3d4f1b71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:19.917027 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-025b2080-bfb3-46ee-ad2e-b9b3d4f1b71c None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:19.918336 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-025b2080-bfb3-46ee-ad2e-b9b3d4f1b71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:19.927486 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 919/1831] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:19.931770 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9e678-9a80-4db8-8e2f-1de1ee4b3dd3 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:19.942033 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9e678-9a80-4db8-8e2f-1de1ee4b3dd3 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:19.947403 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc6e89-a395-408b-b1e2-acc73715aa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:19.949056 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc6e89-a395-408b-b1e2-acc73715aa2c admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:19.949368 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc6e89-a395-408b-b1e2-acc73715aa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:19.949694 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc6e89-a395-408b-b1e2-acc73715aa2c admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:19.950568 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc6e89-a395-408b-b1e2-acc73715aa2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:33:19.951267 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc6e89-a395-408b-b1e2-acc73715aa2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:19.959212 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc6e89-a395-408b-b1e2-acc73715aa2c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:19.976373 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 913/1832] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:33:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:33:19.981150 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b2080-bfb3-46ee-ad2e-b9b3d4f1b71c None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:19.991356 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b2080-bfb3-46ee-ad2e-b9b3d4f1b71c None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:19.996870 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21556890-a5f2-4f1a-8789-d15b328d18f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:19.997504 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21556890-a5f2-4f1a-8789-d15b328d18f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:19.997803 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21556890-a5f2-4f1a-8789-d15b328d18f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:19.998088 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21556890-a5f2-4f1a-8789-d15b328d18f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:19.998880 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21556890-a5f2-4f1a-8789-d15b328d18f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:20.000835 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21556890-a5f2-4f1a-8789-d15b328d18f7 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:20.033530 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 920/1833] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:33:19 2021] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:20.034887 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc6e89-a395-408b-b1e2-acc73715aa2c admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:20.045161 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc6e89-a395-408b-b1e2-acc73715aa2c admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:20.102123 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe57627-a3b5-4375-9f59-5d9222ae0537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:20.102816 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe57627-a3b5-4375-9f59-5d9222ae0537 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:20.103185 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe57627-a3b5-4375-9f59-5d9222ae0537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:20.103435 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe57627-a3b5-4375-9f59-5d9222ae0537 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:20.104882 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe57627-a3b5-4375-9f59-5d9222ae0537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:20.106368 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe57627-a3b5-4375-9f59-5d9222ae0537 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:20.133036 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 914/1834] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:33:20 2021] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:20.134264 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21556890-a5f2-4f1a-8789-d15b328d18f7 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:20.144736 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21556890-a5f2-4f1a-8789-d15b328d18f7 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:20.151027 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272cfba-2d70-4890-b644-e6236eee75fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:20.151815 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272cfba-2d70-4890-b644-e6236eee75fa admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:20.152172 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272cfba-2d70-4890-b644-e6236eee75fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:20.152519 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272cfba-2d70-4890-b644-e6236eee75fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:20.153330 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272cfba-2d70-4890-b644-e6236eee75fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:20.155048 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272cfba-2d70-4890-b644-e6236eee75fa admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:20.167448 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 921/1835] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:20 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:20.171390 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe57627-a3b5-4375-9f59-5d9222ae0537 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:20.182422 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe57627-a3b5-4375-9f59-5d9222ae0537 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:20.188416 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e13a5-9b2e-417c-8011-fcbef31a7148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:20.189096 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e13a5-9b2e-417c-8011-fcbef31a7148 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:20.189383 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e13a5-9b2e-417c-8011-fcbef31a7148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:20.189728 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e13a5-9b2e-417c-8011-fcbef31a7148 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:20.191081 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e13a5-9b2e-417c-8011-fcbef31a7148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:20.192675 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e13a5-9b2e-417c-8011-fcbef31a7148 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:20.204532 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 915/1836] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:20 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:20.212272 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272cfba-2d70-4890-b644-e6236eee75fa admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:20.223392 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272cfba-2d70-4890-b644-e6236eee75fa admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:20.232586 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838dc22-acf2-4f55-afcd-e994324fc415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:20.234247 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838dc22-acf2-4f55-afcd-e994324fc415 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:20.234818 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838dc22-acf2-4f55-afcd-e994324fc415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:20.235078 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838dc22-acf2-4f55-afcd-e994324fc415 admin admin] PATH_INFO: `/v3/projects/8c07aac67e1345f6a05a06f09da40e34/users/7147971802474e579aadf1ab5546746a/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:20.256327 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838dc22-acf2-4f55-afcd-e994324fc415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c07aac67e1345f6a05a06f09da40e34, user_id=7147971802474e579aadf1ab5546746a, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:20.260545 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838dc22-acf2-4f55-afcd-e994324fc415 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:20.277545 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 922/1837] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:20 2021] PUT /identity/v3/projects/8c07aac67e1345f6a05a06f09da40e34/users/7147971802474e579aadf1ab5546746a/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:20.289102 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287fd29-7bfb-4c82-abf1-3965b424c53f None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:20.289673 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287fd29-7bfb-4c82-abf1-3965b424c53f None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:20.290180 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287fd29-7bfb-4c82-abf1-3965b424c53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:20.324455 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-9287fd29-7bfb-4c82-abf1-3965b424c53f None None] MFA Rules not processed for user `7147971802474e579aadf1ab5546746a`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:20.325958 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-9287fd29-7bfb-4c82-abf1-3965b424c53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:20.478274 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 916/1838] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:20 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:20.492033 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838dc22-acf2-4f55-afcd-e994324fc415 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:20.494032 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-a838dc22-acf2-4f55-afcd-e994324fc415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:20.606195 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838dc22-acf2-4f55-afcd-e994324fc415 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:20.613096 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59399ced-1d0c-49a0-8ff1-ea8b26d88bcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:20.614088 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59399ced-1d0c-49a0-8ff1-ea8b26d88bcb service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:20.614521 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59399ced-1d0c-49a0-8ff1-ea8b26d88bcb service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:20.614882 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59399ced-1d0c-49a0-8ff1-ea8b26d88bcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:20.626028 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59399ced-1d0c-49a0-8ff1-ea8b26d88bcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:20.627569 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59399ced-1d0c-49a0-8ff1-ea8b26d88bcb service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:20.647597 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 923/1839] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:20 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:21.064803 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287fd29-7bfb-4c82-abf1-3965b424c53f None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:21.066288 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-9287fd29-7bfb-4c82-abf1-3965b424c53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:21.133712 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287fd29-7bfb-4c82-abf1-3965b424c53f None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:21.138306 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1debd-c1d3-47ba-a085-89545791d5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:21.139358 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1debd-c1d3-47ba-a085-89545791d5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:21.139751 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1debd-c1d3-47ba-a085-89545791d5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:21.139905 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1debd-c1d3-47ba-a085-89545791d5a4 admin admin] PATH_INFO: `/v3/users/4aa072e5f17c46dd84343cbb37247fed` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:21.141099 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1debd-c1d3-47ba-a085-89545791d5a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aa072e5f17c46dd84343cbb37247fed)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:21.143539 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1debd-c1d3-47ba-a085-89545791d5a4 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:21.188471 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-00c1debd-c1d3-47ba-a085-89545791d5a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aa072e5f17c46dd84343cbb37247fed'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:21.195538 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-00c1debd-c1d3-47ba-a085-89545791d5a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aa072e5f17c46dd84343cbb37247fed'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:21.196202 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-00c1debd-c1d3-47ba-a085-89545791d5a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aa072e5f17c46dd84343cbb37247fed'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:21.208232 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-00c1debd-c1d3-47ba-a085-89545791d5a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aa072e5f17c46dd84343cbb37247fed'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:21.217175 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-00c1debd-c1d3-47ba-a085-89545791d5a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aa072e5f17c46dd84343cbb37247fed'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:21.223698 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 917/1840] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:33:21 2021] DELETE /identity/v3/users/4aa072e5f17c46dd84343cbb37247fed => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:21.228978 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81144f80-3072-4915-b89b-d20ddc3ea965 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:21.228978 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81144f80-3072-4915-b89b-d20ddc3ea965 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:21.228978 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81144f80-3072-4915-b89b-d20ddc3ea965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:21.249211 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-81144f80-3072-4915-b89b-d20ddc3ea965 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:21.251151 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-81144f80-3072-4915-b89b-d20ddc3ea965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:21.320433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 924/1841] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:33:21.330998 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1debd-c1d3-47ba-a085-89545791d5a4 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:21.332463 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-00c1debd-c1d3-47ba-a085-89545791d5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:21.402543 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1debd-c1d3-47ba-a085-89545791d5a4 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:21.406256 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec51d6a-0036-42de-bffa-747ce4b3b56a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:21.406904 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec51d6a-0036-42de-bffa-747ce4b3b56a service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:21.407192 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec51d6a-0036-42de-bffa-747ce4b3b56a service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:21.407474 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec51d6a-0036-42de-bffa-747ce4b3b56a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:21.416827 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec51d6a-0036-42de-bffa-747ce4b3b56a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:21.418318 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec51d6a-0036-42de-bffa-747ce4b3b56a service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:21.427778 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 918/1842] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:21.682459 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81144f80-3072-4915-b89b-d20ddc3ea965 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:21.683950 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-81144f80-3072-4915-b89b-d20ddc3ea965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:21.696984 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81144f80-3072-4915-b89b-d20ddc3ea965 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:21.701815 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee11d3-7e33-4308-96f5-889ecc54805d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:21.702717 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee11d3-7e33-4308-96f5-889ecc54805d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:21.703006 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee11d3-7e33-4308-96f5-889ecc54805d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:21.703287 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee11d3-7e33-4308-96f5-889ecc54805d admin admin] PATH_INFO: `/v3/projects/1afda2a3a1ff4d7baca72339058c0103` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:21.704515 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee11d3-7e33-4308-96f5-889ecc54805d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1afda2a3a1ff4d7baca72339058c0103)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:21.707010 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee11d3-7e33-4308-96f5-889ecc54805d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:21.752720 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-71ee11d3-7e33-4308-96f5-889ecc54805d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1afda2a3a1ff4d7baca72339058c0103', 'request_id': 'req-71ee11d3-7e33-4308-96f5-889ecc54805d'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:21.757920 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-71ee11d3-7e33-4308-96f5-889ecc54805d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1afda2a3a1ff4d7baca72339058c0103', 'request_id': 'req-71ee11d3-7e33-4308-96f5-889ecc54805d'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:21.765810 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-71ee11d3-7e33-4308-96f5-889ecc54805d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1afda2a3a1ff4d7baca72339058c0103', 'request_id': 'req-71ee11d3-7e33-4308-96f5-889ecc54805d'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:21.777145 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-71ee11d3-7e33-4308-96f5-889ecc54805d admin admin] The token cache is being invalidate because project 1afda2a3a1ff4d7baca72339058c0103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:21.777445 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-71ee11d3-7e33-4308-96f5-889ecc54805d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:21.778097 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-71ee11d3-7e33-4308-96f5-889ecc54805d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:21.779600 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 925/1843] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:33:21 2021] DELETE /identity/v3/projects/1afda2a3a1ff4d7baca72339058c0103 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:21.784585 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec51d6a-0036-42de-bffa-747ce4b3b56a service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:21.794394 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec51d6a-0036-42de-bffa-747ce4b3b56a service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:21.848344 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d42d4-f66f-4d17-be15-b5af1250932f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:21.849225 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d42d4-f66f-4d17-be15-b5af1250932f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:21.849541 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d42d4-f66f-4d17-be15-b5af1250932f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:21.849828 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d42d4-f66f-4d17-be15-b5af1250932f admin admin] PATH_INFO: `/v3/users/44288603f5a84e289338a4037b66a29a` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:21.851031 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d42d4-f66f-4d17-be15-b5af1250932f admin admin] RBAC: Authorizing `identity:delete_user(user_id=44288603f5a84e289338a4037b66a29a)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:21.852955 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d42d4-f66f-4d17-be15-b5af1250932f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:21.919699 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-872d42d4-f66f-4d17-be15-b5af1250932f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44288603f5a84e289338a4037b66a29a'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:21.931253 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-872d42d4-f66f-4d17-be15-b5af1250932f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44288603f5a84e289338a4037b66a29a'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:21.932245 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-872d42d4-f66f-4d17-be15-b5af1250932f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44288603f5a84e289338a4037b66a29a'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:21.947361 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-872d42d4-f66f-4d17-be15-b5af1250932f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44288603f5a84e289338a4037b66a29a'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:21.961835 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-872d42d4-f66f-4d17-be15-b5af1250932f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44288603f5a84e289338a4037b66a29a'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:21.975313 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 919/1844] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:33:21 2021] DELETE /identity/v3/users/44288603f5a84e289338a4037b66a29a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:22.296023 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee11d3-7e33-4308-96f5-889ecc54805d admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:22.297431 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-71ee11d3-7e33-4308-96f5-889ecc54805d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:22.316154 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee11d3-7e33-4308-96f5-889ecc54805d admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:22.371637 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b464ef-ffe8-44c3-85bb-4227a730a6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:22.372598 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b464ef-ffe8-44c3-85bb-4227a730a6b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:22.372996 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b464ef-ffe8-44c3-85bb-4227a730a6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:22.373392 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b464ef-ffe8-44c3-85bb-4227a730a6b8 admin admin] PATH_INFO: `/v3/projects/97c2c25553d2446880af4b62651a5caa` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:22.374778 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b464ef-ffe8-44c3-85bb-4227a730a6b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97c2c25553d2446880af4b62651a5caa)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:22.376795 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b464ef-ffe8-44c3-85bb-4227a730a6b8 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:22.422642 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-c5b464ef-ffe8-44c3-85bb-4227a730a6b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97c2c25553d2446880af4b62651a5caa', 'request_id': 'req-c5b464ef-ffe8-44c3-85bb-4227a730a6b8'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:22.428033 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-c5b464ef-ffe8-44c3-85bb-4227a730a6b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97c2c25553d2446880af4b62651a5caa', 'request_id': 'req-c5b464ef-ffe8-44c3-85bb-4227a730a6b8'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:22.435957 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-c5b464ef-ffe8-44c3-85bb-4227a730a6b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97c2c25553d2446880af4b62651a5caa', 'request_id': 'req-c5b464ef-ffe8-44c3-85bb-4227a730a6b8'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:22.449078 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-c5b464ef-ffe8-44c3-85bb-4227a730a6b8 admin admin] The token cache is being invalidate because project 97c2c25553d2446880af4b62651a5caa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:22.449366 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-c5b464ef-ffe8-44c3-85bb-4227a730a6b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:22.450105 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-c5b464ef-ffe8-44c3-85bb-4227a730a6b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:22.451702 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 926/1845] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:33:22 2021] DELETE /identity/v3/projects/97c2c25553d2446880af4b62651a5caa => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:22.456330 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d42d4-f66f-4d17-be15-b5af1250932f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:22.457769 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-872d42d4-f66f-4d17-be15-b5af1250932f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:22.470381 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d42d4-f66f-4d17-be15-b5af1250932f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:22.524292 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06dbf05-8f95-4137-8377-b33871815e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:22.525165 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06dbf05-8f95-4137-8377-b33871815e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:22.525477 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06dbf05-8f95-4137-8377-b33871815e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:22.525782 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06dbf05-8f95-4137-8377-b33871815e05 admin admin] PATH_INFO: `/v3/users/74b9e44791144964a87d16ea6c0abbbd` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:22.526973 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06dbf05-8f95-4137-8377-b33871815e05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74b9e44791144964a87d16ea6c0abbbd)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:22.528870 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06dbf05-8f95-4137-8377-b33871815e05 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:22.571177 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-a06dbf05-8f95-4137-8377-b33871815e05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74b9e44791144964a87d16ea6c0abbbd'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:22.577691 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-a06dbf05-8f95-4137-8377-b33871815e05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74b9e44791144964a87d16ea6c0abbbd'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:22.578341 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-a06dbf05-8f95-4137-8377-b33871815e05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74b9e44791144964a87d16ea6c0abbbd'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:22.590054 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-a06dbf05-8f95-4137-8377-b33871815e05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74b9e44791144964a87d16ea6c0abbbd'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:22.597512 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-a06dbf05-8f95-4137-8377-b33871815e05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74b9e44791144964a87d16ea6c0abbbd'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:22.603143 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 920/1846] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:33:22 2021] DELETE /identity/v3/users/74b9e44791144964a87d16ea6c0abbbd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:33:22.864541 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b464ef-ffe8-44c3-85bb-4227a730a6b8 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:22.866095 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-c5b464ef-ffe8-44c3-85bb-4227a730a6b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:22.879557 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b464ef-ffe8-44c3-85bb-4227a730a6b8 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:22.932803 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4aa506-65f7-4af4-907b-21c38d304069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:22.933690 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4aa506-65f7-4af4-907b-21c38d304069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:22.933974 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4aa506-65f7-4af4-907b-21c38d304069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:22.934275 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4aa506-65f7-4af4-907b-21c38d304069 admin admin] PATH_INFO: `/v3/projects/d32f96ab3f5848c580519702d2f086e5` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:22.935455 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4aa506-65f7-4af4-907b-21c38d304069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d32f96ab3f5848c580519702d2f086e5)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:22.937327 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4aa506-65f7-4af4-907b-21c38d304069 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:22.981966 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-4a4aa506-65f7-4af4-907b-21c38d304069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd32f96ab3f5848c580519702d2f086e5', 'request_id': 'req-4a4aa506-65f7-4af4-907b-21c38d304069'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:22.987115 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-4a4aa506-65f7-4af4-907b-21c38d304069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd32f96ab3f5848c580519702d2f086e5', 'request_id': 'req-4a4aa506-65f7-4af4-907b-21c38d304069'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:22.993739 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-4a4aa506-65f7-4af4-907b-21c38d304069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd32f96ab3f5848c580519702d2f086e5', 'request_id': 'req-4a4aa506-65f7-4af4-907b-21c38d304069'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:23.004702 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-4a4aa506-65f7-4af4-907b-21c38d304069 admin admin] The token cache is being invalidate because project d32f96ab3f5848c580519702d2f086e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:23.005039 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-4a4aa506-65f7-4af4-907b-21c38d304069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:23.006017 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-4a4aa506-65f7-4af4-907b-21c38d304069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:23.008346 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 927/1847] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:33:22 2021] DELETE /identity/v3/projects/d32f96ab3f5848c580519702d2f086e5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:23.018920 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f1df7-91e8-4251-83f6-049ec1ac62a1 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:23.019354 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f1df7-91e8-4251-83f6-049ec1ac62a1 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:23.019778 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f1df7-91e8-4251-83f6-049ec1ac62a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:23.043135 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-5e8f1df7-91e8-4251-83f6-049ec1ac62a1 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:23.044299 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-5e8f1df7-91e8-4251-83f6-049ec1ac62a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:23.130845 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 921/1848] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:23.132879 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3cc74-8b59-4886-92c6-e613d5818def None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:23.133239 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3cc74-8b59-4886-92c6-e613d5818def None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:23.133631 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3cc74-8b59-4886-92c6-e613d5818def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:23.151864 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-5cd3cc74-8b59-4886-92c6-e613d5818def None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:23.153239 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-5cd3cc74-8b59-4886-92c6-e613d5818def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:23.161259 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 928/1849] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:23.165622 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f1df7-91e8-4251-83f6-049ec1ac62a1 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:23.175572 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f1df7-91e8-4251-83f6-049ec1ac62a1 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:23.181961 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e8990-e927-4439-ba7d-69b9623823dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:23.182640 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e8990-e927-4439-ba7d-69b9623823dd admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:23.182924 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e8990-e927-4439-ba7d-69b9623823dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:23.183203 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e8990-e927-4439-ba7d-69b9623823dd admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:23.183945 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e8990-e927-4439-ba7d-69b9623823dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:33:23.184253 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e8990-e927-4439-ba7d-69b9623823dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:23.185949 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e8990-e927-4439-ba7d-69b9623823dd admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:23.198394 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 922/1850] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:33:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:33:23.202581 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3cc74-8b59-4886-92c6-e613d5818def None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:23.211534 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3cc74-8b59-4886-92c6-e613d5818def None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:23.216220 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef2c92-de29-4ae4-8c50-48c6e472be56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:23.216880 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef2c92-de29-4ae4-8c50-48c6e472be56 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:23.217159 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef2c92-de29-4ae4-8c50-48c6e472be56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:23.217432 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef2c92-de29-4ae4-8c50-48c6e472be56 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:23.218176 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef2c92-de29-4ae4-8c50-48c6e472be56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:23.220063 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef2c92-de29-4ae4-8c50-48c6e472be56 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:23.249530 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 929/1851] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:33:23 2021] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:23.251496 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e8990-e927-4439-ba7d-69b9623823dd admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:23.264217 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e8990-e927-4439-ba7d-69b9623823dd admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:23.320923 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c338c-1bd3-40dd-937f-36cbd11dd98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:23.321626 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c338c-1bd3-40dd-937f-36cbd11dd98b admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:23.321910 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c338c-1bd3-40dd-937f-36cbd11dd98b admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:23.322189 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c338c-1bd3-40dd-937f-36cbd11dd98b admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:23.322887 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c338c-1bd3-40dd-937f-36cbd11dd98b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:23.325021 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c338c-1bd3-40dd-937f-36cbd11dd98b admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:23.345527 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 923/1852] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:33:23 2021] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:23.350292 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef2c92-de29-4ae4-8c50-48c6e472be56 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:23.360970 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef2c92-de29-4ae4-8c50-48c6e472be56 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:23.365732 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a355e97-c5fc-4a60-b3fb-57a1c37f956b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:23.366340 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a355e97-c5fc-4a60-b3fb-57a1c37f956b admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:23.366750 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a355e97-c5fc-4a60-b3fb-57a1c37f956b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:23.366893 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a355e97-c5fc-4a60-b3fb-57a1c37f956b admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:23.367807 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a355e97-c5fc-4a60-b3fb-57a1c37f956b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:23.369440 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a355e97-c5fc-4a60-b3fb-57a1c37f956b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:23.381419 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 930/1853] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:23 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:23.386948 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c338c-1bd3-40dd-937f-36cbd11dd98b admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:23.398669 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c338c-1bd3-40dd-937f-36cbd11dd98b admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:23.403754 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be39405-055e-4563-a397-861bc3e3fc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:23.404514 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be39405-055e-4563-a397-861bc3e3fc4c admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:23.404800 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be39405-055e-4563-a397-861bc3e3fc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:23.405082 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be39405-055e-4563-a397-861bc3e3fc4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:23.405885 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be39405-055e-4563-a397-861bc3e3fc4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:23.407508 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be39405-055e-4563-a397-861bc3e3fc4c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:23.418827 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 924/1854] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:23 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:23.423027 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a355e97-c5fc-4a60-b3fb-57a1c37f956b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:23.433153 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a355e97-c5fc-4a60-b3fb-57a1c37f956b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:23.438071 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089439e-6ccf-4d84-8d6f-71557115df33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:23.438956 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089439e-6ccf-4d84-8d6f-71557115df33 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:23.439239 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089439e-6ccf-4d84-8d6f-71557115df33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:23.439514 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089439e-6ccf-4d84-8d6f-71557115df33 admin admin] PATH_INFO: `/v3/projects/ccd7eea540444f3db1fa10a195f95a3c/users/76973bc401554d849f2178047f8518cf/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:23.458368 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089439e-6ccf-4d84-8d6f-71557115df33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd7eea540444f3db1fa10a195f95a3c, user_id=76973bc401554d849f2178047f8518cf, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:23.461265 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089439e-6ccf-4d84-8d6f-71557115df33 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:23.475579 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 931/1855] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:23 2021] PUT /identity/v3/projects/ccd7eea540444f3db1fa10a195f95a3c/users/76973bc401554d849f2178047f8518cf/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:23.487027 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad656a-8fdf-4f52-b07a-29f59e84ea7e None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:23.487496 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad656a-8fdf-4f52-b07a-29f59e84ea7e None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:23.487708 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad656a-8fdf-4f52-b07a-29f59e84ea7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:23.513537 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-a4ad656a-8fdf-4f52-b07a-29f59e84ea7e None None] MFA Rules not processed for user `76973bc401554d849f2178047f8518cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:23.514741 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-a4ad656a-8fdf-4f52-b07a-29f59e84ea7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:23.575273 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 925/1856] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:23 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:23.579903 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089439e-6ccf-4d84-8d6f-71557115df33 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:23.638802 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089439e-6ccf-4d84-8d6f-71557115df33 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:23.644047 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0591f4-4975-44f4-ae82-c2a52960f3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:23.644701 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0591f4-4975-44f4-ae82-c2a52960f3a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:23.644988 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0591f4-4975-44f4-ae82-c2a52960f3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:23.645269 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0591f4-4975-44f4-ae82-c2a52960f3a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:23.646018 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0591f4-4975-44f4-ae82-c2a52960f3a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:23.647908 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0591f4-4975-44f4-ae82-c2a52960f3a5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:23.672188 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 932/1857] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:33:23 2021] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:23.676840 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad656a-8fdf-4f52-b07a-29f59e84ea7e None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:23.687583 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad656a-8fdf-4f52-b07a-29f59e84ea7e None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:23.748020 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b876699-7e93-45e6-a298-a20248ed0a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:23.748020 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b876699-7e93-45e6-a298-a20248ed0a1f admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:23.748538 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b876699-7e93-45e6-a298-a20248ed0a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:23.748889 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b876699-7e93-45e6-a298-a20248ed0a1f admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:23.749662 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b876699-7e93-45e6-a298-a20248ed0a1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:23.751596 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b876699-7e93-45e6-a298-a20248ed0a1f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:23.771281 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 926/1858] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:33:23 2021] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:33:23.775204 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0591f4-4975-44f4-ae82-c2a52960f3a5 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:23.787722 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0591f4-4975-44f4-ae82-c2a52960f3a5 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:23.793102 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1c20a-ed2f-4c2c-87b3-077ed02e0d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:23.793926 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1c20a-ed2f-4c2c-87b3-077ed02e0d62 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:23.794243 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1c20a-ed2f-4c2c-87b3-077ed02e0d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:23.794554 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1c20a-ed2f-4c2c-87b3-077ed02e0d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:23.795407 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1c20a-ed2f-4c2c-87b3-077ed02e0d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:23.797121 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1c20a-ed2f-4c2c-87b3-077ed02e0d62 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:23.808825 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 933/1859] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:23 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:23.813109 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b876699-7e93-45e6-a298-a20248ed0a1f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:23.824687 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b876699-7e93-45e6-a298-a20248ed0a1f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:23.830834 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59864585-9c7d-440c-a278-74023822d34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:23.831729 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59864585-9c7d-440c-a278-74023822d34c admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:23.832011 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59864585-9c7d-440c-a278-74023822d34c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:23.832288 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59864585-9c7d-440c-a278-74023822d34c admin admin] PATH_INFO: `/v3/projects/6e68626d4b0b401289ffc892b449ecc3/users/ebae5b08ac0b4a268447690de3d1c1c0/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:23.851297 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59864585-9c7d-440c-a278-74023822d34c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e68626d4b0b401289ffc892b449ecc3, user_id=ebae5b08ac0b4a268447690de3d1c1c0, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:23.854061 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59864585-9c7d-440c-a278-74023822d34c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:23.867421 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 927/1860] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:23 2021] PUT /identity/v3/projects/6e68626d4b0b401289ffc892b449ecc3/users/ebae5b08ac0b4a268447690de3d1c1c0/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:23.871434 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1c20a-ed2f-4c2c-87b3-077ed02e0d62 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:23.881628 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1c20a-ed2f-4c2c-87b3-077ed02e0d62 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:23.943419 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d4000-d7f6-4c4d-a491-3088e29d3478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:23.944319 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d4000-d7f6-4c4d-a491-3088e29d3478 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:23.944679 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d4000-d7f6-4c4d-a491-3088e29d3478 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:23.945034 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d4000-d7f6-4c4d-a491-3088e29d3478 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:23.945819 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d4000-d7f6-4c4d-a491-3088e29d3478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:23.947398 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d4000-d7f6-4c4d-a491-3088e29d3478 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:23.961865 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 934/1861] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:23 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:23.966030 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59864585-9c7d-440c-a278-74023822d34c admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:23.977154 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59864585-9c7d-440c-a278-74023822d34c admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:23.982586 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f26e77-d151-4853-8a95-2d7d16864242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:23.983476 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f26e77-d151-4853-8a95-2d7d16864242 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:23.983760 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f26e77-d151-4853-8a95-2d7d16864242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:23.984040 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f26e77-d151-4853-8a95-2d7d16864242 admin admin] PATH_INFO: `/v3/projects/6e68626d4b0b401289ffc892b449ecc3/users/ebae5b08ac0b4a268447690de3d1c1c0/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:23.986104 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f26e77-d151-4853-8a95-2d7d16864242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e68626d4b0b401289ffc892b449ecc3, user_id=ebae5b08ac0b4a268447690de3d1c1c0, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:23.989339 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f26e77-d151-4853-8a95-2d7d16864242 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:23.999309 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 928/1862] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:23 2021] PUT /identity/v3/projects/6e68626d4b0b401289ffc892b449ecc3/users/ebae5b08ac0b4a268447690de3d1c1c0/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:24.010303 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5f813-9366-4655-bbda-e3e9e46a143d None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:24.010602 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5f813-9366-4655-bbda-e3e9e46a143d None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:24.010917 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5f813-9366-4655-bbda-e3e9e46a143d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:24.036840 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-b5e5f813-9366-4655-bbda-e3e9e46a143d None None] MFA Rules not processed for user `ebae5b08ac0b4a268447690de3d1c1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:24.038117 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-b5e5f813-9366-4655-bbda-e3e9e46a143d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:24.108083 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 935/1863] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:24 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:24.125534 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f26e77-d151-4853-8a95-2d7d16864242 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:24.128207 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-88f26e77-d151-4853-8a95-2d7d16864242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:24.197247 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f26e77-d151-4853-8a95-2d7d16864242 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:24.201507 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d12ed-9718-4cc0-8dbd-43c226d09cd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:24.202299 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d12ed-9718-4cc0-8dbd-43c226d09cd2 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:24.202590 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d12ed-9718-4cc0-8dbd-43c226d09cd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:24.202874 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d12ed-9718-4cc0-8dbd-43c226d09cd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:24.277066 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d12ed-9718-4cc0-8dbd-43c226d09cd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:24.278937 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d12ed-9718-4cc0-8dbd-43c226d09cd2 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:24.289017 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 929/1864] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:24 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:33:25.369622 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5f813-9366-4655-bbda-e3e9e46a143d None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:25.371645 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-b5e5f813-9366-4655-bbda-e3e9e46a143d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:25.438680 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5f813-9366-4655-bbda-e3e9e46a143d None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:25.443491 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340424ee-c5d4-41ad-9795-6139a03c1c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:25.444355 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340424ee-c5d4-41ad-9795-6139a03c1c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:25.444639 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340424ee-c5d4-41ad-9795-6139a03c1c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:25.444916 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340424ee-c5d4-41ad-9795-6139a03c1c59 admin admin] PATH_INFO: `/v3/users/7147971802474e579aadf1ab5546746a` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:25.446132 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340424ee-c5d4-41ad-9795-6139a03c1c59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7147971802474e579aadf1ab5546746a)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:25.448029 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340424ee-c5d4-41ad-9795-6139a03c1c59 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:25.493307 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-340424ee-c5d4-41ad-9795-6139a03c1c59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7147971802474e579aadf1ab5546746a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:25.502121 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-340424ee-c5d4-41ad-9795-6139a03c1c59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7147971802474e579aadf1ab5546746a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:25.509173 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-340424ee-c5d4-41ad-9795-6139a03c1c59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7147971802474e579aadf1ab5546746a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:25.509857 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-340424ee-c5d4-41ad-9795-6139a03c1c59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7147971802474e579aadf1ab5546746a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:25.521660 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-340424ee-c5d4-41ad-9795-6139a03c1c59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7147971802474e579aadf1ab5546746a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:25.527302 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 936/1865] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:33:25 2021] DELETE /identity/v3/users/7147971802474e579aadf1ab5546746a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:25.531797 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5b281-db08-46aa-aed5-70a78490053a None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:25.532273 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5b281-db08-46aa-aed5-70a78490053a None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:25.532391 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5b281-db08-46aa-aed5-70a78490053a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:25.549727 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-bef5b281-db08-46aa-aed5-70a78490053a None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:25.550913 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-bef5b281-db08-46aa-aed5-70a78490053a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:25.608863 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 930/1866] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:25.619262 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340424ee-c5d4-41ad-9795-6139a03c1c59 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:25.621196 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-340424ee-c5d4-41ad-9795-6139a03c1c59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:25.680781 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340424ee-c5d4-41ad-9795-6139a03c1c59 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:25.685122 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a10336-d7c3-4330-a75c-9d4c910df82a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:25.685846 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a10336-d7c3-4330-a75c-9d4c910df82a service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:25.686197 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a10336-d7c3-4330-a75c-9d4c910df82a service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:25.686471 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a10336-d7c3-4330-a75c-9d4c910df82a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:25.701903 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a10336-d7c3-4330-a75c-9d4c910df82a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:25.705869 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a10336-d7c3-4330-a75c-9d4c910df82a service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:25.720791 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 937/1867] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:26.187335 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5b281-db08-46aa-aed5-70a78490053a None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:26.189341 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-bef5b281-db08-46aa-aed5-70a78490053a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:26.264240 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5b281-db08-46aa-aed5-70a78490053a None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:26.308889 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd3894-9612-47f3-9562-7cda6a069d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:26.310047 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd3894-9612-47f3-9562-7cda6a069d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:26.310492 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd3894-9612-47f3-9562-7cda6a069d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:26.310926 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd3894-9612-47f3-9562-7cda6a069d51 admin admin] PATH_INFO: `/v3/projects/8c07aac67e1345f6a05a06f09da40e34` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:26.319667 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd3894-9612-47f3-9562-7cda6a069d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c07aac67e1345f6a05a06f09da40e34)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:26.331928 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd3894-9612-47f3-9562-7cda6a069d51 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:26.452788 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-5cdd3894-9612-47f3-9562-7cda6a069d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c07aac67e1345f6a05a06f09da40e34', 'request_id': 'req-5cdd3894-9612-47f3-9562-7cda6a069d51'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:26.460351 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-5cdd3894-9612-47f3-9562-7cda6a069d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c07aac67e1345f6a05a06f09da40e34', 'request_id': 'req-5cdd3894-9612-47f3-9562-7cda6a069d51'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:26.476020 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-5cdd3894-9612-47f3-9562-7cda6a069d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c07aac67e1345f6a05a06f09da40e34', 'request_id': 'req-5cdd3894-9612-47f3-9562-7cda6a069d51'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:26.503532 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-5cdd3894-9612-47f3-9562-7cda6a069d51 admin admin] The token cache is being invalidate because project 8c07aac67e1345f6a05a06f09da40e34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:26.503828 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-5cdd3894-9612-47f3-9562-7cda6a069d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:26.505311 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-5cdd3894-9612-47f3-9562-7cda6a069d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:26.510106 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 931/1868] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:33:26 2021] DELETE /identity/v3/projects/8c07aac67e1345f6a05a06f09da40e34 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:26.515794 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf42510-2c32-4b04-b5d2-b6cd99844919 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:26.516245 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf42510-2c32-4b04-b5d2-b6cd99844919 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:26.516524 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf42510-2c32-4b04-b5d2-b6cd99844919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:26.537594 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-fdf42510-2c32-4b04-b5d2-b6cd99844919 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:26.538800 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-fdf42510-2c32-4b04-b5d2-b6cd99844919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:26.638635 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 938/1869] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:26.646915 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736982e9-2ec9-4363-a5da-1e624870160b None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:26.647403 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736982e9-2ec9-4363-a5da-1e624870160b None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:26.647492 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736982e9-2ec9-4363-a5da-1e624870160b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:26.671237 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-736982e9-2ec9-4363-a5da-1e624870160b None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:26.672735 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-736982e9-2ec9-4363-a5da-1e624870160b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:26.681340 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 932/1870] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:26.685471 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf42510-2c32-4b04-b5d2-b6cd99844919 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:26.695239 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf42510-2c32-4b04-b5d2-b6cd99844919 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:26.699883 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed54bc-9238-4f9c-bde2-40482a200fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:26.700524 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed54bc-9238-4f9c-bde2-40482a200fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:26.700806 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed54bc-9238-4f9c-bde2-40482a200fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:26.701082 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed54bc-9238-4f9c-bde2-40482a200fb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:26.701850 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed54bc-9238-4f9c-bde2-40482a200fb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:33:26.702174 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed54bc-9238-4f9c-bde2-40482a200fb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:26.703714 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed54bc-9238-4f9c-bde2-40482a200fb7 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:26.715448 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 939/1871] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:33:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:33:26.719784 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736982e9-2ec9-4363-a5da-1e624870160b None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:26.729216 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736982e9-2ec9-4363-a5da-1e624870160b None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:26.733914 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f85c01-ea43-4630-8fea-1341a5b49085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:26.734578 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f85c01-ea43-4630-8fea-1341a5b49085 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:26.734861 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f85c01-ea43-4630-8fea-1341a5b49085 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:26.735137 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f85c01-ea43-4630-8fea-1341a5b49085 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:26.735850 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f85c01-ea43-4630-8fea-1341a5b49085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:26.737787 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f85c01-ea43-4630-8fea-1341a5b49085 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:26.765959 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 933/1872] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:33:26 2021] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:26.767158 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed54bc-9238-4f9c-bde2-40482a200fb7 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:26.777597 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed54bc-9238-4f9c-bde2-40482a200fb7 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:26.833336 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275463b-ecb2-4f48-81e0-f1c121b2774b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:26.834065 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275463b-ecb2-4f48-81e0-f1c121b2774b admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:26.834353 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275463b-ecb2-4f48-81e0-f1c121b2774b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:26.834630 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275463b-ecb2-4f48-81e0-f1c121b2774b admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:26.835371 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275463b-ecb2-4f48-81e0-f1c121b2774b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:26.837290 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275463b-ecb2-4f48-81e0-f1c121b2774b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:26.859920 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 940/1873] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:33:26 2021] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:26.861158 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f85c01-ea43-4630-8fea-1341a5b49085 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:26.873585 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f85c01-ea43-4630-8fea-1341a5b49085 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:26.880494 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a760b6-9526-44ee-b6cb-56d594b5f7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:26.881164 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a760b6-9526-44ee-b6cb-56d594b5f7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:26.881448 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a760b6-9526-44ee-b6cb-56d594b5f7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:26.881754 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a760b6-9526-44ee-b6cb-56d594b5f7f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:26.882493 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a760b6-9526-44ee-b6cb-56d594b5f7f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:26.884786 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a760b6-9526-44ee-b6cb-56d594b5f7f9 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:26.896311 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 934/1874] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:26 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:26.901317 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275463b-ecb2-4f48-81e0-f1c121b2774b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:26.913796 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275463b-ecb2-4f48-81e0-f1c121b2774b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:26.918624 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e021fa-34da-489c-9bb9-4269f81bbc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:26.919304 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e021fa-34da-489c-9bb9-4269f81bbc73 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:26.919591 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e021fa-34da-489c-9bb9-4269f81bbc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:26.919871 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e021fa-34da-489c-9bb9-4269f81bbc73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:26.920599 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e021fa-34da-489c-9bb9-4269f81bbc73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:26.922326 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e021fa-34da-489c-9bb9-4269f81bbc73 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:26.934395 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 941/1875] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:26 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:26.938593 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a760b6-9526-44ee-b6cb-56d594b5f7f9 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:26.951699 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a760b6-9526-44ee-b6cb-56d594b5f7f9 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:26.956676 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec9022-cf33-4b1c-8e83-2845dc3642e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:26.957609 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec9022-cf33-4b1c-8e83-2845dc3642e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:26.957899 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec9022-cf33-4b1c-8e83-2845dc3642e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:26.958180 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec9022-cf33-4b1c-8e83-2845dc3642e6 admin admin] PATH_INFO: `/v3/projects/7b99601dd04044bd8118ad96177e4e1b/users/8a9c3207beb140f58f7967d0b792f5c3/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:26.974975 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec9022-cf33-4b1c-8e83-2845dc3642e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b99601dd04044bd8118ad96177e4e1b, user_id=8a9c3207beb140f58f7967d0b792f5c3, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:26.978482 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec9022-cf33-4b1c-8e83-2845dc3642e6 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:26.997080 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 935/1876] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:26 2021] PUT /identity/v3/projects/7b99601dd04044bd8118ad96177e4e1b/users/8a9c3207beb140f58f7967d0b792f5c3/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:26.998797 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61f870-4c82-41d2-a51e-ecf3ded3a724 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:26.999107 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61f870-4c82-41d2-a51e-ecf3ded3a724 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:26.999391 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61f870-4c82-41d2-a51e-ecf3ded3a724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:27.019236 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-6f61f870-4c82-41d2-a51e-ecf3ded3a724 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:27.020451 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-6f61f870-4c82-41d2-a51e-ecf3ded3a724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:27.091082 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 942/1877] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:27.098097 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec9022-cf33-4b1c-8e83-2845dc3642e6 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:27.099926 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-1fec9022-cf33-4b1c-8e83-2845dc3642e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:27.171255 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec9022-cf33-4b1c-8e83-2845dc3642e6 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:27.176071 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d89384-07eb-493f-bbb3-9c1662220078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:27.176729 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d89384-07eb-493f-bbb3-9c1662220078 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:27.177016 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d89384-07eb-493f-bbb3-9c1662220078 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:27.177297 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d89384-07eb-493f-bbb3-9c1662220078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:27.187971 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d89384-07eb-493f-bbb3-9c1662220078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:27.189404 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d89384-07eb-493f-bbb3-9c1662220078 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:27.200383 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 936/1878] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:28.167803 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61f870-4c82-41d2-a51e-ecf3ded3a724 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:28.170061 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-6f61f870-4c82-41d2-a51e-ecf3ded3a724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:28.187180 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61f870-4c82-41d2-a51e-ecf3ded3a724 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:28.197397 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6bc7b-a43c-47e3-848b-f2b881b3ffe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:28.198630 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6bc7b-a43c-47e3-848b-f2b881b3ffe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:28.199118 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6bc7b-a43c-47e3-848b-f2b881b3ffe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:28.199616 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6bc7b-a43c-47e3-848b-f2b881b3ffe8 admin admin] PATH_INFO: `/v3/users/d75a476cf37e40f68d94eb7083bd7a27` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:28.201085 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6bc7b-a43c-47e3-848b-f2b881b3ffe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d75a476cf37e40f68d94eb7083bd7a27)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:28.203273 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6bc7b-a43c-47e3-848b-f2b881b3ffe8 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:28.288648 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-79d6bc7b-a43c-47e3-848b-f2b881b3ffe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd75a476cf37e40f68d94eb7083bd7a27'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:28.298068 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-79d6bc7b-a43c-47e3-848b-f2b881b3ffe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd75a476cf37e40f68d94eb7083bd7a27'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:28.308167 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-79d6bc7b-a43c-47e3-848b-f2b881b3ffe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd75a476cf37e40f68d94eb7083bd7a27'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:28.309360 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-79d6bc7b-a43c-47e3-848b-f2b881b3ffe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd75a476cf37e40f68d94eb7083bd7a27'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:28.326963 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-79d6bc7b-a43c-47e3-848b-f2b881b3ffe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd75a476cf37e40f68d94eb7083bd7a27'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:28.333764 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 943/1879] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:33:28 2021] DELETE /identity/v3/users/d75a476cf37e40f68d94eb7083bd7a27 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:28.338349 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1e7fe-a15d-4bab-b958-833f90585b69 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:28.338894 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1e7fe-a15d-4bab-b958-833f90585b69 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:28.338894 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1e7fe-a15d-4bab-b958-833f90585b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:28.358547 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-7be1e7fe-a15d-4bab-b958-833f90585b69 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:28.359809 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-7be1e7fe-a15d-4bab-b958-833f90585b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:28.466926 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 937/1880] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:33:28.479102 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6bc7b-a43c-47e3-848b-f2b881b3ffe8 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:28.481745 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-79d6bc7b-a43c-47e3-848b-f2b881b3ffe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:28.576553 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6bc7b-a43c-47e3-848b-f2b881b3ffe8 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:28.582447 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23138303-6e5a-461c-8904-21a0b3242af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:28.583935 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23138303-6e5a-461c-8904-21a0b3242af7 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:28.584722 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23138303-6e5a-461c-8904-21a0b3242af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:28.585218 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23138303-6e5a-461c-8904-21a0b3242af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:28.600276 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23138303-6e5a-461c-8904-21a0b3242af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:28.602023 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23138303-6e5a-461c-8904-21a0b3242af7 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:28.613644 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 944/1881] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:28.985448 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1e7fe-a15d-4bab-b958-833f90585b69 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:28.987027 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-7be1e7fe-a15d-4bab-b958-833f90585b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:29.074725 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1e7fe-a15d-4bab-b958-833f90585b69 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:29.081069 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d8a62-3c6f-4219-a044-f167e2a4c013 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:29.085027 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d8a62-3c6f-4219-a044-f167e2a4c013 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:29.085599 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d8a62-3c6f-4219-a044-f167e2a4c013 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:29.086632 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d8a62-3c6f-4219-a044-f167e2a4c013 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:29.090065 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-db7d8a62-3c6f-4219-a044-f167e2a4c013 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:29.231608 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d8a62-3c6f-4219-a044-f167e2a4c013 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:29.233591 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d8a62-3c6f-4219-a044-f167e2a4c013 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:29.249189 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 938/1882] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:28 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:29.387175 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23138303-6e5a-461c-8904-21a0b3242af7 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:29.389371 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-23138303-6e5a-461c-8904-21a0b3242af7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:29.416007 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23138303-6e5a-461c-8904-21a0b3242af7 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:29.421613 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969aeb45-0f0d-4f39-86fb-e9183274fb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:29.422811 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969aeb45-0f0d-4f39-86fb-e9183274fb57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:29.423317 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969aeb45-0f0d-4f39-86fb-e9183274fb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:29.424355 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969aeb45-0f0d-4f39-86fb-e9183274fb57 admin admin] PATH_INFO: `/v3/projects/0f2da116edc141a8bf54baa587618a81` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:29.426077 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969aeb45-0f0d-4f39-86fb-e9183274fb57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f2da116edc141a8bf54baa587618a81)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:29.428230 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969aeb45-0f0d-4f39-86fb-e9183274fb57 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:29.524709 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-969aeb45-0f0d-4f39-86fb-e9183274fb57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f2da116edc141a8bf54baa587618a81', 'request_id': 'req-969aeb45-0f0d-4f39-86fb-e9183274fb57'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:29.530052 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-969aeb45-0f0d-4f39-86fb-e9183274fb57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f2da116edc141a8bf54baa587618a81', 'request_id': 'req-969aeb45-0f0d-4f39-86fb-e9183274fb57'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:29.541056 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-969aeb45-0f0d-4f39-86fb-e9183274fb57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f2da116edc141a8bf54baa587618a81', 'request_id': 'req-969aeb45-0f0d-4f39-86fb-e9183274fb57'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:29.558543 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-969aeb45-0f0d-4f39-86fb-e9183274fb57 admin admin] The token cache is being invalidate because project 0f2da116edc141a8bf54baa587618a81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:29.559094 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-969aeb45-0f0d-4f39-86fb-e9183274fb57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:29.561410 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-969aeb45-0f0d-4f39-86fb-e9183274fb57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:29.568029 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 945/1883] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:33:29 2021] DELETE /identity/v3/projects/0f2da116edc141a8bf54baa587618a81 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:29.569107 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d8a62-3c6f-4219-a044-f167e2a4c013 service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:29.584199 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d8a62-3c6f-4219-a044-f167e2a4c013 service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:29.684275 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eff39d-a2f4-46b7-958b-6baebc237e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:29.685171 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eff39d-a2f4-46b7-958b-6baebc237e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:29.685455 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eff39d-a2f4-46b7-958b-6baebc237e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:29.685759 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eff39d-a2f4-46b7-958b-6baebc237e53 admin admin] PATH_INFO: `/v3/users/92d831b9b1bb45c5ad5298620958af04` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:29.689075 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eff39d-a2f4-46b7-958b-6baebc237e53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92d831b9b1bb45c5ad5298620958af04)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:29.691760 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eff39d-a2f4-46b7-958b-6baebc237e53 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:29.782145 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-e1eff39d-a2f4-46b7-958b-6baebc237e53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92d831b9b1bb45c5ad5298620958af04'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:29.791924 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-e1eff39d-a2f4-46b7-958b-6baebc237e53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92d831b9b1bb45c5ad5298620958af04'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:29.792991 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-e1eff39d-a2f4-46b7-958b-6baebc237e53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92d831b9b1bb45c5ad5298620958af04'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:29.810299 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-e1eff39d-a2f4-46b7-958b-6baebc237e53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92d831b9b1bb45c5ad5298620958af04'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:29.820170 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-e1eff39d-a2f4-46b7-958b-6baebc237e53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92d831b9b1bb45c5ad5298620958af04'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:29.827949 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 939/1884] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:33:29 2021] DELETE /identity/v3/users/92d831b9b1bb45c5ad5298620958af04 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:33:30.873328 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969aeb45-0f0d-4f39-86fb-e9183274fb57 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:30.874790 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-969aeb45-0f0d-4f39-86fb-e9183274fb57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:30.905314 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969aeb45-0f0d-4f39-86fb-e9183274fb57 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:31.063001 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73b95e-8bc4-4619-a148-67611fae0c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:31.064655 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73b95e-8bc4-4619-a148-67611fae0c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:31.065109 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73b95e-8bc4-4619-a148-67611fae0c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:31.065648 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73b95e-8bc4-4619-a148-67611fae0c62 admin admin] PATH_INFO: `/v3/projects/0d657713cf1e4cb1a2f28b2b83cccb37` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:31.067691 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73b95e-8bc4-4619-a148-67611fae0c62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d657713cf1e4cb1a2f28b2b83cccb37)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:31.071050 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73b95e-8bc4-4619-a148-67611fae0c62 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:31.150740 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-7d73b95e-8bc4-4619-a148-67611fae0c62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d657713cf1e4cb1a2f28b2b83cccb37', 'request_id': 'req-7d73b95e-8bc4-4619-a148-67611fae0c62'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:31.185240 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-7d73b95e-8bc4-4619-a148-67611fae0c62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d657713cf1e4cb1a2f28b2b83cccb37', 'request_id': 'req-7d73b95e-8bc4-4619-a148-67611fae0c62'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:31.198011 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-7d73b95e-8bc4-4619-a148-67611fae0c62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d657713cf1e4cb1a2f28b2b83cccb37', 'request_id': 'req-7d73b95e-8bc4-4619-a148-67611fae0c62'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:31.224034 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-7d73b95e-8bc4-4619-a148-67611fae0c62 admin admin] The token cache is being invalidate because project 0d657713cf1e4cb1a2f28b2b83cccb37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:31.224328 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-7d73b95e-8bc4-4619-a148-67611fae0c62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:31.225214 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-7d73b95e-8bc4-4619-a148-67611fae0c62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:31.239596 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73798785-58e9-4ec4-87ed-bb6149e84d5c None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:31.240209 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73798785-58e9-4ec4-87ed-bb6149e84d5c None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:31.240209 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73798785-58e9-4ec4-87ed-bb6149e84d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:31.246106 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 946/1885] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:33:30 2021] DELETE /identity/v3/projects/0d657713cf1e4cb1a2f28b2b83cccb37 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:31.274380 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-73798785-58e9-4ec4-87ed-bb6149e84d5c None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:31.284461 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-73798785-58e9-4ec4-87ed-bb6149e84d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:31.416347 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 940/1886] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:31.424699 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7ae56-dcbc-40b3-bd02-b94514d78edf None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:31.425477 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7ae56-dcbc-40b3-bd02-b94514d78edf None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:31.426135 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7ae56-dcbc-40b3-bd02-b94514d78edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:31.449647 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-37e7ae56-dcbc-40b3-bd02-b94514d78edf None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:31.451278 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-37e7ae56-dcbc-40b3-bd02-b94514d78edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:31.464116 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 947/1887] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:31.469728 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73798785-58e9-4ec4-87ed-bb6149e84d5c None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:31.484128 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73798785-58e9-4ec4-87ed-bb6149e84d5c None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:31.500197 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39d7a0-e2b1-4120-9c92-1041a3a3b682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:31.501008 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39d7a0-e2b1-4120-9c92-1041a3a3b682 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:31.501269 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39d7a0-e2b1-4120-9c92-1041a3a3b682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:31.501649 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39d7a0-e2b1-4120-9c92-1041a3a3b682 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:31.502527 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf39d7a0-e2b1-4120-9c92-1041a3a3b682 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:33:31.503064 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf39d7a0-e2b1-4120-9c92-1041a3a3b682 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:31.506889 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf39d7a0-e2b1-4120-9c92-1041a3a3b682 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:31.534936 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 941/1888] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:33:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:33:31.536153 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7ae56-dcbc-40b3-bd02-b94514d78edf None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:31.547790 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7ae56-dcbc-40b3-bd02-b94514d78edf None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:31.553521 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4535206-17aa-44c4-95ce-7681ba33b4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:31.554405 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4535206-17aa-44c4-95ce-7681ba33b4f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:31.554863 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4535206-17aa-44c4-95ce-7681ba33b4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:31.555904 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4535206-17aa-44c4-95ce-7681ba33b4f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:31.557115 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4535206-17aa-44c4-95ce-7681ba33b4f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:31.559459 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4535206-17aa-44c4-95ce-7681ba33b4f4 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:31.611721 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 948/1889] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:33:31 2021] POST /identity/v3/projects => generated 363 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:33:31.662166 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39d7a0-e2b1-4120-9c92-1041a3a3b682 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:31.675565 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39d7a0-e2b1-4120-9c92-1041a3a3b682 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:31.793682 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3596b5-ee73-4d84-821f-fe9ddbf64546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:31.794893 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3596b5-ee73-4d84-821f-fe9ddbf64546 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:31.795571 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3596b5-ee73-4d84-821f-fe9ddbf64546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:31.796057 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3596b5-ee73-4d84-821f-fe9ddbf64546 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:31.797011 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3596b5-ee73-4d84-821f-fe9ddbf64546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:31.802509 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3596b5-ee73-4d84-821f-fe9ddbf64546 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:31.833911 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 942/1890] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:33:31 2021] POST /identity/v3/users => generated 282 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:31.840203 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4535206-17aa-44c4-95ce-7681ba33b4f4 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:31.852719 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4535206-17aa-44c4-95ce-7681ba33b4f4 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:31.859330 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e5922-521c-4727-bf5f-90a7b10e1204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:31.860028 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e5922-521c-4727-bf5f-90a7b10e1204 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:31.860434 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e5922-521c-4727-bf5f-90a7b10e1204 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:31.860718 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e5922-521c-4727-bf5f-90a7b10e1204 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:31.862270 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e5922-521c-4727-bf5f-90a7b10e1204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:31.864589 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e5922-521c-4727-bf5f-90a7b10e1204 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:31.883294 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 949/1891] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:31 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:31.884433 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3596b5-ee73-4d84-821f-fe9ddbf64546 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:31.897004 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3596b5-ee73-4d84-821f-fe9ddbf64546 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:31.902726 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36fc98a-d2e9-4466-b5c8-5e7679a8ca0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:31.903894 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fc98a-d2e9-4466-b5c8-5e7679a8ca0b admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:31.904332 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fc98a-d2e9-4466-b5c8-5e7679a8ca0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:31.904752 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fc98a-d2e9-4466-b5c8-5e7679a8ca0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:31.905778 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36fc98a-d2e9-4466-b5c8-5e7679a8ca0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:31.907652 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36fc98a-d2e9-4466-b5c8-5e7679a8ca0b admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:31.923252 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 943/1892] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:31 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:33:31.928503 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e5922-521c-4727-bf5f-90a7b10e1204 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:31.939816 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e5922-521c-4727-bf5f-90a7b10e1204 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:31.945091 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c70502-0c4c-4f91-8735-94c734c0b596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:31.946054 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c70502-0c4c-4f91-8735-94c734c0b596 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:31.946338 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c70502-0c4c-4f91-8735-94c734c0b596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:31.946613 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c70502-0c4c-4f91-8735-94c734c0b596 admin admin] PATH_INFO: `/v3/projects/4a3a68f27bc0491a8d27b4c56fe181d2/users/f0c9b6d3bb7d4ee98d328c8c2a0e0670/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:31.964527 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c70502-0c4c-4f91-8735-94c734c0b596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a3a68f27bc0491a8d27b4c56fe181d2, user_id=f0c9b6d3bb7d4ee98d328c8c2a0e0670, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:31.967685 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c70502-0c4c-4f91-8735-94c734c0b596 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:31.996240 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 950/1893] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:31 2021] PUT /identity/v3/projects/4a3a68f27bc0491a8d27b4c56fe181d2/users/f0c9b6d3bb7d4ee98d328c8c2a0e0670/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:32.006608 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dff8bc-cb2f-4ea4-a6ed-0226c207c952 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:32.006901 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dff8bc-cb2f-4ea4-a6ed-0226c207c952 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:32.008083 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dff8bc-cb2f-4ea4-a6ed-0226c207c952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:32.045041 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-95dff8bc-cb2f-4ea4-a6ed-0226c207c952 None None] MFA Rules not processed for user `f0c9b6d3bb7d4ee98d328c8c2a0e0670`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:32.046945 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-95dff8bc-cb2f-4ea4-a6ed-0226c207c952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:32.152189 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 944/1894] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:32 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:32.156337 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c70502-0c4c-4f91-8735-94c734c0b596 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:32.287597 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c70502-0c4c-4f91-8735-94c734c0b596 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:32.294341 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5cf6d-7165-4ac7-861b-66662a04beb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:32.295172 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5cf6d-7165-4ac7-861b-66662a04beb5 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:32.295622 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5cf6d-7165-4ac7-861b-66662a04beb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:32.296079 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5cf6d-7165-4ac7-861b-66662a04beb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:32.297701 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5cf6d-7165-4ac7-861b-66662a04beb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:32.300662 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5cf6d-7165-4ac7-861b-66662a04beb5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:32.339003 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 951/1895] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:33:32 2021] POST /identity/v3/projects => generated 365 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:33:32.343274 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dff8bc-cb2f-4ea4-a6ed-0226c207c952 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:32.367838 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dff8bc-cb2f-4ea4-a6ed-0226c207c952 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:32.583955 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d566481-7d51-44d9-9117-f8416f386b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:32.584697 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d566481-7d51-44d9-9117-f8416f386b5e admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:32.585021 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d566481-7d51-44d9-9117-f8416f386b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:32.585302 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d566481-7d51-44d9-9117-f8416f386b5e admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:32.586155 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d566481-7d51-44d9-9117-f8416f386b5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:32.591566 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d566481-7d51-44d9-9117-f8416f386b5e admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:32.649037 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 945/1896] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:33:32 2021] POST /identity/v3/users => generated 289 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:32.654707 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5cf6d-7165-4ac7-861b-66662a04beb5 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:32.669050 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5cf6d-7165-4ac7-861b-66662a04beb5 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:32.682701 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e90fa-86ba-48cf-9895-f7e3eb12cb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:32.685104 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e90fa-86ba-48cf-9895-f7e3eb12cb3d admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:32.685385 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e90fa-86ba-48cf-9895-f7e3eb12cb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:32.685922 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e90fa-86ba-48cf-9895-f7e3eb12cb3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:32.687164 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e90fa-86ba-48cf-9895-f7e3eb12cb3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:32.688956 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e90fa-86ba-48cf-9895-f7e3eb12cb3d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:32.701308 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 952/1897] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:32 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:32.705527 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d566481-7d51-44d9-9117-f8416f386b5e admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:32.720420 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d566481-7d51-44d9-9117-f8416f386b5e admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:32.732083 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df685ba3-7d5f-473c-a53b-2cf9b25e6df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:32.733558 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df685ba3-7d5f-473c-a53b-2cf9b25e6df8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:32.734026 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df685ba3-7d5f-473c-a53b-2cf9b25e6df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:32.734301 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df685ba3-7d5f-473c-a53b-2cf9b25e6df8 admin admin] PATH_INFO: `/v3/projects/d6ca38ba5843430694e04a723937325c/users/4c9ea3ad67514ad09efd6f5610efb50d/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:32.763116 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df685ba3-7d5f-473c-a53b-2cf9b25e6df8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6ca38ba5843430694e04a723937325c, user_id=4c9ea3ad67514ad09efd6f5610efb50d, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:32.766425 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df685ba3-7d5f-473c-a53b-2cf9b25e6df8 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:32.807253 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 946/1898] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:32 2021] PUT /identity/v3/projects/d6ca38ba5843430694e04a723937325c/users/4c9ea3ad67514ad09efd6f5610efb50d/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:32.811036 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e90fa-86ba-48cf-9895-f7e3eb12cb3d admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:32.824262 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e90fa-86ba-48cf-9895-f7e3eb12cb3d admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:32.904231 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed1a4d-4005-47b8-a935-98e67167fe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:32.904966 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed1a4d-4005-47b8-a935-98e67167fe4a admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:32.905164 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed1a4d-4005-47b8-a935-98e67167fe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:32.905674 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed1a4d-4005-47b8-a935-98e67167fe4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:32.906629 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed1a4d-4005-47b8-a935-98e67167fe4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:32.908528 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed1a4d-4005-47b8-a935-98e67167fe4a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:32.921061 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 953/1899] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:32 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:33:32.925896 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df685ba3-7d5f-473c-a53b-2cf9b25e6df8 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:32.962328 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df685ba3-7d5f-473c-a53b-2cf9b25e6df8 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:32.981228 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b414d6-4d82-4413-a6a8-d43af023383d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:32.982580 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b414d6-4d82-4413-a6a8-d43af023383d admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:32.983295 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b414d6-4d82-4413-a6a8-d43af023383d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:32.983797 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b414d6-4d82-4413-a6a8-d43af023383d admin admin] PATH_INFO: `/v3/projects/d6ca38ba5843430694e04a723937325c/users/4c9ea3ad67514ad09efd6f5610efb50d/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:32.987300 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b414d6-4d82-4413-a6a8-d43af023383d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6ca38ba5843430694e04a723937325c, user_id=4c9ea3ad67514ad09efd6f5610efb50d, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:32.990397 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b414d6-4d82-4413-a6a8-d43af023383d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:33.008657 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 947/1900] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:32 2021] PUT /identity/v3/projects/d6ca38ba5843430694e04a723937325c/users/4c9ea3ad67514ad09efd6f5610efb50d/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:33.019728 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84b87e-4d70-48b3-b956-ae707291765b None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:33.020258 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84b87e-4d70-48b3-b956-ae707291765b None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:33.020722 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84b87e-4d70-48b3-b956-ae707291765b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:33.068416 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-4b84b87e-4d70-48b3-b956-ae707291765b None None] MFA Rules not processed for user `4c9ea3ad67514ad09efd6f5610efb50d`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:33.071732 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-4b84b87e-4d70-48b3-b956-ae707291765b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:33.197689 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 954/1901] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:33 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:33:33.206889 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b414d6-4d82-4413-a6a8-d43af023383d admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:33.217724 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-d6b414d6-4d82-4413-a6a8-d43af023383d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:33.320883 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b414d6-4d82-4413-a6a8-d43af023383d admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:33.327201 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0eb3b3-e9df-4a54-917b-2dd39a5f7175 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:33.328126 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0eb3b3-e9df-4a54-917b-2dd39a5f7175 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:33.328235 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0eb3b3-e9df-4a54-917b-2dd39a5f7175 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:33.329420 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0eb3b3-e9df-4a54-917b-2dd39a5f7175 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:33.355257 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0eb3b3-e9df-4a54-917b-2dd39a5f7175 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:33.388353 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0eb3b3-e9df-4a54-917b-2dd39a5f7175 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:33.414778 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 948/1902] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:33 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:33.817996 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84b87e-4d70-48b3-b956-ae707291765b None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:33.910840 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84b87e-4d70-48b3-b956-ae707291765b None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:33.917184 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21081e3f-4ed4-4219-8620-525a87cb8dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:33.918321 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21081e3f-4ed4-4219-8620-525a87cb8dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:33.918748 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21081e3f-4ed4-4219-8620-525a87cb8dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:33.919031 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21081e3f-4ed4-4219-8620-525a87cb8dcd admin admin] PATH_INFO: `/v3/users/f0c9b6d3bb7d4ee98d328c8c2a0e0670` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:33.920335 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21081e3f-4ed4-4219-8620-525a87cb8dcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0c9b6d3bb7d4ee98d328c8c2a0e0670)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:33.922382 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21081e3f-4ed4-4219-8620-525a87cb8dcd admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:33.978905 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-21081e3f-4ed4-4219-8620-525a87cb8dcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0c9b6d3bb7d4ee98d328c8c2a0e0670'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:33.987979 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-21081e3f-4ed4-4219-8620-525a87cb8dcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0c9b6d3bb7d4ee98d328c8c2a0e0670'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:33.995771 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-21081e3f-4ed4-4219-8620-525a87cb8dcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0c9b6d3bb7d4ee98d328c8c2a0e0670'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:33.996566 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-21081e3f-4ed4-4219-8620-525a87cb8dcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0c9b6d3bb7d4ee98d328c8c2a0e0670'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:34.009469 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-21081e3f-4ed4-4219-8620-525a87cb8dcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0c9b6d3bb7d4ee98d328c8c2a0e0670'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:34.021218 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 955/1903] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:33:33 2021] DELETE /identity/v3/users/f0c9b6d3bb7d4ee98d328c8c2a0e0670 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:34.025799 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d7668-0f8f-4a5d-9080-82e106ee4aa8 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:34.026093 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d7668-0f8f-4a5d-9080-82e106ee4aa8 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:34.026376 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d7668-0f8f-4a5d-9080-82e106ee4aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:34.047353 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-569d7668-0f8f-4a5d-9080-82e106ee4aa8 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:34.049809 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-569d7668-0f8f-4a5d-9080-82e106ee4aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:34.119521 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 949/1904] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:33:34.126894 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21081e3f-4ed4-4219-8620-525a87cb8dcd admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:34.128913 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-21081e3f-4ed4-4219-8620-525a87cb8dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:34.215479 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21081e3f-4ed4-4219-8620-525a87cb8dcd admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:34.219350 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4ab28-eed9-470a-902c-3825d3a02861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:34.220052 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4ab28-eed9-470a-902c-3825d3a02861 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:34.220338 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4ab28-eed9-470a-902c-3825d3a02861 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:34.221140 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4ab28-eed9-470a-902c-3825d3a02861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:34.242544 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4ab28-eed9-470a-902c-3825d3a02861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:34.244105 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4ab28-eed9-470a-902c-3825d3a02861 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:34.254731 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 956/1905] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:34.519311 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d7668-0f8f-4a5d-9080-82e106ee4aa8 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:34.521293 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-569d7668-0f8f-4a5d-9080-82e106ee4aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:34.534397 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d7668-0f8f-4a5d-9080-82e106ee4aa8 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:34.539355 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de22cff-46e2-4ac4-acc3-a755a326cc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:34.540315 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de22cff-46e2-4ac4-acc3-a755a326cc06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:34.540668 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de22cff-46e2-4ac4-acc3-a755a326cc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:34.541042 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de22cff-46e2-4ac4-acc3-a755a326cc06 admin admin] PATH_INFO: `/v3/projects/4a3a68f27bc0491a8d27b4c56fe181d2` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:34.542332 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de22cff-46e2-4ac4-acc3-a755a326cc06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a3a68f27bc0491a8d27b4c56fe181d2)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:34.545120 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de22cff-46e2-4ac4-acc3-a755a326cc06 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:34.602622 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-3de22cff-46e2-4ac4-acc3-a755a326cc06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a3a68f27bc0491a8d27b4c56fe181d2', 'request_id': 'req-3de22cff-46e2-4ac4-acc3-a755a326cc06'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:34.608511 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-3de22cff-46e2-4ac4-acc3-a755a326cc06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a3a68f27bc0491a8d27b4c56fe181d2', 'request_id': 'req-3de22cff-46e2-4ac4-acc3-a755a326cc06'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:34.617651 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-3de22cff-46e2-4ac4-acc3-a755a326cc06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a3a68f27bc0491a8d27b4c56fe181d2', 'request_id': 'req-3de22cff-46e2-4ac4-acc3-a755a326cc06'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:34.641232 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-3de22cff-46e2-4ac4-acc3-a755a326cc06 admin admin] The token cache is being invalidate because project 4a3a68f27bc0491a8d27b4c56fe181d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:34.641581 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-3de22cff-46e2-4ac4-acc3-a755a326cc06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:34.642929 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-3de22cff-46e2-4ac4-acc3-a755a326cc06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:34.647367 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 950/1906] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:33:34 2021] DELETE /identity/v3/projects/4a3a68f27bc0491a8d27b4c56fe181d2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:34.648514 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4ab28-eed9-470a-902c-3825d3a02861 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:34.660459 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4ab28-eed9-470a-902c-3825d3a02861 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:34.750673 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689dbff2-a8e6-4754-b6b0-4d8ef5a80b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:34.752388 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dbff2-a8e6-4754-b6b0-4d8ef5a80b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:34.752746 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dbff2-a8e6-4754-b6b0-4d8ef5a80b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:34.753220 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dbff2-a8e6-4754-b6b0-4d8ef5a80b8e admin admin] PATH_INFO: `/v3/users/4c9ea3ad67514ad09efd6f5610efb50d` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:34.760597 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689dbff2-a8e6-4754-b6b0-4d8ef5a80b8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c9ea3ad67514ad09efd6f5610efb50d)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:34.762733 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689dbff2-a8e6-4754-b6b0-4d8ef5a80b8e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:34.888327 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-689dbff2-a8e6-4754-b6b0-4d8ef5a80b8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c9ea3ad67514ad09efd6f5610efb50d'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:34.904302 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-689dbff2-a8e6-4754-b6b0-4d8ef5a80b8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c9ea3ad67514ad09efd6f5610efb50d'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:34.930077 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-689dbff2-a8e6-4754-b6b0-4d8ef5a80b8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c9ea3ad67514ad09efd6f5610efb50d'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:34.931600 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-689dbff2-a8e6-4754-b6b0-4d8ef5a80b8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c9ea3ad67514ad09efd6f5610efb50d'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:34.937210 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de22cff-46e2-4ac4-acc3-a755a326cc06 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:34.938941 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3de22cff-46e2-4ac4-acc3-a755a326cc06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:34.962351 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-689dbff2-a8e6-4754-b6b0-4d8ef5a80b8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c9ea3ad67514ad09efd6f5610efb50d'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:34.976977 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de22cff-46e2-4ac4-acc3-a755a326cc06 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:34.977952 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 957/1907] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:33:34 2021] DELETE /identity/v3/users/4c9ea3ad67514ad09efd6f5610efb50d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:35.114796 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc219c8a-dd40-47a6-9179-0086366207bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:35.115882 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc219c8a-dd40-47a6-9179-0086366207bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:35.116263 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc219c8a-dd40-47a6-9179-0086366207bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:35.117036 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc219c8a-dd40-47a6-9179-0086366207bc admin admin] PATH_INFO: `/v3/users/76973bc401554d849f2178047f8518cf` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:35.118517 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc219c8a-dd40-47a6-9179-0086366207bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=76973bc401554d849f2178047f8518cf)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:35.122773 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc219c8a-dd40-47a6-9179-0086366207bc admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:35.219071 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-dc219c8a-dd40-47a6-9179-0086366207bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76973bc401554d849f2178047f8518cf'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:35.236544 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-dc219c8a-dd40-47a6-9179-0086366207bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76973bc401554d849f2178047f8518cf'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:35.238652 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-dc219c8a-dd40-47a6-9179-0086366207bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76973bc401554d849f2178047f8518cf'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:35.262701 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-dc219c8a-dd40-47a6-9179-0086366207bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76973bc401554d849f2178047f8518cf'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:35.273562 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-dc219c8a-dd40-47a6-9179-0086366207bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76973bc401554d849f2178047f8518cf'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:35.284263 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56690964-5cc1-4c33-8a4c-b065351b711e None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:35.284831 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56690964-5cc1-4c33-8a4c-b065351b711e None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:35.285311 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56690964-5cc1-4c33-8a4c-b065351b711e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:35.293046 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 951/1908] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:33:34 2021] DELETE /identity/v3/users/76973bc401554d849f2178047f8518cf => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:33:35.299092 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6c900-7615-4a4f-a08b-3024d59c67c6 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:35.299391 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6c900-7615-4a4f-a08b-3024d59c67c6 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:35.299687 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6c900-7615-4a4f-a08b-3024d59c67c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:35.323005 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-56690964-5cc1-4c33-8a4c-b065351b711e None None] MFA Rules not processed for user `8a9c3207beb140f58f7967d0b792f5c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:35.324928 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-56690964-5cc1-4c33-8a4c-b065351b711e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:35.337092 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-51e6c900-7615-4a4f-a08b-3024d59c67c6 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:35.338329 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-51e6c900-7615-4a4f-a08b-3024d59c67c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:35.479667 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 952/1909] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:33:35.479933 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 958/1910] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:35 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:33:35.482038 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6c900-7615-4a4f-a08b-3024d59c67c6 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:35.483596 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-51e6c900-7615-4a4f-a08b-3024d59c67c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:35.504439 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56690964-5cc1-4c33-8a4c-b065351b711e None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:35.506472 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-56690964-5cc1-4c33-8a4c-b065351b711e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:35.521354 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6c900-7615-4a4f-a08b-3024d59c67c6 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:35.543643 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d483d-ae65-4572-9a95-d0cc39c398f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:35.544319 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d483d-ae65-4572-9a95-d0cc39c398f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:35.547045 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d483d-ae65-4572-9a95-d0cc39c398f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:35.547335 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d483d-ae65-4572-9a95-d0cc39c398f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:35.548047 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d483d-ae65-4572-9a95-d0cc39c398f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:35.556296 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d483d-ae65-4572-9a95-d0cc39c398f4 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:35.623858 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 953/1911] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:33:35 2021] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:35.625429 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d483d-ae65-4572-9a95-d0cc39c398f4 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:35.659409 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56690964-5cc1-4c33-8a4c-b065351b711e None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:35.775576 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ed407-e429-4b23-affa-c1f9cc55cece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:35.776256 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ed407-e429-4b23-affa-c1f9cc55cece service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:35.776581 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ed407-e429-4b23-affa-c1f9cc55cece service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:35.776811 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ed407-e429-4b23-affa-c1f9cc55cece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:35.808352 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d483d-ae65-4572-9a95-d0cc39c398f4 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:35.822272 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88d971-7206-45c2-8e4c-d199357e0adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:35.822971 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88d971-7206-45c2-8e4c-d199357e0adb admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:35.823263 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88d971-7206-45c2-8e4c-d199357e0adb admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:35.823545 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88d971-7206-45c2-8e4c-d199357e0adb admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:35.824268 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88d971-7206-45c2-8e4c-d199357e0adb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:35.826582 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88d971-7206-45c2-8e4c-d199357e0adb admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:35.861247 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 954/1912] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:33:35 2021] POST /identity/v3/users => generated 299 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:35.862135 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88d971-7206-45c2-8e4c-d199357e0adb admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:35.865535 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-7f88d971-7206-45c2-8e4c-d199357e0adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:35.871673 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ed407-e429-4b23-affa-c1f9cc55cece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:35.873831 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ed407-e429-4b23-affa-c1f9cc55cece service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:35.895973 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88d971-7206-45c2-8e4c-d199357e0adb admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:35.902393 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 959/1913] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:35.906667 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ed407-e429-4b23-affa-c1f9cc55cece service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:35.907014 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be1816-81e8-451a-a09e-24967ad2e8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:35.909180 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be1816-81e8-451a-a09e-24967ad2e8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:35.909471 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be1816-81e8-451a-a09e-24967ad2e8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:35.909771 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be1816-81e8-451a-a09e-24967ad2e8d5 admin admin] PATH_INFO: `/v3/projects/d6ca38ba5843430694e04a723937325c` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:35.913697 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be1816-81e8-451a-a09e-24967ad2e8d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6ca38ba5843430694e04a723937325c)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:35.916967 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be1816-81e8-451a-a09e-24967ad2e8d5 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:35.936095 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ed407-e429-4b23-affa-c1f9cc55cece service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:35.950231 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4936b-59a8-4411-8a3d-b0264654930d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:35.951775 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4936b-59a8-4411-8a3d-b0264654930d admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:35.952994 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4936b-59a8-4411-8a3d-b0264654930d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:35.954089 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4936b-59a8-4411-8a3d-b0264654930d admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:35.954995 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4936b-59a8-4411-8a3d-b0264654930d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:35.964641 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4936b-59a8-4411-8a3d-b0264654930d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:35.988772 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 960/1914] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:35 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:35.993565 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4936b-59a8-4411-8a3d-b0264654930d admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:36.006794 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4936b-59a8-4411-8a3d-b0264654930d admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:36.015036 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b3be1816-81e8-451a-a09e-24967ad2e8d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6ca38ba5843430694e04a723937325c', 'request_id': 'req-b3be1816-81e8-451a-a09e-24967ad2e8d5'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:36.065473 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b3be1816-81e8-451a-a09e-24967ad2e8d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6ca38ba5843430694e04a723937325c', 'request_id': 'req-b3be1816-81e8-451a-a09e-24967ad2e8d5'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:36.082614 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b3be1816-81e8-451a-a09e-24967ad2e8d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6ca38ba5843430694e04a723937325c', 'request_id': 'req-b3be1816-81e8-451a-a09e-24967ad2e8d5'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:36.108767 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b3be1816-81e8-451a-a09e-24967ad2e8d5 admin admin] The token cache is being invalidate because project d6ca38ba5843430694e04a723937325c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:36.109105 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b3be1816-81e8-451a-a09e-24967ad2e8d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:36.113255 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b3be1816-81e8-451a-a09e-24967ad2e8d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:36.117183 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 955/1915] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:33:35 2021] DELETE /identity/v3/projects/d6ca38ba5843430694e04a723937325c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:36.122821 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9f0dd-c700-4766-8c91-d51699075113 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:36.123095 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9f0dd-c700-4766-8c91-d51699075113 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:36.123374 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9f0dd-c700-4766-8c91-d51699075113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:36.163846 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-a0a9f0dd-c700-4766-8c91-d51699075113 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:36.167426 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-a0a9f0dd-c700-4766-8c91-d51699075113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:36.187033 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb175e-124b-447e-9b61-d1715d36fc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:36.188296 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb175e-124b-447e-9b61-d1715d36fc56 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:36.188614 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb175e-124b-447e-9b61-d1715d36fc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:36.188965 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb175e-124b-447e-9b61-d1715d36fc56 admin admin] PATH_INFO: `/v3/projects/9928c9a13a7b4630af390a189fc8b009/users/01c75b4e3d114e99831a6b1599bf1e7f/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:36.222590 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb175e-124b-447e-9b61-d1715d36fc56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9928c9a13a7b4630af390a189fc8b009, user_id=01c75b4e3d114e99831a6b1599bf1e7f, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:36.227937 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb175e-124b-447e-9b61-d1715d36fc56 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:36.277306 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 961/1916] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:35 2021] PUT /identity/v3/projects/9928c9a13a7b4630af390a189fc8b009/users/01c75b4e3d114e99831a6b1599bf1e7f/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:36.280112 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb175e-124b-447e-9b61-d1715d36fc56 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:36.287907 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-39bb175e-124b-447e-9b61-d1715d36fc56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:36.344366 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 956/1917] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:36.353618 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec622794-cd9f-44f0-9143-f90fbfc17276 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:36.354229 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec622794-cd9f-44f0-9143-f90fbfc17276 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:36.354710 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec622794-cd9f-44f0-9143-f90fbfc17276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:36.386392 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-ec622794-cd9f-44f0-9143-f90fbfc17276 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:36.387887 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-ec622794-cd9f-44f0-9143-f90fbfc17276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:36.404789 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb175e-124b-447e-9b61-d1715d36fc56 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:36.411323 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135c42d-4899-4e41-b5bb-6806e7f50cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:36.412022 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135c42d-4899-4e41-b5bb-6806e7f50cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:36.412357 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135c42d-4899-4e41-b5bb-6806e7f50cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:36.412639 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135c42d-4899-4e41-b5bb-6806e7f50cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:36.413386 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135c42d-4899-4e41-b5bb-6806e7f50cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:36.415972 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135c42d-4899-4e41-b5bb-6806e7f50cd5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:36.417179 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 957/1918] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:33:36.418526 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec622794-cd9f-44f0-9143-f90fbfc17276 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:36.421818 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-ec622794-cd9f-44f0-9143-f90fbfc17276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:36.431454 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 962/1919] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:36 2021] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:33:36.431454 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135c42d-4899-4e41-b5bb-6806e7f50cd5 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:36.444136 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135c42d-4899-4e41-b5bb-6806e7f50cd5 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:36.449771 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f163c-d212-4f75-94b9-3cb36f207e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:36.450622 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f163c-d212-4f75-94b9-3cb36f207e39 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:36.451002 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f163c-d212-4f75-94b9-3cb36f207e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:36.451539 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f163c-d212-4f75-94b9-3cb36f207e39 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:36.452390 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f163c-d212-4f75-94b9-3cb36f207e39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:33:36.453053 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f163c-d212-4f75-94b9-3cb36f207e39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:36.454004 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec622794-cd9f-44f0-9143-f90fbfc17276 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:36.455492 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f163c-d212-4f75-94b9-3cb36f207e39 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:36.477336 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6f69a-d7c4-4041-b993-7e059fcbde3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:36.478973 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6f69a-d7c4-4041-b993-7e059fcbde3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:36.479469 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6f69a-d7c4-4041-b993-7e059fcbde3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:36.479969 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6f69a-d7c4-4041-b993-7e059fcbde3d admin admin] PATH_INFO: `/v3/projects/ccd7eea540444f3db1fa10a195f95a3c` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:36.481517 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6f69a-d7c4-4041-b993-7e059fcbde3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd7eea540444f3db1fa10a195f95a3c)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:36.484524 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6f69a-d7c4-4041-b993-7e059fcbde3d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:36.489005 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 963/1920] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:33:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:33:36.489964 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f163c-d212-4f75-94b9-3cb36f207e39 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:36.510916 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f163c-d212-4f75-94b9-3cb36f207e39 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:36.522319 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b99e1-62df-4d3e-b1a3-65ee35552886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:36.523231 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b99e1-62df-4d3e-b1a3-65ee35552886 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:36.524679 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b99e1-62df-4d3e-b1a3-65ee35552886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:36.524679 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b99e1-62df-4d3e-b1a3-65ee35552886 admin admin] PATH_INFO: `/v3/projects/9928c9a13a7b4630af390a189fc8b009/users/01c75b4e3d114e99831a6b1599bf1e7f/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:36.528608 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b99e1-62df-4d3e-b1a3-65ee35552886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9928c9a13a7b4630af390a189fc8b009, user_id=01c75b4e3d114e99831a6b1599bf1e7f, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:36.565698 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b99e1-62df-4d3e-b1a3-65ee35552886 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:36.613803 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-14a6f69a-d7c4-4041-b993-7e059fcbde3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd7eea540444f3db1fa10a195f95a3c', 'request_id': 'req-14a6f69a-d7c4-4041-b993-7e059fcbde3d'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:36.617118 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 964/1921] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:36 2021] PUT /identity/v3/projects/9928c9a13a7b4630af390a189fc8b009/users/01c75b4e3d114e99831a6b1599bf1e7f/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:36.625452 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b99e1-62df-4d3e-b1a3-65ee35552886 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:36.643890 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-14a6f69a-d7c4-4041-b993-7e059fcbde3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd7eea540444f3db1fa10a195f95a3c', 'request_id': 'req-14a6f69a-d7c4-4041-b993-7e059fcbde3d'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:36.675685 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-14a6f69a-d7c4-4041-b993-7e059fcbde3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd7eea540444f3db1fa10a195f95a3c', 'request_id': 'req-14a6f69a-d7c4-4041-b993-7e059fcbde3d'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:36.698272 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-14a6f69a-d7c4-4041-b993-7e059fcbde3d admin admin] The token cache is being invalidate because project ccd7eea540444f3db1fa10a195f95a3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:36.698560 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-14a6f69a-d7c4-4041-b993-7e059fcbde3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:36.699411 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-14a6f69a-d7c4-4041-b993-7e059fcbde3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:36.713722 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 958/1922] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:33:36 2021] DELETE /identity/v3/projects/ccd7eea540444f3db1fa10a195f95a3c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:36.714740 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6f69a-d7c4-4041-b993-7e059fcbde3d admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:36.721873 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-14a6f69a-d7c4-4041-b993-7e059fcbde3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:36.869555 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b99e1-62df-4d3e-b1a3-65ee35552886 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:36.888649 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0db63-dab7-4f9e-8967-b97ff496ada1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:36.889336 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0db63-dab7-4f9e-8967-b97ff496ada1 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:36.889643 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0db63-dab7-4f9e-8967-b97ff496ada1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:36.889927 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0db63-dab7-4f9e-8967-b97ff496ada1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:36.890648 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0db63-dab7-4f9e-8967-b97ff496ada1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:36.892610 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0db63-dab7-4f9e-8967-b97ff496ada1 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:36.942712 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6f69a-d7c4-4041-b993-7e059fcbde3d admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:36.961113 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c5b8b-edbe-458d-a74a-bb1b9d313a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:36.961364 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 965/1923] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:33:36 2021] POST /identity/v3/projects => generated 367 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:36.962565 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0db63-dab7-4f9e-8967-b97ff496ada1 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:36.963711 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c5b8b-edbe-458d-a74a-bb1b9d313a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:36.963991 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c5b8b-edbe-458d-a74a-bb1b9d313a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:36.964261 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c5b8b-edbe-458d-a74a-bb1b9d313a2b admin admin] PATH_INFO: `/v3/users/ebae5b08ac0b4a268447690de3d1c1c0` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:36.965569 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c5b8b-edbe-458d-a74a-bb1b9d313a2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebae5b08ac0b4a268447690de3d1c1c0)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:36.967507 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c5b8b-edbe-458d-a74a-bb1b9d313a2b admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:36.968420 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-6cb0db63-dab7-4f9e-8967-b97ff496ada1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:37.118414 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-069c5b8b-edbe-458d-a74a-bb1b9d313a2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebae5b08ac0b4a268447690de3d1c1c0'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:37.136656 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-069c5b8b-edbe-458d-a74a-bb1b9d313a2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebae5b08ac0b4a268447690de3d1c1c0'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:37.137417 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-069c5b8b-edbe-458d-a74a-bb1b9d313a2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebae5b08ac0b4a268447690de3d1c1c0'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:37.172818 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0db63-dab7-4f9e-8967-b97ff496ada1 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:37.176952 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-069c5b8b-edbe-458d-a74a-bb1b9d313a2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebae5b08ac0b4a268447690de3d1c1c0'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:37.183075 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8648a-3df3-4dce-b397-062eabb506ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:37.186195 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8648a-3df3-4dce-b397-062eabb506ce admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:37.186484 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8648a-3df3-4dce-b397-062eabb506ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:37.186761 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8648a-3df3-4dce-b397-062eabb506ce admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:37.187415 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-069c5b8b-edbe-458d-a74a-bb1b9d313a2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebae5b08ac0b4a268447690de3d1c1c0'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:37.187540 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8648a-3df3-4dce-b397-062eabb506ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:37.193594 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8648a-3df3-4dce-b397-062eabb506ce admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:37.197142 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 959/1924] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:33:36 2021] DELETE /identity/v3/users/ebae5b08ac0b4a268447690de3d1c1c0 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:37.240190 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 966/1925] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:33:36 2021] POST /identity/v3/users => generated 284 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:37.241427 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c5b8b-edbe-458d-a74a-bb1b9d313a2b admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:37.242900 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-069c5b8b-edbe-458d-a74a-bb1b9d313a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:37.391140 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c5b8b-edbe-458d-a74a-bb1b9d313a2b admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:37.409149 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9a0bb-2e2c-4187-b1ba-cab4c1b7e904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:37.409872 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9a0bb-2e2c-4187-b1ba-cab4c1b7e904 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:37.410158 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9a0bb-2e2c-4187-b1ba-cab4c1b7e904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:37.410437 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9a0bb-2e2c-4187-b1ba-cab4c1b7e904 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:37.411192 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9a0bb-2e2c-4187-b1ba-cab4c1b7e904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:37.412813 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9a0bb-2e2c-4187-b1ba-cab4c1b7e904 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:37.424743 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 960/1926] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:37 2021] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:37.430824 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8648a-3df3-4dce-b397-062eabb506ce admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:37.443656 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8648a-3df3-4dce-b397-062eabb506ce admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:37.468909 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d28d05-c803-445e-9b3f-74eb9ab9319f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:37.469755 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d28d05-c803-445e-9b3f-74eb9ab9319f admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:37.470043 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d28d05-c803-445e-9b3f-74eb9ab9319f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:37.470482 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d28d05-c803-445e-9b3f-74eb9ab9319f admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:37.474513 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d28d05-c803-445e-9b3f-74eb9ab9319f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:37.476366 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d28d05-c803-445e-9b3f-74eb9ab9319f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:37.502832 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 967/1927] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:37 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:37.506176 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9a0bb-2e2c-4187-b1ba-cab4c1b7e904 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:37.525749 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9a0bb-2e2c-4187-b1ba-cab4c1b7e904 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:37.531616 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a3241-c246-4837-845f-f80c0ce0244a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:37.532719 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a3241-c246-4837-845f-f80c0ce0244a admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:37.534096 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a3241-c246-4837-845f-f80c0ce0244a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:37.534479 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a3241-c246-4837-845f-f80c0ce0244a admin admin] PATH_INFO: `/v3/projects/b5b177e5cb9f4fc8a0986c229875dfce/users/6054e5489a13425f98119f371e0e324b/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:37.561839 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a3241-c246-4837-845f-f80c0ce0244a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5b177e5cb9f4fc8a0986c229875dfce, user_id=6054e5489a13425f98119f371e0e324b, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:37.565456 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a3241-c246-4837-845f-f80c0ce0244a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:37.594139 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 961/1928] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:37 2021] PUT /identity/v3/projects/b5b177e5cb9f4fc8a0986c229875dfce/users/6054e5489a13425f98119f371e0e324b/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:37.605564 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21363b1c-c8c6-4055-bba7-369de90a245c None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:37.605883 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21363b1c-c8c6-4055-bba7-369de90a245c None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:37.606128 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21363b1c-c8c6-4055-bba7-369de90a245c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:37.638210 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-21363b1c-c8c6-4055-bba7-369de90a245c None None] MFA Rules not processed for user `6054e5489a13425f98119f371e0e324b`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:37.639587 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-21363b1c-c8c6-4055-bba7-369de90a245c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:37.740631 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 968/1929] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:37 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:37.741854 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a3241-c246-4837-845f-f80c0ce0244a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:37.846542 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a3241-c246-4837-845f-f80c0ce0244a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:37.860669 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2c4a2-e430-4b6e-b296-b5a6a02092c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:37.862564 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2c4a2-e430-4b6e-b296-b5a6a02092c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:37.863021 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2c4a2-e430-4b6e-b296-b5a6a02092c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:37.863467 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2c4a2-e430-4b6e-b296-b5a6a02092c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:37.864875 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2c4a2-e430-4b6e-b296-b5a6a02092c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:37.868288 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2c4a2-e430-4b6e-b296-b5a6a02092c5 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:37.925527 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 962/1930] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:33:37 2021] POST /identity/v3/projects => generated 367 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:37.929346 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21363b1c-c8c6-4055-bba7-369de90a245c None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:37.945375 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21363b1c-c8c6-4055-bba7-369de90a245c None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:38.037223 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ce3f4-1948-43e8-a397-058b6bdef15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:38.037223 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ce3f4-1948-43e8-a397-058b6bdef15e admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:38.037223 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ce3f4-1948-43e8-a397-058b6bdef15e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:38.038192 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ce3f4-1948-43e8-a397-058b6bdef15e admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:38.038270 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ce3f4-1948-43e8-a397-058b6bdef15e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:38.041312 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ce3f4-1948-43e8-a397-058b6bdef15e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:38.083777 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 969/1931] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:33:37 2021] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:38.087567 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2c4a2-e430-4b6e-b296-b5a6a02092c5 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:38.101121 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2c4a2-e430-4b6e-b296-b5a6a02092c5 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:38.107050 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b9137-c1a2-4e64-b2e4-3b804b6185a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:38.108030 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b9137-c1a2-4e64-b2e4-3b804b6185a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:38.108414 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b9137-c1a2-4e64-b2e4-3b804b6185a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:38.108840 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b9137-c1a2-4e64-b2e4-3b804b6185a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:38.109962 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b9137-c1a2-4e64-b2e4-3b804b6185a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:38.111845 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b9137-c1a2-4e64-b2e4-3b804b6185a7 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:38.131104 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 963/1932] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:38 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:38.131899 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ce3f4-1948-43e8-a397-058b6bdef15e admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:38.149508 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ce3f4-1948-43e8-a397-058b6bdef15e admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:38.157850 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97376d-25a5-4452-b36c-29ccbce0c0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:38.159383 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97376d-25a5-4452-b36c-29ccbce0c0bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:38.159675 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97376d-25a5-4452-b36c-29ccbce0c0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:38.159951 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97376d-25a5-4452-b36c-29ccbce0c0bc admin admin] PATH_INFO: `/v3/projects/1585464424d74542a3825d8bdccb08b3/users/a195102cd9954f6cbd1da47939363557/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:38.207615 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97376d-25a5-4452-b36c-29ccbce0c0bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1585464424d74542a3825d8bdccb08b3, user_id=a195102cd9954f6cbd1da47939363557, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:38.244690 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97376d-25a5-4452-b36c-29ccbce0c0bc admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:38.302747 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b9137-c1a2-4e64-b2e4-3b804b6185a7 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:38.304446 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 970/1933] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:38 2021] PUT /identity/v3/projects/1585464424d74542a3825d8bdccb08b3/users/a195102cd9954f6cbd1da47939363557/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:33:38.337386 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b9137-c1a2-4e64-b2e4-3b804b6185a7 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:38.443701 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5126f3e-cb60-4ba8-a4d2-771bf1033d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:38.445298 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5126f3e-cb60-4ba8-a4d2-771bf1033d1f admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:38.446716 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5126f3e-cb60-4ba8-a4d2-771bf1033d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:38.449329 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5126f3e-cb60-4ba8-a4d2-771bf1033d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:38.451395 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5126f3e-cb60-4ba8-a4d2-771bf1033d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:38.457229 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5126f3e-cb60-4ba8-a4d2-771bf1033d1f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:38.494187 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97376d-25a5-4452-b36c-29ccbce0c0bc admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:38.507033 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 964/1934] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:38 2021] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:38.511181 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97376d-25a5-4452-b36c-29ccbce0c0bc admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:38.522543 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d99c88-ca10-4c4c-9141-5c9ad95c4ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:38.523540 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d99c88-ca10-4c4c-9141-5c9ad95c4ea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:38.523876 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d99c88-ca10-4c4c-9141-5c9ad95c4ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:38.524097 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d99c88-ca10-4c4c-9141-5c9ad95c4ea7 admin admin] PATH_INFO: `/v3/projects/1585464424d74542a3825d8bdccb08b3/users/a195102cd9954f6cbd1da47939363557/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:38.528010 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d99c88-ca10-4c4c-9141-5c9ad95c4ea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1585464424d74542a3825d8bdccb08b3, user_id=a195102cd9954f6cbd1da47939363557, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:38.535138 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d99c88-ca10-4c4c-9141-5c9ad95c4ea7 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:38.563887 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003c075-69ea-4859-9b7c-3e9ebdeb2902 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:38.564968 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003c075-69ea-4859-9b7c-3e9ebdeb2902 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:38.565463 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003c075-69ea-4859-9b7c-3e9ebdeb2902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:38.572948 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 971/1935] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:38 2021] PUT /identity/v3/projects/1585464424d74542a3825d8bdccb08b3/users/a195102cd9954f6cbd1da47939363557/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:38.602299 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-2003c075-69ea-4859-9b7c-3e9ebdeb2902 None None] MFA Rules not processed for user `a195102cd9954f6cbd1da47939363557`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:38.604178 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-2003c075-69ea-4859-9b7c-3e9ebdeb2902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:38.765889 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 965/1936] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:38 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:38.779872 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d99c88-ca10-4c4c-9141-5c9ad95c4ea7 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:38.784448 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-c1d99c88-ca10-4c4c-9141-5c9ad95c4ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:38.847500 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003c075-69ea-4859-9b7c-3e9ebdeb2902 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:38.848864 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-2003c075-69ea-4859-9b7c-3e9ebdeb2902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:38.941718 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d99c88-ca10-4c4c-9141-5c9ad95c4ea7 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:38.950066 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be070e-6fc7-4929-a1aa-ae528c9c1566 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:38.950815 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be070e-6fc7-4929-a1aa-ae528c9c1566 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:38.951130 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be070e-6fc7-4929-a1aa-ae528c9c1566 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:38.951414 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be070e-6fc7-4929-a1aa-ae528c9c1566 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:38.983391 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be070e-6fc7-4929-a1aa-ae528c9c1566 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:38.991292 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be070e-6fc7-4929-a1aa-ae528c9c1566 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:39.019072 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 972/1937] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:38 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:39.022201 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003c075-69ea-4859-9b7c-3e9ebdeb2902 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:39.042032 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e40f57-160f-4f10-b488-7a4220eae8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:39.042908 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e40f57-160f-4f10-b488-7a4220eae8b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:39.043222 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e40f57-160f-4f10-b488-7a4220eae8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:39.043457 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e40f57-160f-4f10-b488-7a4220eae8b9 admin admin] PATH_INFO: `/v3/projects/6e68626d4b0b401289ffc892b449ecc3` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:39.045728 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e40f57-160f-4f10-b488-7a4220eae8b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e68626d4b0b401289ffc892b449ecc3)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:39.053569 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e40f57-160f-4f10-b488-7a4220eae8b9 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:39.117916 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be070e-6fc7-4929-a1aa-ae528c9c1566 service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:39.119492 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-b8be070e-6fc7-4929-a1aa-ae528c9c1566 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:39.136679 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be070e-6fc7-4929-a1aa-ae528c9c1566 service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:39.156348 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d9e40f57-160f-4f10-b488-7a4220eae8b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e68626d4b0b401289ffc892b449ecc3', 'request_id': 'req-d9e40f57-160f-4f10-b488-7a4220eae8b9'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:39.163040 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d9e40f57-160f-4f10-b488-7a4220eae8b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e68626d4b0b401289ffc892b449ecc3', 'request_id': 'req-d9e40f57-160f-4f10-b488-7a4220eae8b9'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:39.178527 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d9e40f57-160f-4f10-b488-7a4220eae8b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e68626d4b0b401289ffc892b449ecc3', 'request_id': 'req-d9e40f57-160f-4f10-b488-7a4220eae8b9'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:39.231843 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d9e40f57-160f-4f10-b488-7a4220eae8b9 admin admin] The token cache is being invalidate because project 6e68626d4b0b401289ffc892b449ecc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:39.232389 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d9e40f57-160f-4f10-b488-7a4220eae8b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:39.233230 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d9e40f57-160f-4f10-b488-7a4220eae8b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:39.237444 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 966/1938] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:33:38 2021] DELETE /identity/v3/projects/6e68626d4b0b401289ffc892b449ecc3 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:33:39.244232 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841470f-9580-4d8a-a068-fe3166840090 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:39.245273 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841470f-9580-4d8a-a068-fe3166840090 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:39.245594 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841470f-9580-4d8a-a068-fe3166840090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:39.287182 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-e841470f-9580-4d8a-a068-fe3166840090 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:39.291864 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-e841470f-9580-4d8a-a068-fe3166840090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:39.297361 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d00a9-2e61-4706-8bad-63d10a29129f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:39.298063 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d00a9-2e61-4706-8bad-63d10a29129f service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:39.298435 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d00a9-2e61-4706-8bad-63d10a29129f service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:39.299305 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d00a9-2e61-4706-8bad-63d10a29129f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:39.303627 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-603d00a9-2e61-4706-8bad-63d10a29129f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:39.403053 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d00a9-2e61-4706-8bad-63d10a29129f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:39.405170 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d00a9-2e61-4706-8bad-63d10a29129f service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:39.405673 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 967/1939] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:39.416228 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326e2f6-a088-4cbb-b135-fc26ff93abd3 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:39.416790 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326e2f6-a088-4cbb-b135-fc26ff93abd3 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:39.417251 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326e2f6-a088-4cbb-b135-fc26ff93abd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:39.419570 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 973/1940] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:39 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:39.447495 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-1326e2f6-a088-4cbb-b135-fc26ff93abd3 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:39.448907 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-1326e2f6-a088-4cbb-b135-fc26ff93abd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:39.461871 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 968/1941] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:33:39.465876 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d00a9-2e61-4706-8bad-63d10a29129f service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:39.486640 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d00a9-2e61-4706-8bad-63d10a29129f service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:39.501325 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8373676-2221-4325-bba0-5cd585042d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:39.502033 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8373676-2221-4325-bba0-5cd585042d10 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:39.502476 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8373676-2221-4325-bba0-5cd585042d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:39.503329 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8373676-2221-4325-bba0-5cd585042d10 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:39.503508 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8373676-2221-4325-bba0-5cd585042d10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:33:39.503823 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8373676-2221-4325-bba0-5cd585042d10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:39.507693 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8373676-2221-4325-bba0-5cd585042d10 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:39.535580 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 974/1942] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:33:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:33:39.540972 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326e2f6-a088-4cbb-b135-fc26ff93abd3 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:39.554912 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326e2f6-a088-4cbb-b135-fc26ff93abd3 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:39.582263 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83746f8-33e0-48ae-9793-03befbcac9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:39.583419 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83746f8-33e0-48ae-9793-03befbcac9cd admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:39.584054 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83746f8-33e0-48ae-9793-03befbcac9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:39.584720 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83746f8-33e0-48ae-9793-03befbcac9cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:39.586120 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83746f8-33e0-48ae-9793-03befbcac9cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:39.588353 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83746f8-33e0-48ae-9793-03befbcac9cd admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:39.632376 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 969/1943] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:33:39 2021] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:39.638092 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8373676-2221-4325-bba0-5cd585042d10 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:39.653019 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8373676-2221-4325-bba0-5cd585042d10 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:39.792337 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3994c0-31f1-4a7f-ac6a-3c4ad7a65564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:39.793744 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3994c0-31f1-4a7f-ac6a-3c4ad7a65564 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:39.795732 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3994c0-31f1-4a7f-ac6a-3c4ad7a65564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:39.796293 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3994c0-31f1-4a7f-ac6a-3c4ad7a65564 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:39.798633 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3994c0-31f1-4a7f-ac6a-3c4ad7a65564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:39.805081 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3994c0-31f1-4a7f-ac6a-3c4ad7a65564 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:39.858159 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 975/1944] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:33:39 2021] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:39.859619 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83746f8-33e0-48ae-9793-03befbcac9cd admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:39.873281 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83746f8-33e0-48ae-9793-03befbcac9cd admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:39.889457 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41bcc2-9da9-45f1-89b0-332742e3ca31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:39.890284 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41bcc2-9da9-45f1-89b0-332742e3ca31 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:39.890674 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41bcc2-9da9-45f1-89b0-332742e3ca31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:39.891069 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41bcc2-9da9-45f1-89b0-332742e3ca31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:39.893960 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41bcc2-9da9-45f1-89b0-332742e3ca31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:39.896442 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41bcc2-9da9-45f1-89b0-332742e3ca31 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:39.915550 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 970/1945] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:39 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:33:39.919883 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3994c0-31f1-4a7f-ac6a-3c4ad7a65564 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:39.938975 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3994c0-31f1-4a7f-ac6a-3c4ad7a65564 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:39.945366 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a89989-8df6-408e-b2cb-f2e0162f39a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:39.946294 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a89989-8df6-408e-b2cb-f2e0162f39a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:39.946745 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a89989-8df6-408e-b2cb-f2e0162f39a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:39.947154 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a89989-8df6-408e-b2cb-f2e0162f39a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:39.948219 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a89989-8df6-408e-b2cb-f2e0162f39a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:39.950189 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a89989-8df6-408e-b2cb-f2e0162f39a3 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:39.979444 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 976/1946] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:39 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:39.983632 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41bcc2-9da9-45f1-89b0-332742e3ca31 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:40.000821 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41bcc2-9da9-45f1-89b0-332742e3ca31 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:40.010638 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9814cbd-7768-4d47-9a81-5518df6bb72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:40.023148 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9814cbd-7768-4d47-9a81-5518df6bb72a admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:40.023536 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9814cbd-7768-4d47-9a81-5518df6bb72a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:40.023829 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9814cbd-7768-4d47-9a81-5518df6bb72a admin admin] PATH_INFO: `/v3/projects/c6e1169cb36d4ae4ba0b43be7cd0f5b0/users/b69a1392996542a699aa5684269bc2f8/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:40.061711 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9814cbd-7768-4d47-9a81-5518df6bb72a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e1169cb36d4ae4ba0b43be7cd0f5b0, user_id=b69a1392996542a699aa5684269bc2f8, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:40.064432 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9814cbd-7768-4d47-9a81-5518df6bb72a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:40.109949 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 971/1947] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:39 2021] PUT /identity/v3/projects/c6e1169cb36d4ae4ba0b43be7cd0f5b0/users/b69a1392996542a699aa5684269bc2f8/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:40.112652 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2635c7-c967-470a-9755-e6c8e1c86935 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:40.113200 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2635c7-c967-470a-9755-e6c8e1c86935 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:40.113641 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2635c7-c967-470a-9755-e6c8e1c86935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:40.165453 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-ef2635c7-c967-470a-9755-e6c8e1c86935 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:40.167564 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-ef2635c7-c967-470a-9755-e6c8e1c86935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:40.264512 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 977/1948] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:40.274613 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9814cbd-7768-4d47-9a81-5518df6bb72a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:40.276433 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-a9814cbd-7768-4d47-9a81-5518df6bb72a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:40.389179 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9814cbd-7768-4d47-9a81-5518df6bb72a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:40.397298 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e882f-b5d3-4931-90c5-6c42e9408121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:40.398010 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e882f-b5d3-4931-90c5-6c42e9408121 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:40.398603 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e882f-b5d3-4931-90c5-6c42e9408121 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:40.398890 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e882f-b5d3-4931-90c5-6c42e9408121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:40.427771 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e882f-b5d3-4931-90c5-6c42e9408121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:40.429193 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e882f-b5d3-4931-90c5-6c42e9408121 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:40.441404 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 972/1949] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:41.499543 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156e9db-42ff-47af-80d7-68b47136dc12 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:41.502559 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156e9db-42ff-47af-80d7-68b47136dc12 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:41.503276 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156e9db-42ff-47af-80d7-68b47136dc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:41.571305 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-5156e9db-42ff-47af-80d7-68b47136dc12 None None] MFA Rules not processed for user `b69a1392996542a699aa5684269bc2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:41.572787 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-5156e9db-42ff-47af-80d7-68b47136dc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:41.741664 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 978/1950] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:41 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:41.744841 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e882f-b5d3-4931-90c5-6c42e9408121 service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:41.747175 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-d30e882f-b5d3-4931-90c5-6c42e9408121 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:41.927893 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e882f-b5d3-4931-90c5-6c42e9408121 service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:41.959828 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc01b9-dca1-4df1-9a4d-e51304181ce2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:41.960563 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc01b9-dca1-4df1-9a4d-e51304181ce2 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:41.960856 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc01b9-dca1-4df1-9a4d-e51304181ce2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:41.961143 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc01b9-dca1-4df1-9a4d-e51304181ce2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:41.989172 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc01b9-dca1-4df1-9a4d-e51304181ce2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:41.991306 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc01b9-dca1-4df1-9a4d-e51304181ce2 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:42.020461 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 973/1951] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:41 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:33:43.386865 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156e9db-42ff-47af-80d7-68b47136dc12 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:43.388343 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-5156e9db-42ff-47af-80d7-68b47136dc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:43.413876 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156e9db-42ff-47af-80d7-68b47136dc12 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:43.422636 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945ce4c-8245-41a8-b35a-868b4c31b661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:43.427881 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945ce4c-8245-41a8-b35a-868b4c31b661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:43.428364 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945ce4c-8245-41a8-b35a-868b4c31b661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:43.428839 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945ce4c-8245-41a8-b35a-868b4c31b661 admin admin] PATH_INFO: `/v3/users/e7bdbbbf823e44c5ada267e4fa89284f` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:43.432349 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945ce4c-8245-41a8-b35a-868b4c31b661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7bdbbbf823e44c5ada267e4fa89284f)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:43.438518 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945ce4c-8245-41a8-b35a-868b4c31b661 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:43.532089 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-d945ce4c-8245-41a8-b35a-868b4c31b661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7bdbbbf823e44c5ada267e4fa89284f'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:43.546605 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-d945ce4c-8245-41a8-b35a-868b4c31b661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7bdbbbf823e44c5ada267e4fa89284f'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:43.561818 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-d945ce4c-8245-41a8-b35a-868b4c31b661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7bdbbbf823e44c5ada267e4fa89284f'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:43.562852 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-d945ce4c-8245-41a8-b35a-868b4c31b661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7bdbbbf823e44c5ada267e4fa89284f'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:43.568142 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63c313-6537-4706-8dcc-239a4f2615ab None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:43.568984 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63c313-6537-4706-8dcc-239a4f2615ab None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:43.569416 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63c313-6537-4706-8dcc-239a4f2615ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:43.583353 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-d945ce4c-8245-41a8-b35a-868b4c31b661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7bdbbbf823e44c5ada267e4fa89284f'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:43.590637 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 979/1952] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:33:43 2021] DELETE /identity/v3/users/e7bdbbbf823e44c5ada267e4fa89284f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:33:43.597217 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-dc63c313-6537-4706-8dcc-239a4f2615ab None None] MFA Rules not processed for user `b69a1392996542a699aa5684269bc2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:43.599595 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-dc63c313-6537-4706-8dcc-239a4f2615ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:43.685225 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 974/1953] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:43 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:43.933163 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945ce4c-8245-41a8-b35a-868b4c31b661 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:43.934309 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-d945ce4c-8245-41a8-b35a-868b4c31b661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:44.035470 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945ce4c-8245-41a8-b35a-868b4c31b661 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:44.040422 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8869f0-5d73-4691-9326-0e1e7a3de01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:44.041460 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8869f0-5d73-4691-9326-0e1e7a3de01d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:44.041874 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8869f0-5d73-4691-9326-0e1e7a3de01d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:44.042254 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8869f0-5d73-4691-9326-0e1e7a3de01d admin admin] PATH_INFO: `/v3/users/6054e5489a13425f98119f371e0e324b` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:44.043638 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8869f0-5d73-4691-9326-0e1e7a3de01d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6054e5489a13425f98119f371e0e324b)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:44.045913 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8869f0-5d73-4691-9326-0e1e7a3de01d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:44.106014 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-ca8869f0-5d73-4691-9326-0e1e7a3de01d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6054e5489a13425f98119f371e0e324b'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:44.114553 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-ca8869f0-5d73-4691-9326-0e1e7a3de01d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6054e5489a13425f98119f371e0e324b'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:44.124885 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-ca8869f0-5d73-4691-9326-0e1e7a3de01d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6054e5489a13425f98119f371e0e324b'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:44.126144 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-ca8869f0-5d73-4691-9326-0e1e7a3de01d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6054e5489a13425f98119f371e0e324b'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:44.141562 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-ca8869f0-5d73-4691-9326-0e1e7a3de01d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6054e5489a13425f98119f371e0e324b'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:44.155393 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 980/1954] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:33:43 2021] DELETE /identity/v3/users/6054e5489a13425f98119f371e0e324b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:44.157383 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8cbd99-9997-4450-91b2-e657d30ff6e0 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:44.158560 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8cbd99-9997-4450-91b2-e657d30ff6e0 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:44.158994 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8cbd99-9997-4450-91b2-e657d30ff6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:44.184151 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-0e8cbd99-9997-4450-91b2-e657d30ff6e0 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:44.185594 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-0e8cbd99-9997-4450-91b2-e657d30ff6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:44.258614 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 975/1955] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:44.269012 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8869f0-5d73-4691-9326-0e1e7a3de01d admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:44.272360 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-ca8869f0-5d73-4691-9326-0e1e7a3de01d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:44.296570 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8cbd99-9997-4450-91b2-e657d30ff6e0 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:44.298015 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-0e8cbd99-9997-4450-91b2-e657d30ff6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:44.314583 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8cbd99-9997-4450-91b2-e657d30ff6e0 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:44.329248 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170803e-09af-4ee6-939f-848598740517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:44.330672 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170803e-09af-4ee6-939f-848598740517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:44.330950 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170803e-09af-4ee6-939f-848598740517 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:44.331223 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170803e-09af-4ee6-939f-848598740517 admin admin] PATH_INFO: `/v3/projects/d0adcfae956746948ce8bf01fa185a4a` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:44.339195 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170803e-09af-4ee6-939f-848598740517 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0adcfae956746948ce8bf01fa185a4a)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:44.341214 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170803e-09af-4ee6-939f-848598740517 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:44.373568 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8869f0-5d73-4691-9326-0e1e7a3de01d admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:44.383431 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad0b3c-458b-485e-bb29-cbc61760dd91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:44.384559 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad0b3c-458b-485e-bb29-cbc61760dd91 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:44.384847 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad0b3c-458b-485e-bb29-cbc61760dd91 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:44.385131 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad0b3c-458b-485e-bb29-cbc61760dd91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:44.399186 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad0b3c-458b-485e-bb29-cbc61760dd91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:44.401439 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad0b3c-458b-485e-bb29-cbc61760dd91 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:44.416743 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 981/1956] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:44.430831 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-8170803e-09af-4ee6-939f-848598740517 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0adcfae956746948ce8bf01fa185a4a', 'request_id': 'req-8170803e-09af-4ee6-939f-848598740517'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:44.445729 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-8170803e-09af-4ee6-939f-848598740517 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0adcfae956746948ce8bf01fa185a4a', 'request_id': 'req-8170803e-09af-4ee6-939f-848598740517'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:44.460606 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-8170803e-09af-4ee6-939f-848598740517 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0adcfae956746948ce8bf01fa185a4a', 'request_id': 'req-8170803e-09af-4ee6-939f-848598740517'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:44.478609 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-8170803e-09af-4ee6-939f-848598740517 admin admin] The token cache is being invalidate because project d0adcfae956746948ce8bf01fa185a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:44.479507 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-8170803e-09af-4ee6-939f-848598740517 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:44.480827 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-8170803e-09af-4ee6-939f-848598740517 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:44.483229 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 976/1957] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:33:44 2021] DELETE /identity/v3/projects/d0adcfae956746948ce8bf01fa185a4a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:44.488921 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dd3bd-fd93-4b69-bdf9-a5d5d898379d None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:44.489209 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dd3bd-fd93-4b69-bdf9-a5d5d898379d None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:44.489509 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dd3bd-fd93-4b69-bdf9-a5d5d898379d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:44.518980 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-0c4dd3bd-fd93-4b69-bdf9-a5d5d898379d None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:44.525238 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-0c4dd3bd-fd93-4b69-bdf9-a5d5d898379d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:44.627768 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2486f4-69e1-45f8-8f62-e4772dfbad42 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:44.628231 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2486f4-69e1-45f8-8f62-e4772dfbad42 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:44.628416 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2486f4-69e1-45f8-8f62-e4772dfbad42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:44.630459 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 982/1958] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:44.703479 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-6a2486f4-69e1-45f8-8f62-e4772dfbad42 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:44.705522 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-6a2486f4-69e1-45f8-8f62-e4772dfbad42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:44.735451 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 977/1959] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:33:44.737612 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dd3bd-fd93-4b69-bdf9-a5d5d898379d None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:44.753878 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dd3bd-fd93-4b69-bdf9-a5d5d898379d None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:44.768510 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb0180-87c4-4763-9efc-787534afefe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:44.769396 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb0180-87c4-4763-9efc-787534afefe9 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:44.769705 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb0180-87c4-4763-9efc-787534afefe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:44.769981 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb0180-87c4-4763-9efc-787534afefe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:44.770722 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb0180-87c4-4763-9efc-787534afefe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:33:44.771030 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb0180-87c4-4763-9efc-787534afefe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:44.772647 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb0180-87c4-4763-9efc-787534afefe9 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:44.820321 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 983/1960] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:33:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:33:44.824363 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2486f4-69e1-45f8-8f62-e4772dfbad42 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:44.835624 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2486f4-69e1-45f8-8f62-e4772dfbad42 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:44.840628 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb7411-1373-422d-a638-118bd6b4ba60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:44.841541 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb7411-1373-422d-a638-118bd6b4ba60 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:44.842318 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb7411-1373-422d-a638-118bd6b4ba60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:44.842744 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb7411-1373-422d-a638-118bd6b4ba60 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:44.843747 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb7411-1373-422d-a638-118bd6b4ba60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:44.846493 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb7411-1373-422d-a638-118bd6b4ba60 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:44.894995 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 978/1961] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:33:44 2021] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:44.895981 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb0180-87c4-4763-9efc-787534afefe9 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:44.911097 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb0180-87c4-4763-9efc-787534afefe9 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:44.946029 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb7411-1373-422d-a638-118bd6b4ba60 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:44.949952 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-5dcb7411-1373-422d-a638-118bd6b4ba60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:45.012028 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef67b3-7d43-409b-8456-5c0142550fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:45.013660 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef67b3-7d43-409b-8456-5c0142550fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:45.013954 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef67b3-7d43-409b-8456-5c0142550fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:45.014262 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef67b3-7d43-409b-8456-5c0142550fe1 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:45.015010 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef67b3-7d43-409b-8456-5c0142550fe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:45.017639 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef67b3-7d43-409b-8456-5c0142550fe1 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:45.058369 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 984/1962] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:33:44 2021] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:33:45.060306 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c52cd-26a9-48e4-8ee2-f48e8a81e662 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:45.061621 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c52cd-26a9-48e4-8ee2-f48e8a81e662 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:45.062720 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c52cd-26a9-48e4-8ee2-f48e8a81e662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:45.094007 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-0c5c52cd-26a9-48e4-8ee2-f48e8a81e662 None None] MFA Rules not processed for user `01c75b4e3d114e99831a6b1599bf1e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:45.095572 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-0c5c52cd-26a9-48e4-8ee2-f48e8a81e662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:45.111472 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb7411-1373-422d-a638-118bd6b4ba60 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:45.117819 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815d002-b670-4950-aa65-97bc74b485bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:45.119291 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815d002-b670-4950-aa65-97bc74b485bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:45.119652 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815d002-b670-4950-aa65-97bc74b485bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:45.120077 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815d002-b670-4950-aa65-97bc74b485bf admin admin] PATH_INFO: `/v3/projects/b5b177e5cb9f4fc8a0986c229875dfce` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:45.121440 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815d002-b670-4950-aa65-97bc74b485bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5b177e5cb9f4fc8a0986c229875dfce)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:45.125819 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815d002-b670-4950-aa65-97bc74b485bf admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:45.210450 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 985/1963] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:45 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:45.210450 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c52cd-26a9-48e4-8ee2-f48e8a81e662 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:45.227203 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-1815d002-b670-4950-aa65-97bc74b485bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5b177e5cb9f4fc8a0986c229875dfce', 'request_id': 'req-1815d002-b670-4950-aa65-97bc74b485bf'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:45.243256 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-1815d002-b670-4950-aa65-97bc74b485bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5b177e5cb9f4fc8a0986c229875dfce', 'request_id': 'req-1815d002-b670-4950-aa65-97bc74b485bf'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:45.243745 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c52cd-26a9-48e4-8ee2-f48e8a81e662 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:45.257889 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-1815d002-b670-4950-aa65-97bc74b485bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5b177e5cb9f4fc8a0986c229875dfce', 'request_id': 'req-1815d002-b670-4950-aa65-97bc74b485bf'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:45.279525 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-1815d002-b670-4950-aa65-97bc74b485bf admin admin] The token cache is being invalidate because project b5b177e5cb9f4fc8a0986c229875dfce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:45.280302 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-1815d002-b670-4950-aa65-97bc74b485bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:45.281040 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-1815d002-b670-4950-aa65-97bc74b485bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:45.285537 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 979/1964] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:33:44 2021] DELETE /identity/v3/projects/b5b177e5cb9f4fc8a0986c229875dfce => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:33:45.285537 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815d002-b670-4950-aa65-97bc74b485bf admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:45.287057 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-1815d002-b670-4950-aa65-97bc74b485bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:45.341737 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352dd8d-46f2-4e1f-955b-fd167eb1bf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:45.342710 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352dd8d-46f2-4e1f-955b-fd167eb1bf34 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:45.343008 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352dd8d-46f2-4e1f-955b-fd167eb1bf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:45.343290 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352dd8d-46f2-4e1f-955b-fd167eb1bf34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:45.344051 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352dd8d-46f2-4e1f-955b-fd167eb1bf34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:45.346263 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352dd8d-46f2-4e1f-955b-fd167eb1bf34 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:45.361626 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 986/1965] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:45 2021] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:45.361626 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352dd8d-46f2-4e1f-955b-fd167eb1bf34 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:45.361882 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815d002-b670-4950-aa65-97bc74b485bf admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:45.363702 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-a352dd8d-46f2-4e1f-955b-fd167eb1bf34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:45.365819 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf53323-63f7-49d5-8819-527164f14f64 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32003a40693246d08640bc7ec45adfc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:45.367559 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf53323-63f7-49d5-8819-527164f14f64 service glance] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:45.368126 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf53323-63f7-49d5-8819-527164f14f64 service glance] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:45.368486 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf53323-63f7-49d5-8819-527164f14f64 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:45.370377 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-2cf53323-63f7-49d5-8819-527164f14f64 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:45.385668 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352dd8d-46f2-4e1f-955b-fd167eb1bf34 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:45.391733 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25984b-e9d6-4742-bf56-b29bec5221c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:45.392688 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25984b-e9d6-4742-bf56-b29bec5221c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:45.392977 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25984b-e9d6-4742-bf56-b29bec5221c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:45.393260 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25984b-e9d6-4742-bf56-b29bec5221c7 admin admin] PATH_INFO: `/v3/users/a195102cd9954f6cbd1da47939363557` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:45.394740 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25984b-e9d6-4742-bf56-b29bec5221c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a195102cd9954f6cbd1da47939363557)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:45.396541 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25984b-e9d6-4742-bf56-b29bec5221c7 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:45.476116 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf53323-63f7-49d5-8819-527164f14f64 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:45.476335 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-1e25984b-e9d6-4742-bf56-b29bec5221c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a195102cd9954f6cbd1da47939363557'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:45.477911 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf53323-63f7-49d5-8819-527164f14f64 service glance] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:45.488267 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 980/1966] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:45 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:45.489284 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf53323-63f7-49d5-8819-527164f14f64 service glance] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:45.491322 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-2cf53323-63f7-49d5-8819-527164f14f64 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:45.495584 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-1e25984b-e9d6-4742-bf56-b29bec5221c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a195102cd9954f6cbd1da47939363557'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:45.507305 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf53323-63f7-49d5-8819-527164f14f64 service glance] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:45.509039 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-1e25984b-e9d6-4742-bf56-b29bec5221c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a195102cd9954f6cbd1da47939363557'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:45.510303 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-1e25984b-e9d6-4742-bf56-b29bec5221c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a195102cd9954f6cbd1da47939363557'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:45.512238 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0638ee-f5bb-4fc2-bb53-11d26aa56533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:45.512999 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0638ee-f5bb-4fc2-bb53-11d26aa56533 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:45.513283 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0638ee-f5bb-4fc2-bb53-11d26aa56533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:45.513592 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0638ee-f5bb-4fc2-bb53-11d26aa56533 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:45.514625 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0638ee-f5bb-4fc2-bb53-11d26aa56533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:45.516265 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0638ee-f5bb-4fc2-bb53-11d26aa56533 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:45.525549 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-1e25984b-e9d6-4742-bf56-b29bec5221c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a195102cd9954f6cbd1da47939363557'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:45.536459 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 981/1967] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:45 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:45.537402 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0638ee-f5bb-4fc2-bb53-11d26aa56533 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:45.538557 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 987/1968] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:33:45 2021] DELETE /identity/v3/users/a195102cd9954f6cbd1da47939363557 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:45.539393 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-1b0638ee-f5bb-4fc2-bb53-11d26aa56533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:45.567737 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0638ee-f5bb-4fc2-bb53-11d26aa56533 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:45.681584 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32cb24-ffe7-4cd8-b5eb-93459998e8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:45.682716 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32cb24-ffe7-4cd8-b5eb-93459998e8b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:45.683002 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32cb24-ffe7-4cd8-b5eb-93459998e8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:45.683406 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32cb24-ffe7-4cd8-b5eb-93459998e8b6 admin admin] PATH_INFO: `/v3/projects/f6904b3eb023499d8a4dcd7fb06e31d1/users/6293ca1c5425498ea337c32c0af4e1b0/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:45.744229 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32cb24-ffe7-4cd8-b5eb-93459998e8b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6904b3eb023499d8a4dcd7fb06e31d1, user_id=6293ca1c5425498ea337c32c0af4e1b0, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:45.754127 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32cb24-ffe7-4cd8-b5eb-93459998e8b6 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:45.767440 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2fd9f-db86-40f4-86b7-42f9c0aefaa2 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:45.767784 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2fd9f-db86-40f4-86b7-42f9c0aefaa2 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:45.768274 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2fd9f-db86-40f4-86b7-42f9c0aefaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:45.783349 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 982/1969] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:45 2021] PUT /identity/v3/projects/f6904b3eb023499d8a4dcd7fb06e31d1/users/6293ca1c5425498ea337c32c0af4e1b0/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:45.810891 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-6ad2fd9f-db86-40f4-86b7-42f9c0aefaa2 None None] MFA Rules not processed for user `56895529b11b4236bccb5956a8ccb5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:45.816476 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-6ad2fd9f-db86-40f4-86b7-42f9c0aefaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:45.857075 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1449e-4c99-4e30-b74e-eb47639049c9 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:45.857425 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1449e-4c99-4e30-b74e-eb47639049c9 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:45.857876 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1449e-4c99-4e30-b74e-eb47639049c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:45.916628 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 988/1970] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Oct 27 01:33:45 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:33:45.932449 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2fd9f-db86-40f4-86b7-42f9c0aefaa2 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:45.934234 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-6ad2fd9f-db86-40f4-86b7-42f9c0aefaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:45.934533 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-b7d1449e-4c99-4e30-b74e-eb47639049c9 None None] MFA Rules not processed for user `6293ca1c5425498ea337c32c0af4e1b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:45.935786 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-b7d1449e-4c99-4e30-b74e-eb47639049c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:46.053451 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 983/1971] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:45 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:46.070564 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2fd9f-db86-40f4-86b7-42f9c0aefaa2 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:46.076923 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239cc80-1748-4727-8f1d-8dab0b6507f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f386f358fdb241f5a529a2cf3d839201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:46.077929 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239cc80-1748-4727-8f1d-8dab0b6507f2 service swift] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:46.078424 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239cc80-1748-4727-8f1d-8dab0b6507f2 service swift] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:46.078928 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239cc80-1748-4727-8f1d-8dab0b6507f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:46.088091 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239cc80-1748-4727-8f1d-8dab0b6507f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:46.090010 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239cc80-1748-4727-8f1d-8dab0b6507f2 service swift] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:46.101875 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 989/1972] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Oct 27 01:33:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:33:46.114904 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1449e-4c99-4e30-b74e-eb47639049c9 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:46.122421 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-b7d1449e-4c99-4e30-b74e-eb47639049c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:46.218518 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239cc80-1748-4727-8f1d-8dab0b6507f2 service swift] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:46.221766 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-0239cc80-1748-4727-8f1d-8dab0b6507f2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:46.295009 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1449e-4c99-4e30-b74e-eb47639049c9 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:46.309304 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb8aab-d6ea-43cc-ba72-119df29c35e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:46.310104 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb8aab-d6ea-43cc-ba72-119df29c35e5 service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:46.310909 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb8aab-d6ea-43cc-ba72-119df29c35e5 service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:46.311260 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb8aab-d6ea-43cc-ba72-119df29c35e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:46.331770 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb8aab-d6ea-43cc-ba72-119df29c35e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:46.333458 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb8aab-d6ea-43cc-ba72-119df29c35e5 service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:46.349683 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239cc80-1748-4727-8f1d-8dab0b6507f2 service swift] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:46.361411 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fd179-fa5c-41d7-ad8e-57ef4f138b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:46.362354 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 984/1973] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:46 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:46.363409 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fd179-fa5c-41d7-ad8e-57ef4f138b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:46.363896 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fd179-fa5c-41d7-ad8e-57ef4f138b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:46.364366 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fd179-fa5c-41d7-ad8e-57ef4f138b5b admin admin] PATH_INFO: `/v3/projects/1585464424d74542a3825d8bdccb08b3` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:46.365888 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471fd179-fa5c-41d7-ad8e-57ef4f138b5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1585464424d74542a3825d8bdccb08b3)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:46.368236 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471fd179-fa5c-41d7-ad8e-57ef4f138b5b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:46.430391 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-471fd179-fa5c-41d7-ad8e-57ef4f138b5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1585464424d74542a3825d8bdccb08b3', 'request_id': 'req-471fd179-fa5c-41d7-ad8e-57ef4f138b5b'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:46.436329 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-471fd179-fa5c-41d7-ad8e-57ef4f138b5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1585464424d74542a3825d8bdccb08b3', 'request_id': 'req-471fd179-fa5c-41d7-ad8e-57ef4f138b5b'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:46.450743 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-471fd179-fa5c-41d7-ad8e-57ef4f138b5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1585464424d74542a3825d8bdccb08b3', 'request_id': 'req-471fd179-fa5c-41d7-ad8e-57ef4f138b5b'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:46.484040 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-471fd179-fa5c-41d7-ad8e-57ef4f138b5b admin admin] The token cache is being invalidate because project 1585464424d74542a3825d8bdccb08b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:46.484710 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-471fd179-fa5c-41d7-ad8e-57ef4f138b5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:46.493745 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-471fd179-fa5c-41d7-ad8e-57ef4f138b5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:46.497816 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 990/1974] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:33:46 2021] DELETE /identity/v3/projects/1585464424d74542a3825d8bdccb08b3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:46.504472 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991c4a4-d230-477f-9e0f-7fccb6cec35d None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:46.504472 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991c4a4-d230-477f-9e0f-7fccb6cec35d None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:46.504962 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991c4a4-d230-477f-9e0f-7fccb6cec35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:46.547407 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-a991c4a4-d230-477f-9e0f-7fccb6cec35d None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:46.549957 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-a991c4a4-d230-477f-9e0f-7fccb6cec35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:46.857526 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 985/1975] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:46.862876 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113e878-8952-41c4-8528-a25744568208 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:46.863877 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113e878-8952-41c4-8528-a25744568208 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:46.867719 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113e878-8952-41c4-8528-a25744568208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:46.891609 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-b113e878-8952-41c4-8528-a25744568208 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:46.893031 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-b113e878-8952-41c4-8528-a25744568208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:46.905122 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 991/1976] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:46.906180 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991c4a4-d230-477f-9e0f-7fccb6cec35d None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:46.939463 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991c4a4-d230-477f-9e0f-7fccb6cec35d None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:46.950241 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0855b46-7bd0-4ced-958b-50e918d9f3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:46.957029 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0855b46-7bd0-4ced-958b-50e918d9f3dc admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:46.957282 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0855b46-7bd0-4ced-958b-50e918d9f3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:46.957647 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0855b46-7bd0-4ced-958b-50e918d9f3dc admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:46.958500 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0855b46-7bd0-4ced-958b-50e918d9f3dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:33:46.958780 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0855b46-7bd0-4ced-958b-50e918d9f3dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:46.960666 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0855b46-7bd0-4ced-958b-50e918d9f3dc admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:46.995667 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 986/1977] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:33:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:33:47.000379 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113e878-8952-41c4-8528-a25744568208 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:47.013262 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113e878-8952-41c4-8528-a25744568208 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:47.027948 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32011d4-7d87-40fb-9763-cf5892266264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:47.028847 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32011d4-7d87-40fb-9763-cf5892266264 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:47.029609 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32011d4-7d87-40fb-9763-cf5892266264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:47.029996 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32011d4-7d87-40fb-9763-cf5892266264 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:47.030908 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32011d4-7d87-40fb-9763-cf5892266264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:47.033694 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32011d4-7d87-40fb-9763-cf5892266264 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:47.092164 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 992/1978] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:33:46 2021] POST /identity/v3/projects => generated 407 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:33:47.095977 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0855b46-7bd0-4ced-958b-50e918d9f3dc admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:47.128270 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0855b46-7bd0-4ced-958b-50e918d9f3dc admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:47.249271 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5a7ca-8036-42cf-a192-e5306bb8f1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:47.249998 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5a7ca-8036-42cf-a192-e5306bb8f1dc admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:47.250285 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5a7ca-8036-42cf-a192-e5306bb8f1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:47.250565 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5a7ca-8036-42cf-a192-e5306bb8f1dc admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:47.252145 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5a7ca-8036-42cf-a192-e5306bb8f1dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:47.254412 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5a7ca-8036-42cf-a192-e5306bb8f1dc admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:47.294797 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 987/1979] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:33:47 2021] POST /identity/v3/users => generated 304 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:33:47.299242 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32011d4-7d87-40fb-9763-cf5892266264 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:47.333625 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32011d4-7d87-40fb-9763-cf5892266264 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:47.341682 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854620b-237e-40a9-b6d4-0e2fd4202bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:47.342791 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854620b-237e-40a9-b6d4-0e2fd4202bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:47.343299 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854620b-237e-40a9-b6d4-0e2fd4202bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:47.343982 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854620b-237e-40a9-b6d4-0e2fd4202bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:47.346008 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854620b-237e-40a9-b6d4-0e2fd4202bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:47.349403 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854620b-237e-40a9-b6d4-0e2fd4202bd1 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:47.364698 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 993/1980] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:47 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:33:47.369138 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5a7ca-8036-42cf-a192-e5306bb8f1dc admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:47.383897 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5a7ca-8036-42cf-a192-e5306bb8f1dc admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:47.396324 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b07de-bf18-499e-8a11-beeb087b85b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:47.398038 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b07de-bf18-499e-8a11-beeb087b85b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:47.398738 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b07de-bf18-499e-8a11-beeb087b85b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:47.400298 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b07de-bf18-499e-8a11-beeb087b85b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:47.402091 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b07de-bf18-499e-8a11-beeb087b85b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:47.405601 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b07de-bf18-499e-8a11-beeb087b85b2 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:47.422483 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 988/1981] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:47 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:47.427776 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854620b-237e-40a9-b6d4-0e2fd4202bd1 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:47.461214 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854620b-237e-40a9-b6d4-0e2fd4202bd1 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:47.477370 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219ea54-1f57-4b73-9000-6fa82c6c42ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:47.478348 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219ea54-1f57-4b73-9000-6fa82c6c42ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:47.478633 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219ea54-1f57-4b73-9000-6fa82c6c42ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:47.479123 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219ea54-1f57-4b73-9000-6fa82c6c42ff admin admin] PATH_INFO: `/v3/projects/a688c17412dc417fbad832decfd05dd9/users/54b49c73ff714a549e95e52baf79ad99/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:47.512454 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219ea54-1f57-4b73-9000-6fa82c6c42ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=a688c17412dc417fbad832decfd05dd9, user_id=54b49c73ff714a549e95e52baf79ad99, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:47.517440 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219ea54-1f57-4b73-9000-6fa82c6c42ff admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:47.566894 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 994/1982] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:47 2021] PUT /identity/v3/projects/a688c17412dc417fbad832decfd05dd9/users/54b49c73ff714a549e95e52baf79ad99/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:33:47.568814 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d702a0-994b-4a89-9233-38e1ae9a5624 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:47.569215 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d702a0-994b-4a89-9233-38e1ae9a5624 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:47.569366 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d702a0-994b-4a89-9233-38e1ae9a5624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:47.634412 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-00d702a0-994b-4a89-9233-38e1ae9a5624 None None] MFA Rules not processed for user `54b49c73ff714a549e95e52baf79ad99`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:47.635799 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-00d702a0-994b-4a89-9233-38e1ae9a5624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:47.749345 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 989/1983] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:47 2021] POST /identity/v3/auth/tokens => generated 3427 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:47.754708 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219ea54-1f57-4b73-9000-6fa82c6c42ff admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:48.038713 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219ea54-1f57-4b73-9000-6fa82c6c42ff admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:48.050171 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47573f-c14c-445a-a8a5-99b95917a1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:48.050864 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47573f-c14c-445a-a8a5-99b95917a1ff admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:48.051152 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47573f-c14c-445a-a8a5-99b95917a1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:48.051456 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47573f-c14c-445a-a8a5-99b95917a1ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:48.052174 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47573f-c14c-445a-a8a5-99b95917a1ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:48.054199 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47573f-c14c-445a-a8a5-99b95917a1ff admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:48.136110 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 995/1984] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:33:47 2021] POST /identity/v3/projects => generated 407 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:33:48.139944 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d702a0-994b-4a89-9233-38e1ae9a5624 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:48.156648 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d702a0-994b-4a89-9233-38e1ae9a5624 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:48.268761 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353ebef-6eef-41a1-ba92-16d5838e1309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:48.269467 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353ebef-6eef-41a1-ba92-16d5838e1309 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:48.269927 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353ebef-6eef-41a1-ba92-16d5838e1309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:48.270308 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353ebef-6eef-41a1-ba92-16d5838e1309 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:48.271355 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353ebef-6eef-41a1-ba92-16d5838e1309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:48.273513 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353ebef-6eef-41a1-ba92-16d5838e1309 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:48.326002 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 990/1985] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:33:48 2021] POST /identity/v3/users => generated 310 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:33:48.330210 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47573f-c14c-445a-a8a5-99b95917a1ff admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:48.356646 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47573f-c14c-445a-a8a5-99b95917a1ff admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:48.372906 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe836b2-dd15-4206-a930-23544c327437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:48.374016 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe836b2-dd15-4206-a930-23544c327437 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:48.374733 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe836b2-dd15-4206-a930-23544c327437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:48.375974 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe836b2-dd15-4206-a930-23544c327437 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:48.377649 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe836b2-dd15-4206-a930-23544c327437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:48.379578 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe836b2-dd15-4206-a930-23544c327437 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:48.414757 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 996/1986] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:48 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:48.418783 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353ebef-6eef-41a1-ba92-16d5838e1309 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:48.441412 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353ebef-6eef-41a1-ba92-16d5838e1309 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:48.450100 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1197277-f6bf-43f1-9927-fc32d817012a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:48.451300 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1197277-f6bf-43f1-9927-fc32d817012a admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:48.451779 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1197277-f6bf-43f1-9927-fc32d817012a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:48.452174 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1197277-f6bf-43f1-9927-fc32d817012a admin admin] PATH_INFO: `/v3/projects/06b6e128c80e4f46a182961ca4a61458/users/4e517d4b3c654234bc64f80e237fb4f4/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:48.496081 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1197277-f6bf-43f1-9927-fc32d817012a admin admin] RBAC: Authorizing `identity:create_grant(project_id=06b6e128c80e4f46a182961ca4a61458, user_id=4e517d4b3c654234bc64f80e237fb4f4, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:48.537241 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1197277-f6bf-43f1-9927-fc32d817012a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:48.578304 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe836b2-dd15-4206-a930-23544c327437 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:48.595368 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 991/1987] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:48 2021] PUT /identity/v3/projects/06b6e128c80e4f46a182961ca4a61458/users/4e517d4b3c654234bc64f80e237fb4f4/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:48.601921 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe836b2-dd15-4206-a930-23544c327437 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:48.795811 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ccb7b-927b-491e-9d27-07710f1c7993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:48.796505 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ccb7b-927b-491e-9d27-07710f1c7993 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:48.796976 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ccb7b-927b-491e-9d27-07710f1c7993 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:48.797425 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ccb7b-927b-491e-9d27-07710f1c7993 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:48.801148 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ccb7b-927b-491e-9d27-07710f1c7993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:48.803068 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ccb7b-927b-491e-9d27-07710f1c7993 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:48.835616 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 997/1988] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:33:48 2021] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:33:48.840559 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1197277-f6bf-43f1-9927-fc32d817012a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:48.877057 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1197277-f6bf-43f1-9927-fc32d817012a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:48.895695 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e190e9-6429-4341-81dd-24101d72e56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:48.898713 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e190e9-6429-4341-81dd-24101d72e56a admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:48.900818 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e190e9-6429-4341-81dd-24101d72e56a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:48.901325 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e190e9-6429-4341-81dd-24101d72e56a admin admin] PATH_INFO: `/v3/projects/06b6e128c80e4f46a182961ca4a61458/users/4e517d4b3c654234bc64f80e237fb4f4/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:48.911562 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e190e9-6429-4341-81dd-24101d72e56a admin admin] RBAC: Authorizing `identity:create_grant(project_id=06b6e128c80e4f46a182961ca4a61458, user_id=4e517d4b3c654234bc64f80e237fb4f4, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:48.926752 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e190e9-6429-4341-81dd-24101d72e56a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:48.961805 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 992/1989] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:33:48 2021] PUT /identity/v3/projects/06b6e128c80e4f46a182961ca4a61458/users/4e517d4b3c654234bc64f80e237fb4f4/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:48.977504 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80cfeb-3d1a-4769-a722-2e85320ec189 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:48.977799 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80cfeb-3d1a-4769-a722-2e85320ec189 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:48.978082 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80cfeb-3d1a-4769-a722-2e85320ec189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:49.021858 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-fc80cfeb-3d1a-4769-a722-2e85320ec189 None None] MFA Rules not processed for user `4e517d4b3c654234bc64f80e237fb4f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:49.023275 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-fc80cfeb-3d1a-4769-a722-2e85320ec189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:49.168455 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 998/1990] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:48 2021] POST /identity/v3/auth/tokens => generated 3494 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:49.216023 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e190e9-6429-4341-81dd-24101d72e56a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:49.217800 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-e5e190e9-6429-4341-81dd-24101d72e56a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:49.324843 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e190e9-6429-4341-81dd-24101d72e56a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:49.330309 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883a0f3-a59d-481b-b119-71bdea8ece95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:49.331111 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883a0f3-a59d-481b-b119-71bdea8ece95 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:49.331965 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883a0f3-a59d-481b-b119-71bdea8ece95 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:49.332356 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883a0f3-a59d-481b-b119-71bdea8ece95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:49.347308 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883a0f3-a59d-481b-b119-71bdea8ece95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:49.349764 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883a0f3-a59d-481b-b119-71bdea8ece95 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:49.361942 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 993/1991] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:49 2021] GET /identity/v3/auth/tokens => generated 3494 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:49.665137 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80cfeb-3d1a-4769-a722-2e85320ec189 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:49.682401 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80cfeb-3d1a-4769-a722-2e85320ec189 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:49.690153 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b277bb-642f-4098-b4b6-e31d4fde4568 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:49.692035 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b277bb-642f-4098-b4b6-e31d4fde4568 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:49.692532 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b277bb-642f-4098-b4b6-e31d4fde4568 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:49.693293 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b277bb-642f-4098-b4b6-e31d4fde4568 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:49.824788 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b277bb-642f-4098-b4b6-e31d4fde4568 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:49.835376 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b277bb-642f-4098-b4b6-e31d4fde4568 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:49.882619 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 999/1992] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:49 2021] GET /identity/v3/auth/tokens => generated 3427 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:57.700275 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035954de-382d-44b9-a060-abfb5ded338e None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:57.700824 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035954de-382d-44b9-a060-abfb5ded338e None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:57.700824 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035954de-382d-44b9-a060-abfb5ded338e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:57.718693 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-035954de-382d-44b9-a060-abfb5ded338e None None] MFA Rules not processed for user `8a9c3207beb140f58f7967d0b792f5c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:57.720419 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-035954de-382d-44b9-a060-abfb5ded338e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:57.783431 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 994/1993] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:57 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:59.249564 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b277bb-642f-4098-b4b6-e31d4fde4568 service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:59.251111 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-02b277bb-642f-4098-b4b6-e31d4fde4568 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:59.321405 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b277bb-642f-4098-b4b6-e31d4fde4568 service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:59.326093 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e10be5-5dba-4c91-8d2f-7bffac8445ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:59.326991 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e10be5-5dba-4c91-8d2f-7bffac8445ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:59.327267 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e10be5-5dba-4c91-8d2f-7bffac8445ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:59.327544 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e10be5-5dba-4c91-8d2f-7bffac8445ee admin admin] PATH_INFO: `/v3/users/6293ca1c5425498ea337c32c0af4e1b0` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:59.328887 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e10be5-5dba-4c91-8d2f-7bffac8445ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=6293ca1c5425498ea337c32c0af4e1b0)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:59.331425 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e10be5-5dba-4c91-8d2f-7bffac8445ee admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:59.375309 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-49e10be5-5dba-4c91-8d2f-7bffac8445ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6293ca1c5425498ea337c32c0af4e1b0'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:59.382260 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-49e10be5-5dba-4c91-8d2f-7bffac8445ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6293ca1c5425498ea337c32c0af4e1b0'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:59.388925 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-49e10be5-5dba-4c91-8d2f-7bffac8445ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6293ca1c5425498ea337c32c0af4e1b0'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:59.389676 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-49e10be5-5dba-4c91-8d2f-7bffac8445ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6293ca1c5425498ea337c32c0af4e1b0'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:59.401219 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-49e10be5-5dba-4c91-8d2f-7bffac8445ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6293ca1c5425498ea337c32c0af4e1b0'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:59.406861 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1000/1994] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:33:59 2021] DELETE /identity/v3/users/6293ca1c5425498ea337c32c0af4e1b0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:33:59.411995 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d8f59-8cd8-46a5-94ff-65948a44b8f6 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:59.412483 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d8f59-8cd8-46a5-94ff-65948a44b8f6 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:59.412582 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d8f59-8cd8-46a5-94ff-65948a44b8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:59.430546 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-4b1d8f59-8cd8-46a5-94ff-65948a44b8f6 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:59.432015 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4b1d8f59-8cd8-46a5-94ff-65948a44b8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:59.496528 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 995/1995] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:33:59.507259 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e10be5-5dba-4c91-8d2f-7bffac8445ee admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:59.508665 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-49e10be5-5dba-4c91-8d2f-7bffac8445ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:59.580709 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e10be5-5dba-4c91-8d2f-7bffac8445ee admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:59.584717 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4870e96-6788-41ff-921c-e90d27d956d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:59.585589 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4870e96-6788-41ff-921c-e90d27d956d4 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:59.585871 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4870e96-6788-41ff-921c-e90d27d956d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:59.586147 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4870e96-6788-41ff-921c-e90d27d956d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:59.597411 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4870e96-6788-41ff-921c-e90d27d956d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:59.598877 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4870e96-6788-41ff-921c-e90d27d956d4 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:59.600489 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d8f59-8cd8-46a5-94ff-65948a44b8f6 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:59.601968 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4b1d8f59-8cd8-46a5-94ff-65948a44b8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:59.609323 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1001/1996] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:59.614142 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d8f59-8cd8-46a5-94ff-65948a44b8f6 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:59.619452 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647fce7-2b5c-4789-b16b-3ee060b9d853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:59.620341 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647fce7-2b5c-4789-b16b-3ee060b9d853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:59.620620 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647fce7-2b5c-4789-b16b-3ee060b9d853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:59.620891 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647fce7-2b5c-4789-b16b-3ee060b9d853 admin admin] PATH_INFO: `/v3/users/54b49c73ff714a549e95e52baf79ad99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:59.622154 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647fce7-2b5c-4789-b16b-3ee060b9d853 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54b49c73ff714a549e95e52baf79ad99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:59.624072 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647fce7-2b5c-4789-b16b-3ee060b9d853 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:59.693238 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4647fce7-2b5c-4789-b16b-3ee060b9d853 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54b49c73ff714a549e95e52baf79ad99'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:59.700913 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4647fce7-2b5c-4789-b16b-3ee060b9d853 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54b49c73ff714a549e95e52baf79ad99'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:59.702306 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4647fce7-2b5c-4789-b16b-3ee060b9d853 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54b49c73ff714a549e95e52baf79ad99'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:59.729342 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4647fce7-2b5c-4789-b16b-3ee060b9d853 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54b49c73ff714a549e95e52baf79ad99'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:59.738732 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4647fce7-2b5c-4789-b16b-3ee060b9d853 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54b49c73ff714a549e95e52baf79ad99'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:59.744860 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 996/1997] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:33:59 2021] DELETE /identity/v3/users/54b49c73ff714a549e95e52baf79ad99 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:33:59.752331 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623158f-63ca-41fe-8b91-bbd48172b88b None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:59.752689 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623158f-63ca-41fe-8b91-bbd48172b88b None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:59.752907 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623158f-63ca-41fe-8b91-bbd48172b88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:59.774455 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-b623158f-63ca-41fe-8b91-bbd48172b88b None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:33:59.777008 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-b623158f-63ca-41fe-8b91-bbd48172b88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:59.857841 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1002/1998] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:33:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:33:59.869026 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647fce7-2b5c-4789-b16b-3ee060b9d853 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:59.871327 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4647fce7-2b5c-4789-b16b-3ee060b9d853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:59.938217 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647fce7-2b5c-4789-b16b-3ee060b9d853 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:59.946186 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26605b88-9120-4df8-b677-9ae6c0854188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:59.946990 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26605b88-9120-4df8-b677-9ae6c0854188 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:59.947776 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26605b88-9120-4df8-b677-9ae6c0854188 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:59.947776 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26605b88-9120-4df8-b677-9ae6c0854188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:59.967998 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26605b88-9120-4df8-b677-9ae6c0854188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:59.971642 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26605b88-9120-4df8-b677-9ae6c0854188 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:59.984724 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 997/1999] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:33:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:34:00.172106 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf98b0-c4ea-4a6f-8c29-5006e6a3e89a None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:00.173778 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf98b0-c4ea-4a6f-8c29-5006e6a3e89a None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:00.174322 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf98b0-c4ea-4a6f-8c29-5006e6a3e89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:00.199354 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-bbcf98b0-c4ea-4a6f-8c29-5006e6a3e89a None None] MFA Rules not processed for user `56895529b11b4236bccb5956a8ccb5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:00.200877 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-bbcf98b0-c4ea-4a6f-8c29-5006e6a3e89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:00.300730 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1003/2000] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Oct 27 01:34:00 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:00.314111 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26605b88-9120-4df8-b677-9ae6c0854188 service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:00.317970 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-26605b88-9120-4df8-b677-9ae6c0854188 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:00.330579 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf98b0-c4ea-4a6f-8c29-5006e6a3e89a None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:00.335623 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26605b88-9120-4df8-b677-9ae6c0854188 service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:00.342611 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-bbcf98b0-c4ea-4a6f-8c29-5006e6a3e89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:00.347274 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c504758-cd14-465c-ab45-02c03493540c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:00.350356 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c504758-cd14-465c-ab45-02c03493540c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:00.353060 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c504758-cd14-465c-ab45-02c03493540c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:00.353570 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c504758-cd14-465c-ab45-02c03493540c admin admin] PATH_INFO: `/v3/projects/f6904b3eb023499d8a4dcd7fb06e31d1` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:00.356783 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c504758-cd14-465c-ab45-02c03493540c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6904b3eb023499d8a4dcd7fb06e31d1)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:00.359198 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c504758-cd14-465c-ab45-02c03493540c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:00.431631 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-3c504758-cd14-465c-ab45-02c03493540c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6904b3eb023499d8a4dcd7fb06e31d1', 'request_id': 'req-3c504758-cd14-465c-ab45-02c03493540c'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:00.447724 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf98b0-c4ea-4a6f-8c29-5006e6a3e89a None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:00.449212 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-3c504758-cd14-465c-ab45-02c03493540c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6904b3eb023499d8a4dcd7fb06e31d1', 'request_id': 'req-3c504758-cd14-465c-ab45-02c03493540c'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:00.462511 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-3c504758-cd14-465c-ab45-02c03493540c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6904b3eb023499d8a4dcd7fb06e31d1', 'request_id': 'req-3c504758-cd14-465c-ab45-02c03493540c'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:00.482998 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-3c504758-cd14-465c-ab45-02c03493540c admin admin] The token cache is being invalidate because project f6904b3eb023499d8a4dcd7fb06e31d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:34:00.483325 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-3c504758-cd14-465c-ab45-02c03493540c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:00.484127 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-3c504758-cd14-465c-ab45-02c03493540c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:00.486605 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 998/2001] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:34:00 2021] DELETE /identity/v3/projects/f6904b3eb023499d8a4dcd7fb06e31d1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:34:00.490977 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c504758-cd14-465c-ab45-02c03493540c admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:00.490977 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3c504758-cd14-465c-ab45-02c03493540c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:00.554510 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbb8a0-6ee0-43ab-bfb7-7e95a06c94a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f386f358fdb241f5a529a2cf3d839201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:00.555178 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbb8a0-6ee0-43ab-bfb7-7e95a06c94a6 service swift] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:00.555594 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbb8a0-6ee0-43ab-bfb7-7e95a06c94a6 service swift] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:00.555838 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbb8a0-6ee0-43ab-bfb7-7e95a06c94a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:00.558300 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-7fdbb8a0-6ee0-43ab-bfb7-7e95a06c94a6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:00.564996 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c504758-cd14-465c-ab45-02c03493540c admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:00.569863 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d9b08-9b3f-4373-bcd3-4a092809fd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:00.570758 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d9b08-9b3f-4373-bcd3-4a092809fd27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:00.571044 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d9b08-9b3f-4373-bcd3-4a092809fd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:00.571320 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d9b08-9b3f-4373-bcd3-4a092809fd27 admin admin] PATH_INFO: `/v3/projects/a688c17412dc417fbad832decfd05dd9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:00.572522 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d9b08-9b3f-4373-bcd3-4a092809fd27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a688c17412dc417fbad832decfd05dd9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:00.574456 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d9b08-9b3f-4373-bcd3-4a092809fd27 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:00.635176 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4d7d9b08-9b3f-4373-bcd3-4a092809fd27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a688c17412dc417fbad832decfd05dd9', 'request_id': 'req-4d7d9b08-9b3f-4373-bcd3-4a092809fd27'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:00.646077 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4d7d9b08-9b3f-4373-bcd3-4a092809fd27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a688c17412dc417fbad832decfd05dd9', 'request_id': 'req-4d7d9b08-9b3f-4373-bcd3-4a092809fd27'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:00.654963 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4d7d9b08-9b3f-4373-bcd3-4a092809fd27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a688c17412dc417fbad832decfd05dd9', 'request_id': 'req-4d7d9b08-9b3f-4373-bcd3-4a092809fd27'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:00.674297 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4d7d9b08-9b3f-4373-bcd3-4a092809fd27 admin admin] The token cache is being invalidate because project a688c17412dc417fbad832decfd05dd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:34:00.674629 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4d7d9b08-9b3f-4373-bcd3-4a092809fd27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:00.675495 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4d7d9b08-9b3f-4373-bcd3-4a092809fd27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:00.677521 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 999/2002] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:34:00 2021] DELETE /identity/v3/projects/a688c17412dc417fbad832decfd05dd9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:34:00.678892 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1088e-fa4c-4502-94af-c9d17e61136f None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:00.679184 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1088e-fa4c-4502-94af-c9d17e61136f None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:00.679581 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1088e-fa4c-4502-94af-c9d17e61136f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:00.705029 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-89f1088e-fa4c-4502-94af-c9d17e61136f None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:00.706297 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-89f1088e-fa4c-4502-94af-c9d17e61136f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:00.788012 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbb8a0-6ee0-43ab-bfb7-7e95a06c94a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:00.803647 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbb8a0-6ee0-43ab-bfb7-7e95a06c94a6 service swift] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:00.805340 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1000/2003] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:00.812341 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1088e-fa4c-4502-94af-c9d17e61136f None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:00.815128 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-89f1088e-fa4c-4502-94af-c9d17e61136f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:00.825895 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1004/2004] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Oct 27 01:34:00 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:34:00.828039 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30783df-fbcf-472d-8131-acba7b246e22 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:00.828522 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30783df-fbcf-472d-8131-acba7b246e22 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:00.829495 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30783df-fbcf-472d-8131-acba7b246e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:00.850702 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1088e-fa4c-4502-94af-c9d17e61136f None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:00.861712 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-e30783df-fbcf-472d-8131-acba7b246e22 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:00.863181 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ad302-d836-4fe8-8f74-682c97371fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:00.863926 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ad302-d836-4fe8-8f74-682c97371fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:00.864212 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ad302-d836-4fe8-8f74-682c97371fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:00.864457 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-e30783df-fbcf-472d-8131-acba7b246e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:00.864573 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ad302-d836-4fe8-8f74-682c97371fdc admin admin] PATH_INFO: `/v3/users/4e517d4b3c654234bc64f80e237fb4f4` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:00.865928 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ad302-d836-4fe8-8f74-682c97371fdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e517d4b3c654234bc64f80e237fb4f4)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:00.867886 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ad302-d836-4fe8-8f74-682c97371fdc admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:00.876067 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1005/2005] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:00.880079 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30783df-fbcf-472d-8131-acba7b246e22 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:00.893032 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30783df-fbcf-472d-8131-acba7b246e22 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:00.898718 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6f9ac-ca04-4ca9-bf28-3056fd2fa4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:00.899566 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6f9ac-ca04-4ca9-bf28-3056fd2fa4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:00.899772 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6f9ac-ca04-4ca9-bf28-3056fd2fa4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:00.900116 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6f9ac-ca04-4ca9-bf28-3056fd2fa4b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:00.900856 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6f9ac-ca04-4ca9-bf28-3056fd2fa4b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:34:00.901283 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6f9ac-ca04-4ca9-bf28-3056fd2fa4b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:00.903020 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6f9ac-ca04-4ca9-bf28-3056fd2fa4b8 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:00.923497 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1006/2006] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:34:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:34:00.931491 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6f9ac-ca04-4ca9-bf28-3056fd2fa4b8 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:00.956203 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6f9ac-ca04-4ca9-bf28-3056fd2fa4b8 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:00.965920 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-986ad302-d836-4fe8-8f74-682c97371fdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e517d4b3c654234bc64f80e237fb4f4'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:00.970244 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6d949-d8de-4ecb-8a9f-25232e4c9f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:00.971146 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6d949-d8de-4ecb-8a9f-25232e4c9f8e admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:00.972391 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6d949-d8de-4ecb-8a9f-25232e4c9f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:00.972857 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6d949-d8de-4ecb-8a9f-25232e4c9f8e admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:00.973965 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6d949-d8de-4ecb-8a9f-25232e4c9f8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:00.976205 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6d949-d8de-4ecb-8a9f-25232e4c9f8e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:00.978256 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-986ad302-d836-4fe8-8f74-682c97371fdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e517d4b3c654234bc64f80e237fb4f4'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:00.979127 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-986ad302-d836-4fe8-8f74-682c97371fdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e517d4b3c654234bc64f80e237fb4f4'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:01.005328 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-986ad302-d836-4fe8-8f74-682c97371fdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e517d4b3c654234bc64f80e237fb4f4'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:01.021445 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-986ad302-d836-4fe8-8f74-682c97371fdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e517d4b3c654234bc64f80e237fb4f4'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:01.032933 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1007/2007] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:34:00 2021] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:34:01.035760 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1001/2008] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:34:00 2021] DELETE /identity/v3/users/4e517d4b3c654234bc64f80e237fb4f4 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:34:01.038729 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6d949-d8de-4ecb-8a9f-25232e4c9f8e admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:01.038922 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-72e6d949-d8de-4ecb-8a9f-25232e4c9f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:01.182822 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6d949-d8de-4ecb-8a9f-25232e4c9f8e admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:01.361385 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8ae7e-a9b5-4cfb-9d99-9d0536333c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:01.362343 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8ae7e-a9b5-4cfb-9d99-9d0536333c20 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:01.362632 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8ae7e-a9b5-4cfb-9d99-9d0536333c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:01.363665 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8ae7e-a9b5-4cfb-9d99-9d0536333c20 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:01.364532 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8ae7e-a9b5-4cfb-9d99-9d0536333c20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:01.369194 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8ae7e-a9b5-4cfb-9d99-9d0536333c20 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:01.437380 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1008/2009] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:34:01 2021] POST /identity/v3/users => generated 287 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:34:01.442262 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ad302-d836-4fe8-8f74-682c97371fdc admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:01.458750 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ad302-d836-4fe8-8f74-682c97371fdc admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:01.473015 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a28279-c419-4976-8da8-6767d44d97c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:01.473733 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a28279-c419-4976-8da8-6767d44d97c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:01.474023 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a28279-c419-4976-8da8-6767d44d97c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:01.474315 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a28279-c419-4976-8da8-6767d44d97c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:01.475061 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a28279-c419-4976-8da8-6767d44d97c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:01.480165 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a28279-c419-4976-8da8-6767d44d97c2 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:01.504052 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1002/2010] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:34:01 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:34:01.509359 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8ae7e-a9b5-4cfb-9d99-9d0536333c20 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:01.515965 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a28279-c419-4976-8da8-6767d44d97c2 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:01.524184 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-a7a28279-c419-4976-8da8-6767d44d97c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:01.524786 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8ae7e-a9b5-4cfb-9d99-9d0536333c20 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:01.531028 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decd73a-6f2a-4243-8ebb-bcc2ba713fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:01.532177 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decd73a-6f2a-4243-8ebb-bcc2ba713fbb admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:01.532700 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decd73a-6f2a-4243-8ebb-bcc2ba713fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:01.533209 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decd73a-6f2a-4243-8ebb-bcc2ba713fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:01.535098 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4decd73a-6f2a-4243-8ebb-bcc2ba713fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:01.537053 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4decd73a-6f2a-4243-8ebb-bcc2ba713fbb admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:01.547372 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a28279-c419-4976-8da8-6767d44d97c2 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:01.559681 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536e9ce-dd92-4e6e-b43a-c35e0bd9127a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:01.560572 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536e9ce-dd92-4e6e-b43a-c35e0bd9127a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:01.560862 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536e9ce-dd92-4e6e-b43a-c35e0bd9127a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:01.561191 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536e9ce-dd92-4e6e-b43a-c35e0bd9127a admin admin] PATH_INFO: `/v3/projects/06b6e128c80e4f46a182961ca4a61458` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:01.562760 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536e9ce-dd92-4e6e-b43a-c35e0bd9127a admin admin] RBAC: Authorizing `identity:delete_project(project_id=06b6e128c80e4f46a182961ca4a61458)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:01.566089 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536e9ce-dd92-4e6e-b43a-c35e0bd9127a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:01.584017 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1009/2011] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:34:01 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:34:01.585210 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decd73a-6f2a-4243-8ebb-bcc2ba713fbb admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:01.614136 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decd73a-6f2a-4243-8ebb-bcc2ba713fbb admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:01.640454 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b8294-90be-48b8-8feb-42a42a9dc22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:01.642340 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b8294-90be-48b8-8feb-42a42a9dc22b admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:01.643708 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b8294-90be-48b8-8feb-42a42a9dc22b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:01.644124 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b8294-90be-48b8-8feb-42a42a9dc22b admin admin] PATH_INFO: `/v3/projects/9a29c409757d44e8b2ac3da941de3779/users/16711a7bf2bd453394cd980e81215945/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:01.684233 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b8294-90be-48b8-8feb-42a42a9dc22b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a29c409757d44e8b2ac3da941de3779, user_id=16711a7bf2bd453394cd980e81215945, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:01.691359 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-e536e9ce-dd92-4e6e-b43a-c35e0bd9127a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06b6e128c80e4f46a182961ca4a61458', 'request_id': 'req-e536e9ce-dd92-4e6e-b43a-c35e0bd9127a'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:01.692192 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b8294-90be-48b8-8feb-42a42a9dc22b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:01.703492 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-e536e9ce-dd92-4e6e-b43a-c35e0bd9127a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06b6e128c80e4f46a182961ca4a61458', 'request_id': 'req-e536e9ce-dd92-4e6e-b43a-c35e0bd9127a'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:01.717631 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1010/2012] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:34:01 2021] PUT /identity/v3/projects/9a29c409757d44e8b2ac3da941de3779/users/16711a7bf2bd453394cd980e81215945/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:34:01.728827 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-e536e9ce-dd92-4e6e-b43a-c35e0bd9127a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06b6e128c80e4f46a182961ca4a61458', 'request_id': 'req-e536e9ce-dd92-4e6e-b43a-c35e0bd9127a'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:01.731558 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d02803-0e0d-4557-a7a6-46a90f0950c9 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:01.731848 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d02803-0e0d-4557-a7a6-46a90f0950c9 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:01.732126 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d02803-0e0d-4557-a7a6-46a90f0950c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:01.756583 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-e536e9ce-dd92-4e6e-b43a-c35e0bd9127a admin admin] The token cache is being invalidate because project 06b6e128c80e4f46a182961ca4a61458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:34:01.756905 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-e536e9ce-dd92-4e6e-b43a-c35e0bd9127a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:01.760023 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-e536e9ce-dd92-4e6e-b43a-c35e0bd9127a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:01.762989 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1003/2013] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:34:01 2021] DELETE /identity/v3/projects/06b6e128c80e4f46a182961ca4a61458 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:34:01.777186 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77470969-eb58-496f-94ef-11875d68717d None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:01.777842 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77470969-eb58-496f-94ef-11875d68717d None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:01.778346 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77470969-eb58-496f-94ef-11875d68717d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:01.795374 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-67d02803-0e0d-4557-a7a6-46a90f0950c9 None None] MFA Rules not processed for user `16711a7bf2bd453394cd980e81215945`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:01.796625 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-67d02803-0e0d-4557-a7a6-46a90f0950c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:01.820493 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-77470969-eb58-496f-94ef-11875d68717d None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:01.822133 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-77470969-eb58-496f-94ef-11875d68717d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:01.930428 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1011/2014] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:01 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:01.936838 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1004/2015] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:01.945598 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8bb9b-caa9-41b9-a41d-138ec76e463d None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:01.945809 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8bb9b-caa9-41b9-a41d-138ec76e463d None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:01.946092 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8bb9b-caa9-41b9-a41d-138ec76e463d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:02.023985 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-aca8bb9b-caa9-41b9-a41d-138ec76e463d None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:02.025230 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-aca8bb9b-caa9-41b9-a41d-138ec76e463d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:02.066541 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1012/2016] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:02.070509 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77470969-eb58-496f-94ef-11875d68717d None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:02.096507 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77470969-eb58-496f-94ef-11875d68717d None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:02.107761 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28732fbc-1ed6-4078-8b35-c17df0848569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:02.111515 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28732fbc-1ed6-4078-8b35-c17df0848569 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:02.112497 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28732fbc-1ed6-4078-8b35-c17df0848569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:02.113597 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28732fbc-1ed6-4078-8b35-c17df0848569 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:02.122705 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28732fbc-1ed6-4078-8b35-c17df0848569 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:34:02.122705 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28732fbc-1ed6-4078-8b35-c17df0848569 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:02.122705 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28732fbc-1ed6-4078-8b35-c17df0848569 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:02.154732 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1005/2017] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:34:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:34:02.156353 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8bb9b-caa9-41b9-a41d-138ec76e463d None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:02.170021 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8bb9b-caa9-41b9-a41d-138ec76e463d None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:02.181747 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae997d7d-991c-4fd8-aee1-4a0c539a5292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:02.182988 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae997d7d-991c-4fd8-aee1-4a0c539a5292 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:02.183397 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae997d7d-991c-4fd8-aee1-4a0c539a5292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:02.183752 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae997d7d-991c-4fd8-aee1-4a0c539a5292 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:02.187172 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae997d7d-991c-4fd8-aee1-4a0c539a5292 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:02.192050 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae997d7d-991c-4fd8-aee1-4a0c539a5292 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:02.276900 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1013/2018] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:34:02 2021] POST /identity/v3/projects => generated 367 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:34:02.280164 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28732fbc-1ed6-4078-8b35-c17df0848569 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:02.291338 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28732fbc-1ed6-4078-8b35-c17df0848569 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:02.379630 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249acc40-730c-4c5e-a76c-85a15abe1652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:02.379630 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249acc40-730c-4c5e-a76c-85a15abe1652 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:02.379630 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249acc40-730c-4c5e-a76c-85a15abe1652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:02.379630 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249acc40-730c-4c5e-a76c-85a15abe1652 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:02.380030 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249acc40-730c-4c5e-a76c-85a15abe1652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:02.381515 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249acc40-730c-4c5e-a76c-85a15abe1652 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:02.422532 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1006/2019] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:34:02 2021] POST /identity/v3/users => generated 284 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:34:02.425593 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae997d7d-991c-4fd8-aee1-4a0c539a5292 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:02.455319 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae997d7d-991c-4fd8-aee1-4a0c539a5292 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:02.464268 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1145f-1c98-4344-9736-e16d25cae740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:02.465387 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1145f-1c98-4344-9736-e16d25cae740 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:02.465710 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1145f-1c98-4344-9736-e16d25cae740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:02.466143 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1145f-1c98-4344-9736-e16d25cae740 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:02.467080 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c1145f-1c98-4344-9736-e16d25cae740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:02.469339 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c1145f-1c98-4344-9736-e16d25cae740 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:02.491309 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1014/2020] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:34:02 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:34:02.492721 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249acc40-730c-4c5e-a76c-85a15abe1652 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:02.508010 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249acc40-730c-4c5e-a76c-85a15abe1652 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:02.528197 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde2a65-b0a2-416d-a817-6735963099d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:02.530975 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde2a65-b0a2-416d-a817-6735963099d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:02.530975 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde2a65-b0a2-416d-a817-6735963099d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:02.530975 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde2a65-b0a2-416d-a817-6735963099d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:02.534456 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde2a65-b0a2-416d-a817-6735963099d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:02.542725 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde2a65-b0a2-416d-a817-6735963099d3 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:02.572716 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1145f-1c98-4344-9736-e16d25cae740 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:02.573148 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1007/2021] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:34:02 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:34:02.585633 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1145f-1c98-4344-9736-e16d25cae740 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:02.590708 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ceee9-ca65-4b97-b9e4-64a0db29cecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:02.591620 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ceee9-ca65-4b97-b9e4-64a0db29cecd admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:02.591907 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ceee9-ca65-4b97-b9e4-64a0db29cecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:02.592186 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ceee9-ca65-4b97-b9e4-64a0db29cecd admin admin] PATH_INFO: `/v3/projects/64b8db1d4dd94cfbbda22012a2720b65/users/061e53dcac61459ca6cf7899e89791e8/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:02.616732 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ceee9-ca65-4b97-b9e4-64a0db29cecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b8db1d4dd94cfbbda22012a2720b65, user_id=061e53dcac61459ca6cf7899e89791e8, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:02.620024 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ceee9-ca65-4b97-b9e4-64a0db29cecd admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:02.638535 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1015/2022] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:34:02 2021] PUT /identity/v3/projects/64b8db1d4dd94cfbbda22012a2720b65/users/061e53dcac61459ca6cf7899e89791e8/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:34:02.648753 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336b39e-3573-4473-ac41-7276749d109c None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:02.649056 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336b39e-3573-4473-ac41-7276749d109c None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:02.649331 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336b39e-3573-4473-ac41-7276749d109c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:02.683505 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-3336b39e-3573-4473-ac41-7276749d109c None None] MFA Rules not processed for user `061e53dcac61459ca6cf7899e89791e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:02.684985 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3336b39e-3573-4473-ac41-7276749d109c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:02.757346 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1008/2023] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:02 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:08.322835 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ceee9-ca65-4b97-b9e4-64a0db29cecd admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:08.324582 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-214ceee9-ca65-4b97-b9e4-64a0db29cecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:08.380643 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ceee9-ca65-4b97-b9e4-64a0db29cecd admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:08.384447 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9975775-7203-4c2c-9fc6-e1244c8ee0e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32003a40693246d08640bc7ec45adfc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:08.385161 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9975775-7203-4c2c-9fc6-e1244c8ee0e8 service glance] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:08.385505 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9975775-7203-4c2c-9fc6-e1244c8ee0e8 service glance] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:08.385790 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9975775-7203-4c2c-9fc6-e1244c8ee0e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:08.394890 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9975775-7203-4c2c-9fc6-e1244c8ee0e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:08.396299 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9975775-7203-4c2c-9fc6-e1244c8ee0e8 service glance] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:08.405111 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1016/2024] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:34:08 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:34:13.542957 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336b39e-3573-4473-ac41-7276749d109c None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:13.544954 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3336b39e-3573-4473-ac41-7276749d109c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:13.630768 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336b39e-3573-4473-ac41-7276749d109c None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:13.636845 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fcb8a-1922-4eb5-b44d-9e3def812963 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:13.637780 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fcb8a-1922-4eb5-b44d-9e3def812963 service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:13.638069 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fcb8a-1922-4eb5-b44d-9e3def812963 service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:13.638341 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fcb8a-1922-4eb5-b44d-9e3def812963 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:13.701523 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9fcb8a-1922-4eb5-b44d-9e3def812963 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:13.704301 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9fcb8a-1922-4eb5-b44d-9e3def812963 service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:13.714320 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1009/2025] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:34:13 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:34:14.314928 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9975775-7203-4c2c-9fc6-e1244c8ee0e8 service glance] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:14.316380 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-e9975775-7203-4c2c-9fc6-e1244c8ee0e8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:14.382444 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9975775-7203-4c2c-9fc6-e1244c8ee0e8 service glance] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:14.387693 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208d1a6-8e4e-498d-942b-e9c8438c834a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:14.388604 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208d1a6-8e4e-498d-942b-e9c8438c834a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:14.388891 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208d1a6-8e4e-498d-942b-e9c8438c834a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:14.389167 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208d1a6-8e4e-498d-942b-e9c8438c834a admin admin] PATH_INFO: `/v3/users/16711a7bf2bd453394cd980e81215945` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:14.390679 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208d1a6-8e4e-498d-942b-e9c8438c834a admin admin] RBAC: Authorizing `identity:delete_user(user_id=16711a7bf2bd453394cd980e81215945)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:14.392668 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208d1a6-8e4e-498d-942b-e9c8438c834a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:14.437142 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-1208d1a6-8e4e-498d-942b-e9c8438c834a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16711a7bf2bd453394cd980e81215945'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:14.444831 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-1208d1a6-8e4e-498d-942b-e9c8438c834a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16711a7bf2bd453394cd980e81215945'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:14.451887 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-1208d1a6-8e4e-498d-942b-e9c8438c834a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16711a7bf2bd453394cd980e81215945'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:14.452512 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-1208d1a6-8e4e-498d-942b-e9c8438c834a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16711a7bf2bd453394cd980e81215945'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:14.468576 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-1208d1a6-8e4e-498d-942b-e9c8438c834a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16711a7bf2bd453394cd980e81215945'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:14.476562 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1017/2026] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:34:14 2021] DELETE /identity/v3/users/16711a7bf2bd453394cd980e81215945 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:34:14.481152 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2b4cd-52dc-413b-9fca-856122e03222 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:14.481452 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2b4cd-52dc-413b-9fca-856122e03222 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:14.481791 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2b4cd-52dc-413b-9fca-856122e03222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:14.500170 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-04c2b4cd-52dc-413b-9fca-856122e03222 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:14.501361 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-04c2b4cd-52dc-413b-9fca-856122e03222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:14.559180 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1010/2027] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:14.569268 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208d1a6-8e4e-498d-942b-e9c8438c834a admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:14.570757 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-1208d1a6-8e4e-498d-942b-e9c8438c834a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:14.627019 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208d1a6-8e4e-498d-942b-e9c8438c834a admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:14.630703 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32521587-dbed-42a1-9e22-ab8c5b451a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:14.631348 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32521587-dbed-42a1-9e22-ab8c5b451a73 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:14.631630 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32521587-dbed-42a1-9e22-ab8c5b451a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:14.631906 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32521587-dbed-42a1-9e22-ab8c5b451a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:14.640725 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32521587-dbed-42a1-9e22-ab8c5b451a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:14.642478 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32521587-dbed-42a1-9e22-ab8c5b451a73 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:14.653087 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1018/2028] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:34:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:34:15.026046 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2b4cd-52dc-413b-9fca-856122e03222 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:15.028004 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-04c2b4cd-52dc-413b-9fca-856122e03222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:15.051055 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2b4cd-52dc-413b-9fca-856122e03222 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:15.066050 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fad959-983b-4b29-8a4d-e7ef36b79595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:15.066931 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fad959-983b-4b29-8a4d-e7ef36b79595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:15.067212 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fad959-983b-4b29-8a4d-e7ef36b79595 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:15.067487 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fad959-983b-4b29-8a4d-e7ef36b79595 admin admin] PATH_INFO: `/v3/projects/9a29c409757d44e8b2ac3da941de3779` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:15.068699 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fad959-983b-4b29-8a4d-e7ef36b79595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a29c409757d44e8b2ac3da941de3779)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:15.070889 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fad959-983b-4b29-8a4d-e7ef36b79595 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:15.134845 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d8fad959-983b-4b29-8a4d-e7ef36b79595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a29c409757d44e8b2ac3da941de3779', 'request_id': 'req-d8fad959-983b-4b29-8a4d-e7ef36b79595'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:15.147005 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d8fad959-983b-4b29-8a4d-e7ef36b79595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a29c409757d44e8b2ac3da941de3779', 'request_id': 'req-d8fad959-983b-4b29-8a4d-e7ef36b79595'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:15.165211 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d8fad959-983b-4b29-8a4d-e7ef36b79595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a29c409757d44e8b2ac3da941de3779', 'request_id': 'req-d8fad959-983b-4b29-8a4d-e7ef36b79595'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:15.179879 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d8fad959-983b-4b29-8a4d-e7ef36b79595 admin admin] The token cache is being invalidate because project 9a29c409757d44e8b2ac3da941de3779 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:34:15.180177 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d8fad959-983b-4b29-8a4d-e7ef36b79595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:15.181233 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d8fad959-983b-4b29-8a4d-e7ef36b79595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:15.187118 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1011/2029] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:34:15 2021] DELETE /identity/v3/projects/9a29c409757d44e8b2ac3da941de3779 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:34:15.189939 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3bdec-141e-4ed3-a0a6-fb8da769891b None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:15.190229 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3bdec-141e-4ed3-a0a6-fb8da769891b None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:15.190507 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3bdec-141e-4ed3-a0a6-fb8da769891b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:15.208656 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-dae3bdec-141e-4ed3-a0a6-fb8da769891b None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:15.210020 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-dae3bdec-141e-4ed3-a0a6-fb8da769891b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:15.268450 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1019/2030] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:15.276637 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a1d40-ec4a-4909-a7b9-690d8d146559 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:15.276928 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a1d40-ec4a-4909-a7b9-690d8d146559 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:15.277231 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a1d40-ec4a-4909-a7b9-690d8d146559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:15.297005 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-593a1d40-ec4a-4909-a7b9-690d8d146559 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:15.298801 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-593a1d40-ec4a-4909-a7b9-690d8d146559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:15.311088 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1012/2031] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:15.311790 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3bdec-141e-4ed3-a0a6-fb8da769891b None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:15.321810 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3bdec-141e-4ed3-a0a6-fb8da769891b None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:15.326634 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057ffd1-f3d5-4b70-8a61-8bcdf970cee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:15.327310 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057ffd1-f3d5-4b70-8a61-8bcdf970cee5 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:15.327598 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057ffd1-f3d5-4b70-8a61-8bcdf970cee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:15.327882 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057ffd1-f3d5-4b70-8a61-8bcdf970cee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:15.328945 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057ffd1-f3d5-4b70-8a61-8bcdf970cee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:34:15.329231 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057ffd1-f3d5-4b70-8a61-8bcdf970cee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:15.331014 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057ffd1-f3d5-4b70-8a61-8bcdf970cee5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:15.342888 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1020/2032] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:34:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:34:15.347856 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a1d40-ec4a-4909-a7b9-690d8d146559 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:15.356903 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a1d40-ec4a-4909-a7b9-690d8d146559 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:15.362054 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f43b6-05cb-4a20-ab63-aa4281a621e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:15.362707 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f43b6-05cb-4a20-ab63-aa4281a621e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:15.362986 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f43b6-05cb-4a20-ab63-aa4281a621e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:15.363257 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f43b6-05cb-4a20-ab63-aa4281a621e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:15.363943 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f43b6-05cb-4a20-ab63-aa4281a621e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:15.365831 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f43b6-05cb-4a20-ab63-aa4281a621e5 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:15.395577 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1013/2033] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:34:15 2021] POST /identity/v3/projects => generated 355 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:34:15.399433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057ffd1-f3d5-4b70-8a61-8bcdf970cee5 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:15.410215 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057ffd1-f3d5-4b70-8a61-8bcdf970cee5 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:15.475127 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f76224-e561-49f1-8a7b-2f47f8a9bf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:15.475794 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f76224-e561-49f1-8a7b-2f47f8a9bf9f admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:15.476075 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f76224-e561-49f1-8a7b-2f47f8a9bf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:15.476356 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f76224-e561-49f1-8a7b-2f47f8a9bf9f admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:15.477069 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f76224-e561-49f1-8a7b-2f47f8a9bf9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:15.479213 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f76224-e561-49f1-8a7b-2f47f8a9bf9f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:15.499245 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1021/2034] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:34:15 2021] POST /identity/v3/users => generated 278 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:34:15.503356 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f43b6-05cb-4a20-ab63-aa4281a621e5 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:15.513677 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f43b6-05cb-4a20-ab63-aa4281a621e5 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:15.518473 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634e7f2-0e9e-4ad3-a4e4-39c2aed6b05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:15.519141 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634e7f2-0e9e-4ad3-a4e4-39c2aed6b05f admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:15.519430 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634e7f2-0e9e-4ad3-a4e4-39c2aed6b05f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:15.519711 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634e7f2-0e9e-4ad3-a4e4-39c2aed6b05f admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:15.520635 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634e7f2-0e9e-4ad3-a4e4-39c2aed6b05f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:15.522153 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634e7f2-0e9e-4ad3-a4e4-39c2aed6b05f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:15.533518 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1014/2035] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:34:15 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:34:15.537665 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f76224-e561-49f1-8a7b-2f47f8a9bf9f admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:15.547524 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f76224-e561-49f1-8a7b-2f47f8a9bf9f admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:15.552658 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb8322-b3e5-4761-ae03-fd224ccd5644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:15.553421 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb8322-b3e5-4761-ae03-fd224ccd5644 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:15.553819 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb8322-b3e5-4761-ae03-fd224ccd5644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:15.554164 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb8322-b3e5-4761-ae03-fd224ccd5644 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:15.554976 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb8322-b3e5-4761-ae03-fd224ccd5644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:15.556872 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb8322-b3e5-4761-ae03-fd224ccd5644 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:15.568214 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1022/2036] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:34:15 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:34:15.572357 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634e7f2-0e9e-4ad3-a4e4-39c2aed6b05f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:15.582543 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634e7f2-0e9e-4ad3-a4e4-39c2aed6b05f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:15.587830 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae4b0a-91cd-4e1c-8698-b619a57b8022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:15.588807 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae4b0a-91cd-4e1c-8698-b619a57b8022 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:15.589097 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae4b0a-91cd-4e1c-8698-b619a57b8022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:15.589372 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae4b0a-91cd-4e1c-8698-b619a57b8022 admin admin] PATH_INFO: `/v3/projects/4283910da3e54643b6dd7d7d906e6f8a/users/5d8a12b35ae74bb2a3d75c2cd4d9375a/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:15.604658 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae4b0a-91cd-4e1c-8698-b619a57b8022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4283910da3e54643b6dd7d7d906e6f8a, user_id=5d8a12b35ae74bb2a3d75c2cd4d9375a, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:15.607326 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae4b0a-91cd-4e1c-8698-b619a57b8022 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:15.620797 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1015/2037] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:34:15 2021] PUT /identity/v3/projects/4283910da3e54643b6dd7d7d906e6f8a/users/5d8a12b35ae74bb2a3d75c2cd4d9375a/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:34:15.631628 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c7c73-5e44-499b-9e3f-74bd321d21b1 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:15.631941 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c7c73-5e44-499b-9e3f-74bd321d21b1 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:15.632226 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c7c73-5e44-499b-9e3f-74bd321d21b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:15.658684 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-9c3c7c73-5e44-499b-9e3f-74bd321d21b1 None None] MFA Rules not processed for user `5d8a12b35ae74bb2a3d75c2cd4d9375a`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:15.659893 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-9c3c7c73-5e44-499b-9e3f-74bd321d21b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:15.733146 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1023/2038] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:15 2021] POST /identity/v3/auth/tokens => generated 3375 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:15.734274 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae4b0a-91cd-4e1c-8698-b619a57b8022 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:15.795576 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae4b0a-91cd-4e1c-8698-b619a57b8022 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:15.800350 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5e8ae-820b-494b-9ba8-691546231586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:15.801007 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5e8ae-820b-494b-9ba8-691546231586 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:15.801308 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5e8ae-820b-494b-9ba8-691546231586 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:15.801607 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5e8ae-820b-494b-9ba8-691546231586 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:15.802325 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5e8ae-820b-494b-9ba8-691546231586 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:15.804195 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5e8ae-820b-494b-9ba8-691546231586 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:15.829230 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1016/2039] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:34:15 2021] POST /identity/v3/projects => generated 357 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:34:15.833419 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c7c73-5e44-499b-9e3f-74bd321d21b1 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:15.843816 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c7c73-5e44-499b-9e3f-74bd321d21b1 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:15.901815 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58845c83-dac9-4596-bfae-8ce447867046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:15.902625 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58845c83-dac9-4596-bfae-8ce447867046 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:15.902950 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58845c83-dac9-4596-bfae-8ce447867046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:15.903285 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58845c83-dac9-4596-bfae-8ce447867046 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:15.904082 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58845c83-dac9-4596-bfae-8ce447867046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:15.906026 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58845c83-dac9-4596-bfae-8ce447867046 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:15.926055 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1024/2040] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:34:15 2021] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:34:15.930209 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5e8ae-820b-494b-9ba8-691546231586 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:15.941012 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5e8ae-820b-494b-9ba8-691546231586 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:15.945726 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f3ac3-4e1a-423e-86f4-46f95edc88e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:15.946388 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f3ac3-4e1a-423e-86f4-46f95edc88e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:15.946673 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f3ac3-4e1a-423e-86f4-46f95edc88e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:15.946953 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f3ac3-4e1a-423e-86f4-46f95edc88e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:15.947687 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f3ac3-4e1a-423e-86f4-46f95edc88e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:15.949269 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f3ac3-4e1a-423e-86f4-46f95edc88e2 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:15.960436 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1017/2041] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:34:15 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:34:15.964590 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58845c83-dac9-4596-bfae-8ce447867046 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:15.974644 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58845c83-dac9-4596-bfae-8ce447867046 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:15.979279 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d82939-cc21-47f3-8663-511e616dc4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:15.980141 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d82939-cc21-47f3-8663-511e616dc4b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:15.980426 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d82939-cc21-47f3-8663-511e616dc4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:15.980703 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d82939-cc21-47f3-8663-511e616dc4b5 admin admin] PATH_INFO: `/v3/projects/59b0651106f14e7394b9d92a2469986b/users/f687013344bb412fa974831a56920f66/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:15.995400 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d82939-cc21-47f3-8663-511e616dc4b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b0651106f14e7394b9d92a2469986b, user_id=f687013344bb412fa974831a56920f66, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:15.998089 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d82939-cc21-47f3-8663-511e616dc4b5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:16.012386 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1025/2042] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:34:15 2021] PUT /identity/v3/projects/59b0651106f14e7394b9d92a2469986b/users/f687013344bb412fa974831a56920f66/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:34:16.016207 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f3ac3-4e1a-423e-86f4-46f95edc88e2 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:16.025820 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f3ac3-4e1a-423e-86f4-46f95edc88e2 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:16.077924 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087862c5-d1b3-443e-a311-327aac83da67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:16.078600 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087862c5-d1b3-443e-a311-327aac83da67 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:16.078879 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087862c5-d1b3-443e-a311-327aac83da67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:16.079150 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087862c5-d1b3-443e-a311-327aac83da67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:16.079871 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087862c5-d1b3-443e-a311-327aac83da67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:16.081467 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087862c5-d1b3-443e-a311-327aac83da67 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:16.091155 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1018/2043] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:34:16 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:34:16.096080 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d82939-cc21-47f3-8663-511e616dc4b5 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:16.107422 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d82939-cc21-47f3-8663-511e616dc4b5 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:16.114225 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519d49d-1ec6-451c-928f-e982cfba6b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:16.114225 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519d49d-1ec6-451c-928f-e982cfba6b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:16.114559 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519d49d-1ec6-451c-928f-e982cfba6b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:16.114783 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519d49d-1ec6-451c-928f-e982cfba6b52 admin admin] PATH_INFO: `/v3/projects/59b0651106f14e7394b9d92a2469986b/users/f687013344bb412fa974831a56920f66/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:16.116773 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519d49d-1ec6-451c-928f-e982cfba6b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b0651106f14e7394b9d92a2469986b, user_id=f687013344bb412fa974831a56920f66, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:16.119435 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519d49d-1ec6-451c-928f-e982cfba6b52 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:16.130569 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1026/2044] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:34:16 2021] PUT /identity/v3/projects/59b0651106f14e7394b9d92a2469986b/users/f687013344bb412fa974831a56920f66/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:34:16.141738 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c348c-d90f-43fb-b7c2-232ee9a873a4 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:16.142028 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c348c-d90f-43fb-b7c2-232ee9a873a4 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:16.142310 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c348c-d90f-43fb-b7c2-232ee9a873a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:16.170645 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-fc6c348c-d90f-43fb-b7c2-232ee9a873a4 None None] MFA Rules not processed for user `f687013344bb412fa974831a56920f66`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:16.171869 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-fc6c348c-d90f-43fb-b7c2-232ee9a873a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:16.259085 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1019/2045] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:16 2021] POST /identity/v3/auth/tokens => generated 3444 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:16.272579 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519d49d-1ec6-451c-928f-e982cfba6b52 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:16.274475 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-b519d49d-1ec6-451c-928f-e982cfba6b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:16.340774 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519d49d-1ec6-451c-928f-e982cfba6b52 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:16.345006 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee0776-d651-4f58-b66e-7f8650778a1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:16.345677 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee0776-d651-4f58-b66e-7f8650778a1d service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:16.345960 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee0776-d651-4f58-b66e-7f8650778a1d service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:16.346234 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee0776-d651-4f58-b66e-7f8650778a1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:16.356060 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee0776-d651-4f58-b66e-7f8650778a1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:16.357565 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee0776-d651-4f58-b66e-7f8650778a1d service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:16.367699 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1027/2046] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:34:16 2021] GET /identity/v3/auth/tokens => generated 3444 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:34:16.438849 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c348c-d90f-43fb-b7c2-232ee9a873a4 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:16.453639 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c348c-d90f-43fb-b7c2-232ee9a873a4 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:16.459028 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c446fe-0d63-42ca-b4cd-f79803fcbca2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:16.459994 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c446fe-0d63-42ca-b4cd-f79803fcbca2 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:16.460423 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c446fe-0d63-42ca-b4cd-f79803fcbca2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:16.460844 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c446fe-0d63-42ca-b4cd-f79803fcbca2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:16.531451 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c446fe-0d63-42ca-b4cd-f79803fcbca2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:16.533031 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c446fe-0d63-42ca-b4cd-f79803fcbca2 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:16.545365 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1020/2047] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:34:16 2021] GET /identity/v3/auth/tokens => generated 3375 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:34:20.064477 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee0776-d651-4f58-b66e-7f8650778a1d service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:20.066139 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-79ee0776-d651-4f58-b66e-7f8650778a1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:20.142291 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee0776-d651-4f58-b66e-7f8650778a1d service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:20.149713 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98561a46-9d88-42be-823a-4f66e4b39f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:20.150805 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98561a46-9d88-42be-823a-4f66e4b39f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:20.151252 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98561a46-9d88-42be-823a-4f66e4b39f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:20.151678 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98561a46-9d88-42be-823a-4f66e4b39f58 admin admin] PATH_INFO: `/v3/users/00d81dec84634250b35b8e090620bc8d` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:20.153084 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98561a46-9d88-42be-823a-4f66e4b39f58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00d81dec84634250b35b8e090620bc8d)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:20.155209 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98561a46-9d88-42be-823a-4f66e4b39f58 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:20.230284 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-98561a46-9d88-42be-823a-4f66e4b39f58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00d81dec84634250b35b8e090620bc8d'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:20.241837 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-98561a46-9d88-42be-823a-4f66e4b39f58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00d81dec84634250b35b8e090620bc8d'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:20.252641 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-98561a46-9d88-42be-823a-4f66e4b39f58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00d81dec84634250b35b8e090620bc8d'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:20.253810 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-98561a46-9d88-42be-823a-4f66e4b39f58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00d81dec84634250b35b8e090620bc8d'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:20.270748 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-98561a46-9d88-42be-823a-4f66e4b39f58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00d81dec84634250b35b8e090620bc8d'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:20.279413 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1028/2048] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:34:20 2021] DELETE /identity/v3/users/00d81dec84634250b35b8e090620bc8d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:34:20.283970 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154207dd-05f2-4a09-bc43-618187c9072c None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:20.284460 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154207dd-05f2-4a09-bc43-618187c9072c None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:20.284651 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154207dd-05f2-4a09-bc43-618187c9072c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:20.320447 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-154207dd-05f2-4a09-bc43-618187c9072c None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:20.321745 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-154207dd-05f2-4a09-bc43-618187c9072c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:20.507494 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1021/2049] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:20.519966 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98561a46-9d88-42be-823a-4f66e4b39f58 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:20.521407 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-98561a46-9d88-42be-823a-4f66e4b39f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:20.635073 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98561a46-9d88-42be-823a-4f66e4b39f58 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:20.641652 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7edcb84-c910-4bca-9db5-be5d3f9fbd7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:20.643041 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edcb84-c910-4bca-9db5-be5d3f9fbd7b service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:20.643400 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edcb84-c910-4bca-9db5-be5d3f9fbd7b service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:20.643772 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7edcb84-c910-4bca-9db5-be5d3f9fbd7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:20.654696 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edcb84-c910-4bca-9db5-be5d3f9fbd7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:20.656280 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7edcb84-c910-4bca-9db5-be5d3f9fbd7b service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:20.668513 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1029/2050] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:34:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:34:21.007877 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154207dd-05f2-4a09-bc43-618187c9072c None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:21.009387 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-154207dd-05f2-4a09-bc43-618187c9072c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:21.021502 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154207dd-05f2-4a09-bc43-618187c9072c None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:21.026581 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639323dd-2a30-4012-a473-6add26a2fa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:21.027514 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639323dd-2a30-4012-a473-6add26a2fa3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:21.027868 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639323dd-2a30-4012-a473-6add26a2fa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:21.028216 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639323dd-2a30-4012-a473-6add26a2fa3c admin admin] PATH_INFO: `/v3/projects/4365b29543584588a1e14a607e95e668` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:21.029500 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639323dd-2a30-4012-a473-6add26a2fa3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4365b29543584588a1e14a607e95e668)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:21.031408 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639323dd-2a30-4012-a473-6add26a2fa3c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:21.080549 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-639323dd-2a30-4012-a473-6add26a2fa3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4365b29543584588a1e14a607e95e668', 'request_id': 'req-639323dd-2a30-4012-a473-6add26a2fa3c'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:21.086666 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-639323dd-2a30-4012-a473-6add26a2fa3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4365b29543584588a1e14a607e95e668', 'request_id': 'req-639323dd-2a30-4012-a473-6add26a2fa3c'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:21.098053 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-639323dd-2a30-4012-a473-6add26a2fa3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4365b29543584588a1e14a607e95e668', 'request_id': 'req-639323dd-2a30-4012-a473-6add26a2fa3c'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:21.111316 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-639323dd-2a30-4012-a473-6add26a2fa3c admin admin] The token cache is being invalidate because project 4365b29543584588a1e14a607e95e668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:34:21.111749 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-639323dd-2a30-4012-a473-6add26a2fa3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:21.112636 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-639323dd-2a30-4012-a473-6add26a2fa3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:21.114344 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1022/2051] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:34:21 2021] DELETE /identity/v3/projects/4365b29543584588a1e14a607e95e668 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:34:21.120678 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cebf0f-50ff-49b0-9b14-95f6cdec0ea1 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:21.121335 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cebf0f-50ff-49b0-9b14-95f6cdec0ea1 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:21.121335 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cebf0f-50ff-49b0-9b14-95f6cdec0ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:21.139922 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-95cebf0f-50ff-49b0-9b14-95f6cdec0ea1 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:21.141401 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-95cebf0f-50ff-49b0-9b14-95f6cdec0ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:21.207039 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1030/2052] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:21.214904 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf37852-7d55-41b1-875a-98c5a57a24b1 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:21.215191 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf37852-7d55-41b1-875a-98c5a57a24b1 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:21.215623 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf37852-7d55-41b1-875a-98c5a57a24b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:21.235146 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-ebf37852-7d55-41b1-875a-98c5a57a24b1 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:21.236361 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-ebf37852-7d55-41b1-875a-98c5a57a24b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:21.246316 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1023/2053] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:21.250823 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cebf0f-50ff-49b0-9b14-95f6cdec0ea1 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:21.260857 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cebf0f-50ff-49b0-9b14-95f6cdec0ea1 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:21.265634 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d15cc-1d81-445d-8fd4-f67bc9130c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:21.266307 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d15cc-1d81-445d-8fd4-f67bc9130c52 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:21.266590 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d15cc-1d81-445d-8fd4-f67bc9130c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:21.266866 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d15cc-1d81-445d-8fd4-f67bc9130c52 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:21.267594 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d15cc-1d81-445d-8fd4-f67bc9130c52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:34:21.267899 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d15cc-1d81-445d-8fd4-f67bc9130c52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:21.269467 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d15cc-1d81-445d-8fd4-f67bc9130c52 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:21.286127 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1031/2054] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:34:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:34:21.287283 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf37852-7d55-41b1-875a-98c5a57a24b1 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:21.307458 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf37852-7d55-41b1-875a-98c5a57a24b1 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:21.312349 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab9f3f-4e24-4547-a717-0789ff62018d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:21.313043 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab9f3f-4e24-4547-a717-0789ff62018d admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:21.313328 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab9f3f-4e24-4547-a717-0789ff62018d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:21.313641 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab9f3f-4e24-4547-a717-0789ff62018d admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:21.314352 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab9f3f-4e24-4547-a717-0789ff62018d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:21.316291 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab9f3f-4e24-4547-a717-0789ff62018d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:21.341214 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1024/2055] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:34:21 2021] POST /identity/v3/projects => generated 361 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:34:21.346061 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d15cc-1d81-445d-8fd4-f67bc9130c52 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:21.356092 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d15cc-1d81-445d-8fd4-f67bc9130c52 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:21.412187 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57184923-2535-47bf-9b39-53f4449c8e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:21.412858 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57184923-2535-47bf-9b39-53f4449c8e72 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:21.413142 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57184923-2535-47bf-9b39-53f4449c8e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:21.413446 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57184923-2535-47bf-9b39-53f4449c8e72 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:21.414191 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57184923-2535-47bf-9b39-53f4449c8e72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:21.416095 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57184923-2535-47bf-9b39-53f4449c8e72 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:21.438133 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1032/2056] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:34:21 2021] POST /identity/v3/users => generated 281 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:34:21.442428 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab9f3f-4e24-4547-a717-0789ff62018d admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:21.453072 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab9f3f-4e24-4547-a717-0789ff62018d admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:21.457903 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643985b-f88d-405d-9da2-1f0700161a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:21.458574 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643985b-f88d-405d-9da2-1f0700161a6d admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:21.458862 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643985b-f88d-405d-9da2-1f0700161a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:21.459145 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643985b-f88d-405d-9da2-1f0700161a6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:21.459921 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643985b-f88d-405d-9da2-1f0700161a6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:21.461536 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643985b-f88d-405d-9da2-1f0700161a6d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:21.474813 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1025/2057] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:34:21 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:34:21.478984 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57184923-2535-47bf-9b39-53f4449c8e72 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:21.489461 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57184923-2535-47bf-9b39-53f4449c8e72 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:21.494285 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088b9a3-5a9b-42ba-ac85-6c3009e8dc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:21.494943 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088b9a3-5a9b-42ba-ac85-6c3009e8dc59 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:21.495240 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088b9a3-5a9b-42ba-ac85-6c3009e8dc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:21.495526 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088b9a3-5a9b-42ba-ac85-6c3009e8dc59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:21.496269 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088b9a3-5a9b-42ba-ac85-6c3009e8dc59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:21.497876 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088b9a3-5a9b-42ba-ac85-6c3009e8dc59 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:21.517653 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1033/2058] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:34:21 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:34:21.521205 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643985b-f88d-405d-9da2-1f0700161a6d admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:21.531131 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643985b-f88d-405d-9da2-1f0700161a6d admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:21.536610 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa69859-c91b-4e4f-ab8a-34523a92ba4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:21.537538 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa69859-c91b-4e4f-ab8a-34523a92ba4e admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:21.537826 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa69859-c91b-4e4f-ab8a-34523a92ba4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:21.538107 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa69859-c91b-4e4f-ab8a-34523a92ba4e admin admin] PATH_INFO: `/v3/projects/6a33135cefd746a3a433fbcefd0ad1b9/users/46f000fe1a09485bb7483446da3cd821/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:21.553652 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa69859-c91b-4e4f-ab8a-34523a92ba4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a33135cefd746a3a433fbcefd0ad1b9, user_id=46f000fe1a09485bb7483446da3cd821, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:21.556543 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa69859-c91b-4e4f-ab8a-34523a92ba4e admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:21.569015 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1026/2059] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:34:21 2021] PUT /identity/v3/projects/6a33135cefd746a3a433fbcefd0ad1b9/users/46f000fe1a09485bb7483446da3cd821/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:34:21.580475 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4431318-0d0c-482d-bb4a-82d28df59339 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:21.580772 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4431318-0d0c-482d-bb4a-82d28df59339 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:21.581057 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4431318-0d0c-482d-bb4a-82d28df59339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:21.606881 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-c4431318-0d0c-482d-bb4a-82d28df59339 None None] MFA Rules not processed for user `46f000fe1a09485bb7483446da3cd821`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:21.608082 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-c4431318-0d0c-482d-bb4a-82d28df59339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:21.670107 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1034/2060] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:21 2021] POST /identity/v3/auth/tokens => generated 3381 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:34:21.698122 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa69859-c91b-4e4f-ab8a-34523a92ba4e admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:21.699858 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-ffa69859-c91b-4e4f-ab8a-34523a92ba4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:21.756043 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa69859-c91b-4e4f-ab8a-34523a92ba4e admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:21.760505 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748a40c-5fcc-444a-9035-5ac3f2790f3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:21.761168 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748a40c-5fcc-444a-9035-5ac3f2790f3b service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:21.761450 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748a40c-5fcc-444a-9035-5ac3f2790f3b service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:21.761759 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748a40c-5fcc-444a-9035-5ac3f2790f3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:21.770767 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2748a40c-5fcc-444a-9035-5ac3f2790f3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:21.772164 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2748a40c-5fcc-444a-9035-5ac3f2790f3b service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:21.780648 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1027/2061] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:34:21 2021] GET /identity/v3/auth/tokens => generated 3381 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:34:21.795356 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4431318-0d0c-482d-bb4a-82d28df59339 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:21.855567 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4431318-0d0c-482d-bb4a-82d28df59339 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:21.860665 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f77a10-6bc0-43da-bccf-07d436601932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:21.861553 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f77a10-6bc0-43da-bccf-07d436601932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:21.861842 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f77a10-6bc0-43da-bccf-07d436601932 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:21.862123 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f77a10-6bc0-43da-bccf-07d436601932 admin admin] PATH_INFO: `/v3/users/46f000fe1a09485bb7483446da3cd821` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:21.863325 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f77a10-6bc0-43da-bccf-07d436601932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46f000fe1a09485bb7483446da3cd821)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:21.865214 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f77a10-6bc0-43da-bccf-07d436601932 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:21.909653 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-38f77a10-6bc0-43da-bccf-07d436601932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46f000fe1a09485bb7483446da3cd821'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:21.916006 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-38f77a10-6bc0-43da-bccf-07d436601932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46f000fe1a09485bb7483446da3cd821'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:21.923227 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-38f77a10-6bc0-43da-bccf-07d436601932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46f000fe1a09485bb7483446da3cd821'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:21.923796 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-38f77a10-6bc0-43da-bccf-07d436601932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46f000fe1a09485bb7483446da3cd821'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:21.936004 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-38f77a10-6bc0-43da-bccf-07d436601932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46f000fe1a09485bb7483446da3cd821'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:21.943214 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1035/2062] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:34:21 2021] DELETE /identity/v3/users/46f000fe1a09485bb7483446da3cd821 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:34:21.947565 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37341221-2989-4f57-914b-6d63866e4484 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:21.947932 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37341221-2989-4f57-914b-6d63866e4484 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:21.948282 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37341221-2989-4f57-914b-6d63866e4484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:21.975186 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-37341221-2989-4f57-914b-6d63866e4484 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:21.976433 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-37341221-2989-4f57-914b-6d63866e4484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:22.043091 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1028/2063] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:22.056507 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f77a10-6bc0-43da-bccf-07d436601932 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:22.057046 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-38f77a10-6bc0-43da-bccf-07d436601932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:22.117347 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f77a10-6bc0-43da-bccf-07d436601932 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:22.121133 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056129c-2411-478d-b654-4739cb078b25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:22.122021 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056129c-2411-478d-b654-4739cb078b25 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:22.122310 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056129c-2411-478d-b654-4739cb078b25 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:22.122702 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056129c-2411-478d-b654-4739cb078b25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:22.131792 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056129c-2411-478d-b654-4739cb078b25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:22.133217 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056129c-2411-478d-b654-4739cb078b25 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:22.142433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1036/2064] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:34:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:34:22.268659 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5e022-5add-4a2b-bb7c-9b621e40e252 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:22.269051 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5e022-5add-4a2b-bb7c-9b621e40e252 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:22.269429 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5e022-5add-4a2b-bb7c-9b621e40e252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:22.325020 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-9ae5e022-5add-4a2b-bb7c-9b621e40e252 None None] MFA Rules not processed for user `b69a1392996542a699aa5684269bc2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:22.329357 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-9ae5e022-5add-4a2b-bb7c-9b621e40e252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:22.402387 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1029/2065] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:22 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:22.441645 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056129c-2411-478d-b654-4739cb078b25 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:22.443048 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-c056129c-2411-478d-b654-4739cb078b25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:22.466867 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056129c-2411-478d-b654-4739cb078b25 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:22.471633 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c1aa0-6d24-4253-acda-76ce21144129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:22.472706 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c1aa0-6d24-4253-acda-76ce21144129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:22.473818 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c1aa0-6d24-4253-acda-76ce21144129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:22.474109 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c1aa0-6d24-4253-acda-76ce21144129 admin admin] PATH_INFO: `/v3/projects/6a33135cefd746a3a433fbcefd0ad1b9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:22.475659 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c1aa0-6d24-4253-acda-76ce21144129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a33135cefd746a3a433fbcefd0ad1b9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:22.477563 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c1aa0-6d24-4253-acda-76ce21144129 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:22.527100 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-9f1c1aa0-6d24-4253-acda-76ce21144129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a33135cefd746a3a433fbcefd0ad1b9', 'request_id': 'req-9f1c1aa0-6d24-4253-acda-76ce21144129'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:22.533045 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-9f1c1aa0-6d24-4253-acda-76ce21144129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a33135cefd746a3a433fbcefd0ad1b9', 'request_id': 'req-9f1c1aa0-6d24-4253-acda-76ce21144129'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:22.544442 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-9f1c1aa0-6d24-4253-acda-76ce21144129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a33135cefd746a3a433fbcefd0ad1b9', 'request_id': 'req-9f1c1aa0-6d24-4253-acda-76ce21144129'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:22.559471 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-9f1c1aa0-6d24-4253-acda-76ce21144129 admin admin] The token cache is being invalidate because project 6a33135cefd746a3a433fbcefd0ad1b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:34:22.559898 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-9f1c1aa0-6d24-4253-acda-76ce21144129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:22.560638 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-9f1c1aa0-6d24-4253-acda-76ce21144129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:22.562587 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1037/2066] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:34:22 2021] DELETE /identity/v3/projects/6a33135cefd746a3a433fbcefd0ad1b9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:34:22.569099 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c941a-ee5d-4b90-b9f2-d62e8394fa5d None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:22.569708 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c941a-ee5d-4b90-b9f2-d62e8394fa5d None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:22.570107 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c941a-ee5d-4b90-b9f2-d62e8394fa5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:22.590614 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-347c941a-ee5d-4b90-b9f2-d62e8394fa5d None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:22.591834 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-347c941a-ee5d-4b90-b9f2-d62e8394fa5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:22.651337 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1030/2067] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:34:22.659963 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbeb543-75ee-4bae-b819-edbba84af20a None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:22.660343 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbeb543-75ee-4bae-b819-edbba84af20a None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:22.660699 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbeb543-75ee-4bae-b819-edbba84af20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:22.679699 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-6fbeb543-75ee-4bae-b819-edbba84af20a None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:22.681227 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-6fbeb543-75ee-4bae-b819-edbba84af20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:22.689812 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1038/2068] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:34:22.694174 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c941a-ee5d-4b90-b9f2-d62e8394fa5d None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:22.704766 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c941a-ee5d-4b90-b9f2-d62e8394fa5d None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:22.709705 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb708e4-fb0b-4471-a1af-94f942bf8b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:22.710389 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb708e4-fb0b-4471-a1af-94f942bf8b0d admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:22.710676 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb708e4-fb0b-4471-a1af-94f942bf8b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:22.711160 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb708e4-fb0b-4471-a1af-94f942bf8b0d admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:22.711985 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb708e4-fb0b-4471-a1af-94f942bf8b0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:34:22.712298 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb708e4-fb0b-4471-a1af-94f942bf8b0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:22.713955 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb708e4-fb0b-4471-a1af-94f942bf8b0d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:22.730071 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1031/2069] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:34:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:34:22.731027 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbeb543-75ee-4bae-b819-edbba84af20a None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:22.740777 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbeb543-75ee-4bae-b819-edbba84af20a None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:22.745632 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b720a-55eb-4456-a6a5-81f47a326669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:22.747491 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b720a-55eb-4456-a6a5-81f47a326669 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:22.747491 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b720a-55eb-4456-a6a5-81f47a326669 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:22.747491 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b720a-55eb-4456-a6a5-81f47a326669 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:22.747765 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b720a-55eb-4456-a6a5-81f47a326669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:22.749711 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b720a-55eb-4456-a6a5-81f47a326669 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:22.776961 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1039/2070] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:34:22 2021] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:34:22.782085 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb708e4-fb0b-4471-a1af-94f942bf8b0d admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:22.796838 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb708e4-fb0b-4471-a1af-94f942bf8b0d admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:22.865013 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55604758-697b-4ce7-9925-402080d92533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:22.865828 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55604758-697b-4ce7-9925-402080d92533 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:22.866200 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55604758-697b-4ce7-9925-402080d92533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:22.868034 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55604758-697b-4ce7-9925-402080d92533 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:22.868034 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55604758-697b-4ce7-9925-402080d92533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:22.869271 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55604758-697b-4ce7-9925-402080d92533 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:22.890327 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1032/2071] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:34:22 2021] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:34:22.895130 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b720a-55eb-4456-a6a5-81f47a326669 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:22.905413 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b720a-55eb-4456-a6a5-81f47a326669 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:22.910122 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223caed0-1f5e-4188-baf2-f7a95b01a1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:22.910780 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223caed0-1f5e-4188-baf2-f7a95b01a1bb admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:22.911067 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223caed0-1f5e-4188-baf2-f7a95b01a1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:22.911346 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223caed0-1f5e-4188-baf2-f7a95b01a1bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:22.912116 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223caed0-1f5e-4188-baf2-f7a95b01a1bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:22.913729 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223caed0-1f5e-4188-baf2-f7a95b01a1bb admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:22.927116 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1040/2072] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:34:22 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:34:22.928281 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55604758-697b-4ce7-9925-402080d92533 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:22.940129 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55604758-697b-4ce7-9925-402080d92533 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:22.944842 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a526e38-1e7f-4a8f-86d3-43a7400a80f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:22.945524 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a526e38-1e7f-4a8f-86d3-43a7400a80f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:22.945814 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a526e38-1e7f-4a8f-86d3-43a7400a80f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:22.946094 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a526e38-1e7f-4a8f-86d3-43a7400a80f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:22.946834 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a526e38-1e7f-4a8f-86d3-43a7400a80f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:22.948417 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a526e38-1e7f-4a8f-86d3-43a7400a80f8 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:22.959467 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1033/2073] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:34:22 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:34:22.963582 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223caed0-1f5e-4188-baf2-f7a95b01a1bb admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:22.973699 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223caed0-1f5e-4188-baf2-f7a95b01a1bb admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:22.978589 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ec189-f043-4102-8911-bb0d32f05f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:22.979900 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ec189-f043-4102-8911-bb0d32f05f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:22.979900 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ec189-f043-4102-8911-bb0d32f05f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:22.980250 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ec189-f043-4102-8911-bb0d32f05f5a admin admin] PATH_INFO: `/v3/projects/73ee0d5a0a5d462a90cebc6c5eb8676b/users/fa9a3c47d78d457fb89f9240c901dbaa/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:22.995982 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ec189-f043-4102-8911-bb0d32f05f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ee0d5a0a5d462a90cebc6c5eb8676b, user_id=fa9a3c47d78d457fb89f9240c901dbaa, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:22.998637 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ec189-f043-4102-8911-bb0d32f05f5a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:23.011873 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1041/2074] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:34:22 2021] PUT /identity/v3/projects/73ee0d5a0a5d462a90cebc6c5eb8676b/users/fa9a3c47d78d457fb89f9240c901dbaa/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:34:23.022734 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75210b19-da6e-473f-a429-5c8674c372da None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:23.023059 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75210b19-da6e-473f-a429-5c8674c372da None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:23.023307 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75210b19-da6e-473f-a429-5c8674c372da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:23.051424 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-75210b19-da6e-473f-a429-5c8674c372da None None] MFA Rules not processed for user `fa9a3c47d78d457fb89f9240c901dbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:23.052630 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-75210b19-da6e-473f-a429-5c8674c372da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:23.133266 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1034/2075] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:23 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:23.143816 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ec189-f043-4102-8911-bb0d32f05f5a admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:23.145777 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-f03ec189-f043-4102-8911-bb0d32f05f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:23.228416 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ec189-f043-4102-8911-bb0d32f05f5a admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:23.232783 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273501e-90e9-4fb2-b205-35eb85cded4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:23.233917 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273501e-90e9-4fb2-b205-35eb85cded4f service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:23.236413 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273501e-90e9-4fb2-b205-35eb85cded4f service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:23.240357 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273501e-90e9-4fb2-b205-35eb85cded4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:23.251007 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273501e-90e9-4fb2-b205-35eb85cded4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:23.252756 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273501e-90e9-4fb2-b205-35eb85cded4f service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:23.272229 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1042/2076] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:34:23 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:34:36.943410 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75210b19-da6e-473f-a429-5c8674c372da None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:36.944800 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-75210b19-da6e-473f-a429-5c8674c372da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:37.001351 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75210b19-da6e-473f-a429-5c8674c372da None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:37.005265 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab02f49-e9db-4d1c-8b6f-28a61ee1aa5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:37.005944 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab02f49-e9db-4d1c-8b6f-28a61ee1aa5d service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:37.006260 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab02f49-e9db-4d1c-8b6f-28a61ee1aa5d service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:37.006534 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab02f49-e9db-4d1c-8b6f-28a61ee1aa5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:37.008256 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4ab02f49-e9db-4d1c-8b6f-28a61ee1aa5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:37.067781 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab02f49-e9db-4d1c-8b6f-28a61ee1aa5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:37.069185 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab02f49-e9db-4d1c-8b6f-28a61ee1aa5d service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:37.078895 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1035/2077] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:34:36 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:34:39.249940 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273501e-90e9-4fb2-b205-35eb85cded4f service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:39.251511 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-d273501e-90e9-4fb2-b205-35eb85cded4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:39.328618 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273501e-90e9-4fb2-b205-35eb85cded4f service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:39.354478 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5cd988-a703-4608-8dbd-f8ecb2fa97e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:39.355591 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cd988-a703-4608-8dbd-f8ecb2fa97e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:39.356390 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cd988-a703-4608-8dbd-f8ecb2fa97e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:39.356903 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cd988-a703-4608-8dbd-f8ecb2fa97e6 admin admin] PATH_INFO: `/v3/users/5d8a12b35ae74bb2a3d75c2cd4d9375a` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:39.358877 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5cd988-a703-4608-8dbd-f8ecb2fa97e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d8a12b35ae74bb2a3d75c2cd4d9375a)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:39.363349 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5cd988-a703-4608-8dbd-f8ecb2fa97e6 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:39.420679 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-7a5cd988-a703-4608-8dbd-f8ecb2fa97e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d8a12b35ae74bb2a3d75c2cd4d9375a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:39.430073 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-7a5cd988-a703-4608-8dbd-f8ecb2fa97e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d8a12b35ae74bb2a3d75c2cd4d9375a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:39.438857 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-7a5cd988-a703-4608-8dbd-f8ecb2fa97e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d8a12b35ae74bb2a3d75c2cd4d9375a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:39.439657 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-7a5cd988-a703-4608-8dbd-f8ecb2fa97e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d8a12b35ae74bb2a3d75c2cd4d9375a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:39.454980 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-7a5cd988-a703-4608-8dbd-f8ecb2fa97e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d8a12b35ae74bb2a3d75c2cd4d9375a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:39.462824 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1043/2078] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:34:39 2021] DELETE /identity/v3/users/5d8a12b35ae74bb2a3d75c2cd4d9375a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:34:39.467293 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617d74b-d75d-4506-bc18-773befa5863e None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:39.467754 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617d74b-d75d-4506-bc18-773befa5863e None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:39.467995 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617d74b-d75d-4506-bc18-773befa5863e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:39.491746 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-f617d74b-d75d-4506-bc18-773befa5863e None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:39.493300 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-f617d74b-d75d-4506-bc18-773befa5863e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:39.560529 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1036/2079] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:39.574774 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5cd988-a703-4608-8dbd-f8ecb2fa97e6 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:39.576967 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-7a5cd988-a703-4608-8dbd-f8ecb2fa97e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:39.650346 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5cd988-a703-4608-8dbd-f8ecb2fa97e6 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:39.654047 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b4301-d745-4b2f-8638-bfa84d919bb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:39.654758 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b4301-d745-4b2f-8638-bfa84d919bb8 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:39.655126 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b4301-d745-4b2f-8638-bfa84d919bb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:39.655379 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b4301-d745-4b2f-8638-bfa84d919bb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:39.667025 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b4301-d745-4b2f-8638-bfa84d919bb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:39.668553 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b4301-d745-4b2f-8638-bfa84d919bb8 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:39.679309 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1044/2080] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:34:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:34:40.038935 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617d74b-d75d-4506-bc18-773befa5863e None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:40.040614 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-f617d74b-d75d-4506-bc18-773befa5863e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:40.063207 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617d74b-d75d-4506-bc18-773befa5863e None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:40.074794 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c1413-557c-49d8-a895-302a36f6e476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:40.075657 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c1413-557c-49d8-a895-302a36f6e476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:40.075938 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c1413-557c-49d8-a895-302a36f6e476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:40.076259 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c1413-557c-49d8-a895-302a36f6e476 admin admin] PATH_INFO: `/v3/projects/4283910da3e54643b6dd7d7d906e6f8a` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:40.077512 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c1413-557c-49d8-a895-302a36f6e476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4283910da3e54643b6dd7d7d906e6f8a)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:40.080504 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c1413-557c-49d8-a895-302a36f6e476 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:40.146848 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-296c1413-557c-49d8-a895-302a36f6e476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4283910da3e54643b6dd7d7d906e6f8a', 'request_id': 'req-296c1413-557c-49d8-a895-302a36f6e476'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:40.152399 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-296c1413-557c-49d8-a895-302a36f6e476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4283910da3e54643b6dd7d7d906e6f8a', 'request_id': 'req-296c1413-557c-49d8-a895-302a36f6e476'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:40.159965 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-296c1413-557c-49d8-a895-302a36f6e476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4283910da3e54643b6dd7d7d906e6f8a', 'request_id': 'req-296c1413-557c-49d8-a895-302a36f6e476'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:40.172064 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-296c1413-557c-49d8-a895-302a36f6e476 admin admin] The token cache is being invalidate because project 4283910da3e54643b6dd7d7d906e6f8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:34:40.172353 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-296c1413-557c-49d8-a895-302a36f6e476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:40.173131 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-296c1413-557c-49d8-a895-302a36f6e476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:40.174805 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1037/2081] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:34:40 2021] DELETE /identity/v3/projects/4283910da3e54643b6dd7d7d906e6f8a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:34:40.178785 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b4301-d745-4b2f-8638-bfa84d919bb8 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:40.189418 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b4301-d745-4b2f-8638-bfa84d919bb8 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:40.243235 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393b0fe-9ac1-45e8-967c-909deb80ef36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:40.244142 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393b0fe-9ac1-45e8-967c-909deb80ef36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:40.244423 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393b0fe-9ac1-45e8-967c-909deb80ef36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:40.244698 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393b0fe-9ac1-45e8-967c-909deb80ef36 admin admin] PATH_INFO: `/v3/users/f687013344bb412fa974831a56920f66` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:40.246061 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393b0fe-9ac1-45e8-967c-909deb80ef36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f687013344bb412fa974831a56920f66)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:40.247957 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393b0fe-9ac1-45e8-967c-909deb80ef36 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:40.296413 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-4393b0fe-9ac1-45e8-967c-909deb80ef36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f687013344bb412fa974831a56920f66'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:40.303970 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-4393b0fe-9ac1-45e8-967c-909deb80ef36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f687013344bb412fa974831a56920f66'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:40.311505 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-4393b0fe-9ac1-45e8-967c-909deb80ef36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f687013344bb412fa974831a56920f66'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:40.312667 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-4393b0fe-9ac1-45e8-967c-909deb80ef36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f687013344bb412fa974831a56920f66'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:40.324995 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-4393b0fe-9ac1-45e8-967c-909deb80ef36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f687013344bb412fa974831a56920f66'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:40.333522 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1045/2082] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:34:40 2021] DELETE /identity/v3/users/f687013344bb412fa974831a56920f66 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:34:40.600732 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c1413-557c-49d8-a895-302a36f6e476 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:40.602232 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-296c1413-557c-49d8-a895-302a36f6e476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:40.616522 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c1413-557c-49d8-a895-302a36f6e476 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:40.669953 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5a3a6-bf38-4fb4-a477-c9bd6a57a3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:40.670805 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5a3a6-bf38-4fb4-a477-c9bd6a57a3eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:40.671097 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5a3a6-bf38-4fb4-a477-c9bd6a57a3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:40.671371 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5a3a6-bf38-4fb4-a477-c9bd6a57a3eb admin admin] PATH_INFO: `/v3/projects/59b0651106f14e7394b9d92a2469986b` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:40.673050 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5a3a6-bf38-4fb4-a477-c9bd6a57a3eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=59b0651106f14e7394b9d92a2469986b)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:40.674959 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5a3a6-bf38-4fb4-a477-c9bd6a57a3eb admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:40.719230 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-34e5a3a6-bf38-4fb4-a477-c9bd6a57a3eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59b0651106f14e7394b9d92a2469986b', 'request_id': 'req-34e5a3a6-bf38-4fb4-a477-c9bd6a57a3eb'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:40.724375 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-34e5a3a6-bf38-4fb4-a477-c9bd6a57a3eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59b0651106f14e7394b9d92a2469986b', 'request_id': 'req-34e5a3a6-bf38-4fb4-a477-c9bd6a57a3eb'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:40.731071 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-34e5a3a6-bf38-4fb4-a477-c9bd6a57a3eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59b0651106f14e7394b9d92a2469986b', 'request_id': 'req-34e5a3a6-bf38-4fb4-a477-c9bd6a57a3eb'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:40.742087 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-34e5a3a6-bf38-4fb4-a477-c9bd6a57a3eb admin admin] The token cache is being invalidate because project 59b0651106f14e7394b9d92a2469986b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:34:40.742375 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-34e5a3a6-bf38-4fb4-a477-c9bd6a57a3eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:40.742987 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-34e5a3a6-bf38-4fb4-a477-c9bd6a57a3eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:40.744479 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1038/2083] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:34:40 2021] DELETE /identity/v3/projects/59b0651106f14e7394b9d92a2469986b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:34:40.750583 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c21d4-75b9-4859-b073-2e9cacb9c979 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:40.750956 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c21d4-75b9-4859-b073-2e9cacb9c979 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:40.751326 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c21d4-75b9-4859-b073-2e9cacb9c979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:40.768338 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-f60c21d4-75b9-4859-b073-2e9cacb9c979 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:40.769580 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-f60c21d4-75b9-4859-b073-2e9cacb9c979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:40.828405 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1046/2084] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:34:40.835896 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9865cc9-0d17-4f05-92ce-02e9f0af3cc9 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:40.836186 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9865cc9-0d17-4f05-92ce-02e9f0af3cc9 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:40.836466 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9865cc9-0d17-4f05-92ce-02e9f0af3cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:40.854486 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-d9865cc9-0d17-4f05-92ce-02e9f0af3cc9 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:40.855675 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-d9865cc9-0d17-4f05-92ce-02e9f0af3cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:40.864098 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1039/2085] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:40.868146 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c21d4-75b9-4859-b073-2e9cacb9c979 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:40.877767 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c21d4-75b9-4859-b073-2e9cacb9c979 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:40.882468 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee322aa-0a52-4f34-8c9d-75c6b5b71602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:40.883124 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee322aa-0a52-4f34-8c9d-75c6b5b71602 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:40.883404 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee322aa-0a52-4f34-8c9d-75c6b5b71602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:40.883679 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee322aa-0a52-4f34-8c9d-75c6b5b71602 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:40.884414 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee322aa-0a52-4f34-8c9d-75c6b5b71602 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:34:40.884721 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee322aa-0a52-4f34-8c9d-75c6b5b71602 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:40.886334 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee322aa-0a52-4f34-8c9d-75c6b5b71602 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:40.897656 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1047/2086] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:34:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:34:40.901880 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9865cc9-0d17-4f05-92ce-02e9f0af3cc9 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:40.911179 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9865cc9-0d17-4f05-92ce-02e9f0af3cc9 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:40.915808 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c010c-a0c7-40c3-a46d-97877f4b7c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:40.916447 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c010c-a0c7-40c3-a46d-97877f4b7c38 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:40.916732 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c010c-a0c7-40c3-a46d-97877f4b7c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:40.917013 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c010c-a0c7-40c3-a46d-97877f4b7c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:40.917762 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c010c-a0c7-40c3-a46d-97877f4b7c38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:40.919633 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c010c-a0c7-40c3-a46d-97877f4b7c38 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:40.945506 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1040/2087] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:34:40 2021] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:34:40.949370 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee322aa-0a52-4f34-8c9d-75c6b5b71602 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:40.958963 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee322aa-0a52-4f34-8c9d-75c6b5b71602 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:41.012651 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeabb7a-a3b7-4623-80bb-20577e33a465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:41.013329 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeabb7a-a3b7-4623-80bb-20577e33a465 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:41.013630 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeabb7a-a3b7-4623-80bb-20577e33a465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:41.013915 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeabb7a-a3b7-4623-80bb-20577e33a465 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:41.014718 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeabb7a-a3b7-4623-80bb-20577e33a465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:41.016765 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeabb7a-a3b7-4623-80bb-20577e33a465 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:41.036611 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1048/2088] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:34:40 2021] POST /identity/v3/users => generated 283 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:34:41.040790 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c010c-a0c7-40c3-a46d-97877f4b7c38 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:41.051364 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c010c-a0c7-40c3-a46d-97877f4b7c38 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:41.056234 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227617a-fcd9-4eaf-a39c-444285d2f1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:41.056881 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227617a-fcd9-4eaf-a39c-444285d2f1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:41.057162 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227617a-fcd9-4eaf-a39c-444285d2f1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:41.057438 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227617a-fcd9-4eaf-a39c-444285d2f1a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:41.058200 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0227617a-fcd9-4eaf-a39c-444285d2f1a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:41.059771 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0227617a-fcd9-4eaf-a39c-444285d2f1a6 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:41.069808 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1041/2089] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:34:41 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:34:41.073505 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeabb7a-a3b7-4623-80bb-20577e33a465 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:41.083445 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeabb7a-a3b7-4623-80bb-20577e33a465 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:41.088057 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b0bf5-5940-4634-b972-dd1f71a6d309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:41.088698 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b0bf5-5940-4634-b972-dd1f71a6d309 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:41.088983 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b0bf5-5940-4634-b972-dd1f71a6d309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:41.089277 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b0bf5-5940-4634-b972-dd1f71a6d309 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:41.090029 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b0bf5-5940-4634-b972-dd1f71a6d309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:41.091618 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b0bf5-5940-4634-b972-dd1f71a6d309 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:41.101710 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1049/2090] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:34:41 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:34:41.105445 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227617a-fcd9-4eaf-a39c-444285d2f1a6 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:41.115175 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227617a-fcd9-4eaf-a39c-444285d2f1a6 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:41.119725 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3bc09-dfe4-467f-88e8-fcac2aadfdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:41.120582 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3bc09-dfe4-467f-88e8-fcac2aadfdad admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:41.120865 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3bc09-dfe4-467f-88e8-fcac2aadfdad admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:41.121141 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3bc09-dfe4-467f-88e8-fcac2aadfdad admin admin] PATH_INFO: `/v3/projects/4a878b9230bc4dc89f873ffff66b02db/users/3569289bb687475cbf84d8fb49350c79/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:41.135045 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3bc09-dfe4-467f-88e8-fcac2aadfdad admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a878b9230bc4dc89f873ffff66b02db, user_id=3569289bb687475cbf84d8fb49350c79, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:41.137695 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3bc09-dfe4-467f-88e8-fcac2aadfdad admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:41.151117 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1042/2091] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:34:41 2021] PUT /identity/v3/projects/4a878b9230bc4dc89f873ffff66b02db/users/3569289bb687475cbf84d8fb49350c79/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:34:41.162456 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabcc6b-b842-45fa-befb-6940617fe504 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:41.162756 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabcc6b-b842-45fa-befb-6940617fe504 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:41.163033 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabcc6b-b842-45fa-befb-6940617fe504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:41.192259 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-beabcc6b-b842-45fa-befb-6940617fe504 None None] MFA Rules not processed for user `3569289bb687475cbf84d8fb49350c79`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:41.193464 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-beabcc6b-b842-45fa-befb-6940617fe504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:41.254913 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1050/2092] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:41 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:34:41.259401 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3bc09-dfe4-467f-88e8-fcac2aadfdad admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:41.319430 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3bc09-dfe4-467f-88e8-fcac2aadfdad admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:41.324083 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9dffb-a1d2-4fcd-a855-4b4d88dd0584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:41.324732 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9dffb-a1d2-4fcd-a855-4b4d88dd0584 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:41.325016 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9dffb-a1d2-4fcd-a855-4b4d88dd0584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:41.325292 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9dffb-a1d2-4fcd-a855-4b4d88dd0584 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:41.326040 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9dffb-a1d2-4fcd-a855-4b4d88dd0584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:41.328465 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9dffb-a1d2-4fcd-a855-4b4d88dd0584 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:41.353109 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1043/2093] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:34:41 2021] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:34:41.357167 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabcc6b-b842-45fa-befb-6940617fe504 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:41.367535 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabcc6b-b842-45fa-befb-6940617fe504 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:41.421776 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed1eec-1df3-418f-ac36-375870b64aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:41.422439 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed1eec-1df3-418f-ac36-375870b64aab admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:41.422728 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed1eec-1df3-418f-ac36-375870b64aab admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:41.423010 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed1eec-1df3-418f-ac36-375870b64aab admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:41.423723 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed1eec-1df3-418f-ac36-375870b64aab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:41.425653 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed1eec-1df3-418f-ac36-375870b64aab admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:41.445465 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1051/2094] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:34:41 2021] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:34:41.449178 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9dffb-a1d2-4fcd-a855-4b4d88dd0584 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:41.460805 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9dffb-a1d2-4fcd-a855-4b4d88dd0584 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:41.465405 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc65a9-95da-49bd-b6b8-3f1980af758f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:41.466102 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc65a9-95da-49bd-b6b8-3f1980af758f admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:41.466412 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc65a9-95da-49bd-b6b8-3f1980af758f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:41.466664 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc65a9-95da-49bd-b6b8-3f1980af758f admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:41.467402 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc65a9-95da-49bd-b6b8-3f1980af758f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:41.468979 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc65a9-95da-49bd-b6b8-3f1980af758f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:41.479272 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1044/2095] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:34:41 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:34:41.487802 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed1eec-1df3-418f-ac36-375870b64aab admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:41.497442 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed1eec-1df3-418f-ac36-375870b64aab admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:41.502568 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9fb65-6ceb-4ad9-b027-e91904e10263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:41.503437 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9fb65-6ceb-4ad9-b027-e91904e10263 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:41.503719 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9fb65-6ceb-4ad9-b027-e91904e10263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:41.503999 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9fb65-6ceb-4ad9-b027-e91904e10263 admin admin] PATH_INFO: `/v3/projects/9c1b6117f1e54f8ba388b395ea62c17f/users/79e2107c33ce4351a8faeb11616a4ebf/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:41.520121 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9fb65-6ceb-4ad9-b027-e91904e10263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c1b6117f1e54f8ba388b395ea62c17f, user_id=79e2107c33ce4351a8faeb11616a4ebf, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:41.522791 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9fb65-6ceb-4ad9-b027-e91904e10263 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:41.534942 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1052/2096] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:34:41 2021] PUT /identity/v3/projects/9c1b6117f1e54f8ba388b395ea62c17f/users/79e2107c33ce4351a8faeb11616a4ebf/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:34:41.538869 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc65a9-95da-49bd-b6b8-3f1980af758f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:41.548708 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc65a9-95da-49bd-b6b8-3f1980af758f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:41.603078 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291f92e-8d0d-4967-a893-5faed73bfc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:41.603792 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291f92e-8d0d-4967-a893-5faed73bfc7f admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:41.604021 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291f92e-8d0d-4967-a893-5faed73bfc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:41.604298 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291f92e-8d0d-4967-a893-5faed73bfc7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:41.605031 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291f92e-8d0d-4967-a893-5faed73bfc7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:41.606642 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291f92e-8d0d-4967-a893-5faed73bfc7f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:41.616346 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1045/2097] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:34:41 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:34:41.620534 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9fb65-6ceb-4ad9-b027-e91904e10263 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:41.630867 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9fb65-6ceb-4ad9-b027-e91904e10263 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:41.635411 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f02bf6-d8ee-49da-bd06-fb3533871ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:41.636280 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f02bf6-d8ee-49da-bd06-fb3533871ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:41.636567 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f02bf6-d8ee-49da-bd06-fb3533871ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:41.636844 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f02bf6-d8ee-49da-bd06-fb3533871ed5 admin admin] PATH_INFO: `/v3/projects/9c1b6117f1e54f8ba388b395ea62c17f/users/79e2107c33ce4351a8faeb11616a4ebf/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:41.638848 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f02bf6-d8ee-49da-bd06-fb3533871ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c1b6117f1e54f8ba388b395ea62c17f, user_id=79e2107c33ce4351a8faeb11616a4ebf, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:41.642164 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f02bf6-d8ee-49da-bd06-fb3533871ed5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:41.652504 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1053/2098] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:34:41 2021] PUT /identity/v3/projects/9c1b6117f1e54f8ba388b395ea62c17f/users/79e2107c33ce4351a8faeb11616a4ebf/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:34:41.662665 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b63a2a-74fa-476b-8026-055fbe2a9047 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:41.663240 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b63a2a-74fa-476b-8026-055fbe2a9047 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:41.663525 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b63a2a-74fa-476b-8026-055fbe2a9047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:41.696043 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-82b63a2a-74fa-476b-8026-055fbe2a9047 None None] MFA Rules not processed for user `79e2107c33ce4351a8faeb11616a4ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:41.697228 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-82b63a2a-74fa-476b-8026-055fbe2a9047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:41.777667 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1046/2099] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:41 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:41.789653 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f02bf6-d8ee-49da-bd06-fb3533871ed5 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:41.792052 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-63f02bf6-d8ee-49da-bd06-fb3533871ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:41.851501 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f02bf6-d8ee-49da-bd06-fb3533871ed5 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:41.855531 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1244db-b825-46bb-b7a5-0d788cde8739 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:41.856108 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1244db-b825-46bb-b7a5-0d788cde8739 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:41.856391 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1244db-b825-46bb-b7a5-0d788cde8739 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:41.856664 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1244db-b825-46bb-b7a5-0d788cde8739 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:41.867148 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1244db-b825-46bb-b7a5-0d788cde8739 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:41.868455 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1244db-b825-46bb-b7a5-0d788cde8739 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:41.879797 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1054/2100] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:34:41 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:34:41.976651 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b63a2a-74fa-476b-8026-055fbe2a9047 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:41.987763 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b63a2a-74fa-476b-8026-055fbe2a9047 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:41.991508 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f7fef-8290-4f9b-8c5f-9f68b3f54cd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:41.992365 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f7fef-8290-4f9b-8c5f-9f68b3f54cd4 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:41.992798 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f7fef-8290-4f9b-8c5f-9f68b3f54cd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:41.993226 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f7fef-8290-4f9b-8c5f-9f68b3f54cd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:42.071679 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f7fef-8290-4f9b-8c5f-9f68b3f54cd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:42.073119 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f7fef-8290-4f9b-8c5f-9f68b3f54cd4 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:42.083874 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1047/2101] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:34:41 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:34:47.941260 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1244db-b825-46bb-b7a5-0d788cde8739 service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:48.002367 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1244db-b825-46bb-b7a5-0d788cde8739 service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:48.006871 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c0115-889a-464e-9f96-8fcd7e57329f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:48.007922 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c0115-889a-464e-9f96-8fcd7e57329f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:48.008214 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c0115-889a-464e-9f96-8fcd7e57329f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:48.009452 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c0115-889a-464e-9f96-8fcd7e57329f admin admin] PATH_INFO: `/v3/users/3569289bb687475cbf84d8fb49350c79` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:48.010126 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c0115-889a-464e-9f96-8fcd7e57329f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3569289bb687475cbf84d8fb49350c79)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:48.012215 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c0115-889a-464e-9f96-8fcd7e57329f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:48.057986 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-a71c0115-889a-464e-9f96-8fcd7e57329f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3569289bb687475cbf84d8fb49350c79'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:48.065037 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-a71c0115-889a-464e-9f96-8fcd7e57329f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3569289bb687475cbf84d8fb49350c79'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:48.072631 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-a71c0115-889a-464e-9f96-8fcd7e57329f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3569289bb687475cbf84d8fb49350c79'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:48.073299 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-a71c0115-889a-464e-9f96-8fcd7e57329f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3569289bb687475cbf84d8fb49350c79'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:48.085537 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-a71c0115-889a-464e-9f96-8fcd7e57329f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3569289bb687475cbf84d8fb49350c79'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:48.091315 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1055/2102] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:34:47 2021] DELETE /identity/v3/users/3569289bb687475cbf84d8fb49350c79 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:34:48.096655 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064a1e3-9f38-4b9f-8884-1e19a7c04d85 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:48.097138 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064a1e3-9f38-4b9f-8884-1e19a7c04d85 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:48.097244 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064a1e3-9f38-4b9f-8884-1e19a7c04d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:48.115337 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-6064a1e3-9f38-4b9f-8884-1e19a7c04d85 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:48.116585 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-6064a1e3-9f38-4b9f-8884-1e19a7c04d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:48.175546 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1048/2103] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:48.185974 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c0115-889a-464e-9f96-8fcd7e57329f admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:48.188055 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-a71c0115-889a-464e-9f96-8fcd7e57329f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:48.247379 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c0115-889a-464e-9f96-8fcd7e57329f admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:48.251717 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8983b-9274-4a6e-b71b-3468dfa6aae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:48.252358 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8983b-9274-4a6e-b71b-3468dfa6aae6 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:48.252702 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8983b-9274-4a6e-b71b-3468dfa6aae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:48.252925 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8983b-9274-4a6e-b71b-3468dfa6aae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:48.261735 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8983b-9274-4a6e-b71b-3468dfa6aae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:48.263145 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8983b-9274-4a6e-b71b-3468dfa6aae6 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:48.272820 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1056/2104] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:34:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:34:48.532040 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064a1e3-9f38-4b9f-8884-1e19a7c04d85 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:48.533523 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-6064a1e3-9f38-4b9f-8884-1e19a7c04d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:48.545115 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064a1e3-9f38-4b9f-8884-1e19a7c04d85 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:48.549957 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40439e07-bc37-45be-81d8-96d6481d2519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:48.550887 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40439e07-bc37-45be-81d8-96d6481d2519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:48.551243 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40439e07-bc37-45be-81d8-96d6481d2519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:48.551528 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40439e07-bc37-45be-81d8-96d6481d2519 admin admin] PATH_INFO: `/v3/projects/4a878b9230bc4dc89f873ffff66b02db` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:48.552839 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40439e07-bc37-45be-81d8-96d6481d2519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a878b9230bc4dc89f873ffff66b02db)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:48.555383 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40439e07-bc37-45be-81d8-96d6481d2519 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:48.601027 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-40439e07-bc37-45be-81d8-96d6481d2519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a878b9230bc4dc89f873ffff66b02db', 'request_id': 'req-40439e07-bc37-45be-81d8-96d6481d2519'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:48.606338 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-40439e07-bc37-45be-81d8-96d6481d2519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a878b9230bc4dc89f873ffff66b02db', 'request_id': 'req-40439e07-bc37-45be-81d8-96d6481d2519'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:48.614616 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-40439e07-bc37-45be-81d8-96d6481d2519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a878b9230bc4dc89f873ffff66b02db', 'request_id': 'req-40439e07-bc37-45be-81d8-96d6481d2519'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:48.625826 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-40439e07-bc37-45be-81d8-96d6481d2519 admin admin] The token cache is being invalidate because project 4a878b9230bc4dc89f873ffff66b02db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:34:48.626116 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-40439e07-bc37-45be-81d8-96d6481d2519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:48.626744 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-40439e07-bc37-45be-81d8-96d6481d2519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:48.628265 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1049/2105] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:34:48 2021] DELETE /identity/v3/projects/4a878b9230bc4dc89f873ffff66b02db => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:34:48.632677 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8983b-9274-4a6e-b71b-3468dfa6aae6 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:48.642137 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8983b-9274-4a6e-b71b-3468dfa6aae6 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:48.693905 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02017d15-fbb4-4711-9f16-426f607bf314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:48.694754 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02017d15-fbb4-4711-9f16-426f607bf314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:48.695039 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02017d15-fbb4-4711-9f16-426f607bf314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:48.695324 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02017d15-fbb4-4711-9f16-426f607bf314 admin admin] PATH_INFO: `/v3/users/79e2107c33ce4351a8faeb11616a4ebf` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:48.696502 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02017d15-fbb4-4711-9f16-426f607bf314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79e2107c33ce4351a8faeb11616a4ebf)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:48.698458 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02017d15-fbb4-4711-9f16-426f607bf314 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:48.745559 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-02017d15-fbb4-4711-9f16-426f607bf314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79e2107c33ce4351a8faeb11616a4ebf'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:48.753862 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-02017d15-fbb4-4711-9f16-426f607bf314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79e2107c33ce4351a8faeb11616a4ebf'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:48.760876 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-02017d15-fbb4-4711-9f16-426f607bf314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79e2107c33ce4351a8faeb11616a4ebf'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:48.761595 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-02017d15-fbb4-4711-9f16-426f607bf314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79e2107c33ce4351a8faeb11616a4ebf'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:48.772953 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-02017d15-fbb4-4711-9f16-426f607bf314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79e2107c33ce4351a8faeb11616a4ebf'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:48.778770 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1057/2106] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:34:48 2021] DELETE /identity/v3/users/79e2107c33ce4351a8faeb11616a4ebf => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:34:49.205019 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40439e07-bc37-45be-81d8-96d6481d2519 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:49.207569 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-40439e07-bc37-45be-81d8-96d6481d2519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:49.232761 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40439e07-bc37-45be-81d8-96d6481d2519 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:49.343878 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afb386-e9f8-47c3-a30f-1210d1711057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:49.345066 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afb386-e9f8-47c3-a30f-1210d1711057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:49.345357 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afb386-e9f8-47c3-a30f-1210d1711057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:49.345677 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afb386-e9f8-47c3-a30f-1210d1711057 admin admin] PATH_INFO: `/v3/projects/9c1b6117f1e54f8ba388b395ea62c17f` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:49.346895 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afb386-e9f8-47c3-a30f-1210d1711057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c1b6117f1e54f8ba388b395ea62c17f)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:49.348917 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afb386-e9f8-47c3-a30f-1210d1711057 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:49.398022 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-e9afb386-e9f8-47c3-a30f-1210d1711057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c1b6117f1e54f8ba388b395ea62c17f', 'request_id': 'req-e9afb386-e9f8-47c3-a30f-1210d1711057'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:49.403619 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-e9afb386-e9f8-47c3-a30f-1210d1711057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c1b6117f1e54f8ba388b395ea62c17f', 'request_id': 'req-e9afb386-e9f8-47c3-a30f-1210d1711057'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:49.411746 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-e9afb386-e9f8-47c3-a30f-1210d1711057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c1b6117f1e54f8ba388b395ea62c17f', 'request_id': 'req-e9afb386-e9f8-47c3-a30f-1210d1711057'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:49.423843 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-e9afb386-e9f8-47c3-a30f-1210d1711057 admin admin] The token cache is being invalidate because project 9c1b6117f1e54f8ba388b395ea62c17f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:34:49.424135 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-e9afb386-e9f8-47c3-a30f-1210d1711057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:49.425126 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-e9afb386-e9f8-47c3-a30f-1210d1711057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:49.426572 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1050/2107] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:34:49 2021] DELETE /identity/v3/projects/9c1b6117f1e54f8ba388b395ea62c17f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:34:49.432791 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9fa9e-3226-4aef-ad0a-dff958c03346 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:49.433286 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9fa9e-3226-4aef-ad0a-dff958c03346 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:49.433736 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9fa9e-3226-4aef-ad0a-dff958c03346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:49.452542 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-03c9fa9e-3226-4aef-ad0a-dff958c03346 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:49.453931 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-03c9fa9e-3226-4aef-ad0a-dff958c03346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:49.513497 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1058/2108] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:49.521538 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090e61f-4410-4f20-b88a-4bbcf653b36b None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:49.521833 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090e61f-4410-4f20-b88a-4bbcf653b36b None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:49.522117 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090e61f-4410-4f20-b88a-4bbcf653b36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:49.539970 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-2090e61f-4410-4f20-b88a-4bbcf653b36b None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:49.541094 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-2090e61f-4410-4f20-b88a-4bbcf653b36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:49.549695 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1051/2109] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:49.554288 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9fa9e-3226-4aef-ad0a-dff958c03346 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:49.565235 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9fa9e-3226-4aef-ad0a-dff958c03346 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:49.569982 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d8a23-3ec7-438c-9566-a485d95b15d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:49.570737 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d8a23-3ec7-438c-9566-a485d95b15d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:49.571108 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d8a23-3ec7-438c-9566-a485d95b15d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:49.571454 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d8a23-3ec7-438c-9566-a485d95b15d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:49.572323 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d8a23-3ec7-438c-9566-a485d95b15d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:34:49.572699 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d8a23-3ec7-438c-9566-a485d95b15d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:49.574401 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d8a23-3ec7-438c-9566-a485d95b15d1 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:49.586094 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1059/2110] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:34:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:34:49.590505 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090e61f-4410-4f20-b88a-4bbcf653b36b None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:49.599485 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090e61f-4410-4f20-b88a-4bbcf653b36b None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:49.604140 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e9a58-2ed3-4662-97d6-0ea9c7dbafcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:49.604788 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e9a58-2ed3-4662-97d6-0ea9c7dbafcd admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:49.605070 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e9a58-2ed3-4662-97d6-0ea9c7dbafcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:49.605349 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e9a58-2ed3-4662-97d6-0ea9c7dbafcd admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:49.606115 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e9a58-2ed3-4662-97d6-0ea9c7dbafcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:49.608012 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e9a58-2ed3-4662-97d6-0ea9c7dbafcd admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:49.642119 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1052/2111] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:34:49 2021] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:34:49.643233 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d8a23-3ec7-438c-9566-a485d95b15d1 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:49.655004 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d8a23-3ec7-438c-9566-a485d95b15d1 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:49.717798 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfb460-5183-49cd-a0cf-ee1957b58fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:49.718520 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfb460-5183-49cd-a0cf-ee1957b58fef admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:49.718808 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfb460-5183-49cd-a0cf-ee1957b58fef admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:49.719089 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfb460-5183-49cd-a0cf-ee1957b58fef admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:49.719797 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedfb460-5183-49cd-a0cf-ee1957b58fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:49.722848 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedfb460-5183-49cd-a0cf-ee1957b58fef admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:49.745565 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1060/2112] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:34:49 2021] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:34:49.750266 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e9a58-2ed3-4662-97d6-0ea9c7dbafcd admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:49.760822 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e9a58-2ed3-4662-97d6-0ea9c7dbafcd admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:49.765779 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8358ed-36aa-44d3-8039-8ba54121e439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:49.766419 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8358ed-36aa-44d3-8039-8ba54121e439 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:49.766688 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8358ed-36aa-44d3-8039-8ba54121e439 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:49.766996 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8358ed-36aa-44d3-8039-8ba54121e439 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:49.767699 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8358ed-36aa-44d3-8039-8ba54121e439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:49.769294 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8358ed-36aa-44d3-8039-8ba54121e439 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:49.780049 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1053/2113] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:34:49 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:34:49.784832 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfb460-5183-49cd-a0cf-ee1957b58fef admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:49.796025 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfb460-5183-49cd-a0cf-ee1957b58fef admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:49.801227 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f1b46-1b0c-42e2-96af-37d6544dd1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:49.801928 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f1b46-1b0c-42e2-96af-37d6544dd1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:49.802308 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f1b46-1b0c-42e2-96af-37d6544dd1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:49.802483 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f1b46-1b0c-42e2-96af-37d6544dd1a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:49.803229 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f1b46-1b0c-42e2-96af-37d6544dd1a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:49.804792 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f1b46-1b0c-42e2-96af-37d6544dd1a7 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:49.815113 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1061/2114] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:34:49 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:34:49.819547 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8358ed-36aa-44d3-8039-8ba54121e439 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:49.830876 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8358ed-36aa-44d3-8039-8ba54121e439 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:49.835797 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e1fe1-021c-44fb-bd02-a9ebc9326bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:49.836675 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e1fe1-021c-44fb-bd02-a9ebc9326bc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:49.836982 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e1fe1-021c-44fb-bd02-a9ebc9326bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:49.837242 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e1fe1-021c-44fb-bd02-a9ebc9326bc8 admin admin] PATH_INFO: `/v3/projects/7a7eda7f1dae496baae6305ece0b99ae/users/e56b922770d6465d9250f5540cb6025d/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:49.854708 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e1fe1-021c-44fb-bd02-a9ebc9326bc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a7eda7f1dae496baae6305ece0b99ae, user_id=e56b922770d6465d9250f5540cb6025d, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:49.857395 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e1fe1-021c-44fb-bd02-a9ebc9326bc8 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:49.871186 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1054/2115] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:34:49 2021] PUT /identity/v3/projects/7a7eda7f1dae496baae6305ece0b99ae/users/e56b922770d6465d9250f5540cb6025d/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:34:49.882887 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3e4e6-a783-4de3-8a13-4ed5ee9ce3d6 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:49.883424 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3e4e6-a783-4de3-8a13-4ed5ee9ce3d6 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:49.883710 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3e4e6-a783-4de3-8a13-4ed5ee9ce3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:49.914830 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-65e3e4e6-a783-4de3-8a13-4ed5ee9ce3d6 None None] MFA Rules not processed for user `e56b922770d6465d9250f5540cb6025d`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:49.916290 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-65e3e4e6-a783-4de3-8a13-4ed5ee9ce3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:49.986498 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1062/2116] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:49 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:49.991003 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e1fe1-021c-44fb-bd02-a9ebc9326bc8 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:50.051465 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e1fe1-021c-44fb-bd02-a9ebc9326bc8 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:50.056833 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec658c3-8d8a-4eba-96db-7dab57d13228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:50.057614 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec658c3-8d8a-4eba-96db-7dab57d13228 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:50.057902 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec658c3-8d8a-4eba-96db-7dab57d13228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:50.058184 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec658c3-8d8a-4eba-96db-7dab57d13228 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:50.058889 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec658c3-8d8a-4eba-96db-7dab57d13228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:50.060789 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec658c3-8d8a-4eba-96db-7dab57d13228 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:50.086526 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1055/2117] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:34:49 2021] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:34:50.090648 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3e4e6-a783-4de3-8a13-4ed5ee9ce3d6 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:50.101088 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3e4e6-a783-4de3-8a13-4ed5ee9ce3d6 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:50.156497 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9c160-7933-4427-b438-75e87c5792f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:50.157186 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9c160-7933-4427-b438-75e87c5792f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:50.157477 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9c160-7933-4427-b438-75e87c5792f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:50.157809 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9c160-7933-4427-b438-75e87c5792f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:50.158533 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9c160-7933-4427-b438-75e87c5792f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:50.160907 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9c160-7933-4427-b438-75e87c5792f1 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:50.184103 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1063/2118] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:34:50 2021] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:34:50.188835 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec658c3-8d8a-4eba-96db-7dab57d13228 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:50.199757 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec658c3-8d8a-4eba-96db-7dab57d13228 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:50.204775 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773ce9a-b5b5-4489-a188-51b5423cd043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:50.205450 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773ce9a-b5b5-4489-a188-51b5423cd043 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:50.206024 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773ce9a-b5b5-4489-a188-51b5423cd043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:50.206024 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773ce9a-b5b5-4489-a188-51b5423cd043 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:50.206771 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773ce9a-b5b5-4489-a188-51b5423cd043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:50.208357 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773ce9a-b5b5-4489-a188-51b5423cd043 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:50.220307 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1056/2119] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:34:50 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:34:50.224448 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9c160-7933-4427-b438-75e87c5792f1 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:50.237386 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9c160-7933-4427-b438-75e87c5792f1 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:50.243806 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571e65e-e13e-4e68-8c15-27af58433c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:50.244759 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571e65e-e13e-4e68-8c15-27af58433c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:50.245111 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571e65e-e13e-4e68-8c15-27af58433c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:50.245454 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571e65e-e13e-4e68-8c15-27af58433c48 admin admin] PATH_INFO: `/v3/projects/4d49165d5d9340e499c2ab741649fe41/users/24418da6bfe543618a113d88b3e2b0f1/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:50.270576 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571e65e-e13e-4e68-8c15-27af58433c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d49165d5d9340e499c2ab741649fe41, user_id=24418da6bfe543618a113d88b3e2b0f1, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:50.273810 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571e65e-e13e-4e68-8c15-27af58433c48 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:50.289837 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1064/2120] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:34:50 2021] PUT /identity/v3/projects/4d49165d5d9340e499c2ab741649fe41/users/24418da6bfe543618a113d88b3e2b0f1/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:34:50.293999 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773ce9a-b5b5-4489-a188-51b5423cd043 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:50.311102 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773ce9a-b5b5-4489-a188-51b5423cd043 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:50.382317 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97103e16-a842-4e47-b564-a63e797bd553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:50.383070 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97103e16-a842-4e47-b564-a63e797bd553 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:50.383575 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97103e16-a842-4e47-b564-a63e797bd553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:50.383871 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97103e16-a842-4e47-b564-a63e797bd553 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:50.384851 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97103e16-a842-4e47-b564-a63e797bd553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:50.386665 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97103e16-a842-4e47-b564-a63e797bd553 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:50.398110 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1057/2121] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:34:50 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:34:50.403163 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571e65e-e13e-4e68-8c15-27af58433c48 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:50.412608 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571e65e-e13e-4e68-8c15-27af58433c48 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:50.417212 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8feaa2-471a-4d64-88c0-895adf90d104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:50.418119 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8feaa2-471a-4d64-88c0-895adf90d104 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:50.418399 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8feaa2-471a-4d64-88c0-895adf90d104 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:50.418672 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8feaa2-471a-4d64-88c0-895adf90d104 admin admin] PATH_INFO: `/v3/projects/4d49165d5d9340e499c2ab741649fe41/users/24418da6bfe543618a113d88b3e2b0f1/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:50.420649 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8feaa2-471a-4d64-88c0-895adf90d104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d49165d5d9340e499c2ab741649fe41, user_id=24418da6bfe543618a113d88b3e2b0f1, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:50.423765 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8feaa2-471a-4d64-88c0-895adf90d104 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:50.434614 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1065/2122] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:34:50 2021] PUT /identity/v3/projects/4d49165d5d9340e499c2ab741649fe41/users/24418da6bfe543618a113d88b3e2b0f1/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:34:50.447474 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b323a-8c21-46b5-90d1-1bcd6678bef6 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:50.447762 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b323a-8c21-46b5-90d1-1bcd6678bef6 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:50.448042 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b323a-8c21-46b5-90d1-1bcd6678bef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:50.475180 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-bd0b323a-8c21-46b5-90d1-1bcd6678bef6 None None] MFA Rules not processed for user `24418da6bfe543618a113d88b3e2b0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:50.476499 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-bd0b323a-8c21-46b5-90d1-1bcd6678bef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:50.563969 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1058/2123] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:50 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:34:50.576456 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8feaa2-471a-4d64-88c0-895adf90d104 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:50.581039 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-6a8feaa2-471a-4d64-88c0-895adf90d104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:50.655093 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8feaa2-471a-4d64-88c0-895adf90d104 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:50.660182 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55516a3-db88-4688-8e3a-70b1d2bd8fee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:50.660975 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55516a3-db88-4688-8e3a-70b1d2bd8fee service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:50.661272 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55516a3-db88-4688-8e3a-70b1d2bd8fee service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:50.661585 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55516a3-db88-4688-8e3a-70b1d2bd8fee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:50.725472 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55516a3-db88-4688-8e3a-70b1d2bd8fee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:50.726906 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55516a3-db88-4688-8e3a-70b1d2bd8fee service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:50.736189 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1066/2124] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:34:50 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:34:52.712725 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b323a-8c21-46b5-90d1-1bcd6678bef6 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:52.714882 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-bd0b323a-8c21-46b5-90d1-1bcd6678bef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:52.782210 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b323a-8c21-46b5-90d1-1bcd6678bef6 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:52.786801 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2aaa05-0beb-4977-9bce-804fb8340cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:52.787663 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2aaa05-0beb-4977-9bce-804fb8340cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:52.787948 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2aaa05-0beb-4977-9bce-804fb8340cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:52.788224 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2aaa05-0beb-4977-9bce-804fb8340cca admin admin] PATH_INFO: `/v3/users/fa9a3c47d78d457fb89f9240c901dbaa` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:52.789440 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2aaa05-0beb-4977-9bce-804fb8340cca admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa9a3c47d78d457fb89f9240c901dbaa)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:52.791816 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2aaa05-0beb-4977-9bce-804fb8340cca admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:52.839553 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-1e2aaa05-0beb-4977-9bce-804fb8340cca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa9a3c47d78d457fb89f9240c901dbaa'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:52.846186 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-1e2aaa05-0beb-4977-9bce-804fb8340cca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa9a3c47d78d457fb89f9240c901dbaa'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:52.846846 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-1e2aaa05-0beb-4977-9bce-804fb8340cca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa9a3c47d78d457fb89f9240c901dbaa'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:52.858212 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-1e2aaa05-0beb-4977-9bce-804fb8340cca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa9a3c47d78d457fb89f9240c901dbaa'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:52.865605 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-1e2aaa05-0beb-4977-9bce-804fb8340cca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa9a3c47d78d457fb89f9240c901dbaa'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:52.871527 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1059/2125] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:34:52 2021] DELETE /identity/v3/users/fa9a3c47d78d457fb89f9240c901dbaa => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:34:52.876707 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfd8a4-cef1-4188-ae3d-35e215a494ce None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:52.877234 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfd8a4-cef1-4188-ae3d-35e215a494ce None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:52.877330 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfd8a4-cef1-4188-ae3d-35e215a494ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:52.897737 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-6cbfd8a4-cef1-4188-ae3d-35e215a494ce None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:52.898995 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-6cbfd8a4-cef1-4188-ae3d-35e215a494ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:52.968375 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1067/2126] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:52.979401 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2aaa05-0beb-4977-9bce-804fb8340cca admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:52.981211 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-1e2aaa05-0beb-4977-9bce-804fb8340cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:53.044512 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2aaa05-0beb-4977-9bce-804fb8340cca admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:53.049529 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c203448-f6e5-4994-be51-ba5e39de6b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:53.050252 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c203448-f6e5-4994-be51-ba5e39de6b21 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:53.050541 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c203448-f6e5-4994-be51-ba5e39de6b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:53.050822 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c203448-f6e5-4994-be51-ba5e39de6b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:53.062859 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c203448-f6e5-4994-be51-ba5e39de6b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:53.064288 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c203448-f6e5-4994-be51-ba5e39de6b21 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:53.074230 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1060/2127] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:34:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:34:53.376727 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbfd8a4-cef1-4188-ae3d-35e215a494ce None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:53.378285 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-6cbfd8a4-cef1-4188-ae3d-35e215a494ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:53.392334 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbfd8a4-cef1-4188-ae3d-35e215a494ce None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:53.396972 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc3948-281c-44d9-88a2-f48a68f01c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:53.397867 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc3948-281c-44d9-88a2-f48a68f01c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:53.398153 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc3948-281c-44d9-88a2-f48a68f01c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:53.398455 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc3948-281c-44d9-88a2-f48a68f01c56 admin admin] PATH_INFO: `/v3/projects/73ee0d5a0a5d462a90cebc6c5eb8676b` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:53.399636 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc3948-281c-44d9-88a2-f48a68f01c56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73ee0d5a0a5d462a90cebc6c5eb8676b)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:53.401542 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc3948-281c-44d9-88a2-f48a68f01c56 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:53.448612 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-f1dc3948-281c-44d9-88a2-f48a68f01c56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73ee0d5a0a5d462a90cebc6c5eb8676b', 'request_id': 'req-f1dc3948-281c-44d9-88a2-f48a68f01c56'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:53.454536 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-f1dc3948-281c-44d9-88a2-f48a68f01c56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73ee0d5a0a5d462a90cebc6c5eb8676b', 'request_id': 'req-f1dc3948-281c-44d9-88a2-f48a68f01c56'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:53.461423 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-f1dc3948-281c-44d9-88a2-f48a68f01c56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73ee0d5a0a5d462a90cebc6c5eb8676b', 'request_id': 'req-f1dc3948-281c-44d9-88a2-f48a68f01c56'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:53.472203 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-f1dc3948-281c-44d9-88a2-f48a68f01c56 admin admin] The token cache is being invalidate because project 73ee0d5a0a5d462a90cebc6c5eb8676b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:34:53.472501 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-f1dc3948-281c-44d9-88a2-f48a68f01c56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:53.473113 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-f1dc3948-281c-44d9-88a2-f48a68f01c56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:34:53.474650 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1068/2128] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:34:53 2021] DELETE /identity/v3/projects/73ee0d5a0a5d462a90cebc6c5eb8676b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:34:53.480227 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcd074-e592-46eb-9a35-ffdd1a3ea942 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:53.480518 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcd074-e592-46eb-9a35-ffdd1a3ea942 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:53.480824 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcd074-e592-46eb-9a35-ffdd1a3ea942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:53.498371 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-ebdcd074-e592-46eb-9a35-ffdd1a3ea942 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:53.500048 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-ebdcd074-e592-46eb-9a35-ffdd1a3ea942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:53.558403 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1061/2129] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:53.566866 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d648bb-f106-4f68-b0be-9fae83a91b93 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:53.567157 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d648bb-f106-4f68-b0be-9fae83a91b93 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:53.567438 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d648bb-f106-4f68-b0be-9fae83a91b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:53.586047 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-b9d648bb-f106-4f68-b0be-9fae83a91b93 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:53.587278 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-b9d648bb-f106-4f68-b0be-9fae83a91b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:53.595502 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1069/2130] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:53.599620 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcd074-e592-46eb-9a35-ffdd1a3ea942 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:53.609084 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcd074-e592-46eb-9a35-ffdd1a3ea942 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:53.613756 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba74cf1-85ce-4fb1-b5a3-22546be25512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:53.614399 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba74cf1-85ce-4fb1-b5a3-22546be25512 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:53.614681 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba74cf1-85ce-4fb1-b5a3-22546be25512 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:53.614992 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba74cf1-85ce-4fb1-b5a3-22546be25512 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:53.615745 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba74cf1-85ce-4fb1-b5a3-22546be25512 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:34:53.616047 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba74cf1-85ce-4fb1-b5a3-22546be25512 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:53.617647 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba74cf1-85ce-4fb1-b5a3-22546be25512 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:53.629122 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1062/2131] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:34:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:34:53.633454 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d648bb-f106-4f68-b0be-9fae83a91b93 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:53.642917 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d648bb-f106-4f68-b0be-9fae83a91b93 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:53.647495 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17780a77-6128-4ec2-ae68-0b83cdf29dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:53.648133 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17780a77-6128-4ec2-ae68-0b83cdf29dee admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:53.648413 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17780a77-6128-4ec2-ae68-0b83cdf29dee admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:53.648687 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17780a77-6128-4ec2-ae68-0b83cdf29dee admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:53.649380 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17780a77-6128-4ec2-ae68-0b83cdf29dee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:53.651272 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17780a77-6128-4ec2-ae68-0b83cdf29dee admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:53.675371 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1070/2132] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:34:53 2021] POST /identity/v3/projects => generated 375 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:34:53.679794 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba74cf1-85ce-4fb1-b5a3-22546be25512 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:53.690378 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba74cf1-85ce-4fb1-b5a3-22546be25512 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:53.743158 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332aa6c-1546-4e57-a439-63cc62e55ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:53.743814 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332aa6c-1546-4e57-a439-63cc62e55ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:53.744096 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332aa6c-1546-4e57-a439-63cc62e55ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:53.744372 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332aa6c-1546-4e57-a439-63cc62e55ca8 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:53.745139 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332aa6c-1546-4e57-a439-63cc62e55ca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:53.747114 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332aa6c-1546-4e57-a439-63cc62e55ca8 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:53.767351 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1063/2133] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:34:53 2021] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:34:53.771274 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17780a77-6128-4ec2-ae68-0b83cdf29dee admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:53.781291 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17780a77-6128-4ec2-ae68-0b83cdf29dee admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:53.786095 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58483023-a587-4408-9f03-08e28184ee21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:53.786756 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58483023-a587-4408-9f03-08e28184ee21 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:53.787035 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58483023-a587-4408-9f03-08e28184ee21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:53.787311 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58483023-a587-4408-9f03-08e28184ee21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:53.788044 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58483023-a587-4408-9f03-08e28184ee21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:53.789661 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58483023-a587-4408-9f03-08e28184ee21 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:53.802916 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1071/2134] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:34:53 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:34:53.807441 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332aa6c-1546-4e57-a439-63cc62e55ca8 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:53.817670 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332aa6c-1546-4e57-a439-63cc62e55ca8 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:53.822229 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb960d31-e96d-46cf-b251-96e89283ab94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:53.822885 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb960d31-e96d-46cf-b251-96e89283ab94 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:53.823166 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb960d31-e96d-46cf-b251-96e89283ab94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:53.823436 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb960d31-e96d-46cf-b251-96e89283ab94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:53.824169 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb960d31-e96d-46cf-b251-96e89283ab94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:53.825784 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb960d31-e96d-46cf-b251-96e89283ab94 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:53.836461 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1064/2135] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:34:53 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:34:53.840755 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58483023-a587-4408-9f03-08e28184ee21 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:53.851410 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58483023-a587-4408-9f03-08e28184ee21 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:53.856019 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432edc7-794c-41d1-8a25-2c37585cc5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:53.856897 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432edc7-794c-41d1-8a25-2c37585cc5bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:53.857185 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432edc7-794c-41d1-8a25-2c37585cc5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:53.857463 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432edc7-794c-41d1-8a25-2c37585cc5bb admin admin] PATH_INFO: `/v3/projects/03f6d10a5bd14e329dcb0458758cea69/users/f0584a7760ad462591f021400d2c37cd/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:53.872268 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432edc7-794c-41d1-8a25-2c37585cc5bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=03f6d10a5bd14e329dcb0458758cea69, user_id=f0584a7760ad462591f021400d2c37cd, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:53.875065 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432edc7-794c-41d1-8a25-2c37585cc5bb admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:53.888014 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1072/2136] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:34:53 2021] PUT /identity/v3/projects/03f6d10a5bd14e329dcb0458758cea69/users/f0584a7760ad462591f021400d2c37cd/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:34:53.898670 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8804af-67e8-4685-a738-c3d8910ed796 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:53.898965 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8804af-67e8-4685-a738-c3d8910ed796 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:53.899245 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8804af-67e8-4685-a738-c3d8910ed796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:53.925548 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-fd8804af-67e8-4685-a738-c3d8910ed796 None None] MFA Rules not processed for user `f0584a7760ad462591f021400d2c37cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:34:53.926734 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-fd8804af-67e8-4685-a738-c3d8910ed796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:53.988823 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1065/2137] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:34:53 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:34:53.998739 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432edc7-794c-41d1-8a25-2c37585cc5bb admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:54.000475 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-e432edc7-794c-41d1-8a25-2c37585cc5bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:54.056084 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432edc7-794c-41d1-8a25-2c37585cc5bb admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:54.059662 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5aa90-df5e-49e5-974c-83b3015e1cbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:54.060302 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5aa90-df5e-49e5-974c-83b3015e1cbe service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:54.060587 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5aa90-df5e-49e5-974c-83b3015e1cbe service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:54.060868 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5aa90-df5e-49e5-974c-83b3015e1cbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:54.069455 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5aa90-df5e-49e5-974c-83b3015e1cbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:54.070898 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5aa90-df5e-49e5-974c-83b3015e1cbe service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:54.080313 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1073/2138] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:34:53 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:34:56.351042 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8804af-67e8-4685-a738-c3d8910ed796 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:34:56.360903 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8804af-67e8-4685-a738-c3d8910ed796 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:34:56.364713 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb5a49-438c-4fd8-910e-fa7931ea7c10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:34:56.365438 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb5a49-438c-4fd8-910e-fa7931ea7c10 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:34:56.365836 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb5a49-438c-4fd8-910e-fa7931ea7c10 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:34:56.366189 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb5a49-438c-4fd8-910e-fa7931ea7c10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:34:56.368013 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4adb5a49-438c-4fd8-910e-fa7931ea7c10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:34:56.430336 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb5a49-438c-4fd8-910e-fa7931ea7c10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:34:56.432018 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb5a49-438c-4fd8-910e-fa7931ea7c10 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:34:56.442031 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1066/2139] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:34:56 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:35:08.843500 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc43b7-f921-47c5-8010-a122a553c509 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:08.844000 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc43b7-f921-47c5-8010-a122a553c509 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:08.844291 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc43b7-f921-47c5-8010-a122a553c509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:08.862790 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-34fc43b7-f921-47c5-8010-a122a553c509 None None] MFA Rules not processed for user `56895529b11b4236bccb5956a8ccb5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:08.863998 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-34fc43b7-f921-47c5-8010-a122a553c509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:08.920170 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1074/2140] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Oct 27 01:35:08 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:35:08.985865 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb5a49-438c-4fd8-910e-fa7931ea7c10 service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:08.987410 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4adb5a49-438c-4fd8-910e-fa7931ea7c10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:09.058558 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb5a49-438c-4fd8-910e-fa7931ea7c10 service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:09.063983 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd788b4-3578-40be-b05c-241f856781ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f386f358fdb241f5a529a2cf3d839201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:09.064775 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd788b4-3578-40be-b05c-241f856781ca service swift] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:09.065060 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd788b4-3578-40be-b05c-241f856781ca service swift] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:09.065343 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd788b4-3578-40be-b05c-241f856781ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:09.074998 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd788b4-3578-40be-b05c-241f856781ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:09.077313 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd788b4-3578-40be-b05c-241f856781ca service swift] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:09.087985 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1067/2141] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Oct 27 01:35:08 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:35:19.683876 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428ad8b-9894-4260-85af-1c5565b385cd None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:19.684628 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428ad8b-9894-4260-85af-1c5565b385cd None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:19.684628 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428ad8b-9894-4260-85af-1c5565b385cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:19.757543 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-2428ad8b-9894-4260-85af-1c5565b385cd None None] MFA Rules not processed for user `56895529b11b4236bccb5956a8ccb5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:19.757543 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-2428ad8b-9894-4260-85af-1c5565b385cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:19.800496 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1075/2142] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Oct 27 01:35:19 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:35:19.815614 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd788b4-3578-40be-b05c-241f856781ca service swift] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:19.897073 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd788b4-3578-40be-b05c-241f856781ca service swift] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:19.908284 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2c3d8-986a-493d-bac6-b050cc3a0419 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f386f358fdb241f5a529a2cf3d839201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:19.909141 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2c3d8-986a-493d-bac6-b050cc3a0419 service swift] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:19.909531 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2c3d8-986a-493d-bac6-b050cc3a0419 service swift] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:19.909815 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2c3d8-986a-493d-bac6-b050cc3a0419 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:19.934899 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2c3d8-986a-493d-bac6-b050cc3a0419 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:19.937357 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2c3d8-986a-493d-bac6-b050cc3a0419 service swift] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:19.952258 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1068/2143] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Oct 27 01:35:19 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:35:22.109264 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428ad8b-9894-4260-85af-1c5565b385cd None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:22.110726 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-2428ad8b-9894-4260-85af-1c5565b385cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:22.528437 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428ad8b-9894-4260-85af-1c5565b385cd None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:22.534710 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98026875-7ecc-460a-918e-5492e86c7055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:22.536288 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98026875-7ecc-460a-918e-5492e86c7055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:22.536812 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98026875-7ecc-460a-918e-5492e86c7055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:22.537307 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98026875-7ecc-460a-918e-5492e86c7055 admin admin] PATH_INFO: `/v3/users/061e53dcac61459ca6cf7899e89791e8` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:22.538945 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98026875-7ecc-460a-918e-5492e86c7055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=061e53dcac61459ca6cf7899e89791e8)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:22.541272 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98026875-7ecc-460a-918e-5492e86c7055 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:22.621980 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-98026875-7ecc-460a-918e-5492e86c7055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '061e53dcac61459ca6cf7899e89791e8'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:22.636657 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-98026875-7ecc-460a-918e-5492e86c7055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '061e53dcac61459ca6cf7899e89791e8'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:22.648456 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-98026875-7ecc-460a-918e-5492e86c7055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '061e53dcac61459ca6cf7899e89791e8'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:22.649519 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-98026875-7ecc-460a-918e-5492e86c7055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '061e53dcac61459ca6cf7899e89791e8'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:22.670609 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-98026875-7ecc-460a-918e-5492e86c7055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '061e53dcac61459ca6cf7899e89791e8'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:22.680615 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1076/2144] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:35:22 2021] DELETE /identity/v3/users/061e53dcac61459ca6cf7899e89791e8 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:35:22.685291 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d91c41-5084-4f11-ba33-7f2af02e0980 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:22.686908 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d91c41-5084-4f11-ba33-7f2af02e0980 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:22.687353 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d91c41-5084-4f11-ba33-7f2af02e0980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:22.735919 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-98d91c41-5084-4f11-ba33-7f2af02e0980 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:22.737151 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-98d91c41-5084-4f11-ba33-7f2af02e0980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:22.806128 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1069/2145] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:35:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:35:22.818980 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98026875-7ecc-460a-918e-5492e86c7055 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:22.821043 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-98026875-7ecc-460a-918e-5492e86c7055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:22.969842 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98026875-7ecc-460a-918e-5492e86c7055 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:22.977737 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c798f-e5b0-412a-98cd-a78da5ceb278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:22.978571 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c798f-e5b0-412a-98cd-a78da5ceb278 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:22.978863 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c798f-e5b0-412a-98cd-a78da5ceb278 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:22.979147 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c798f-e5b0-412a-98cd-a78da5ceb278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:22.999889 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c798f-e5b0-412a-98cd-a78da5ceb278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:23.001337 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c798f-e5b0-412a-98cd-a78da5ceb278 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:23.029685 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1077/2146] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:35:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:35:23.570317 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d91c41-5084-4f11-ba33-7f2af02e0980 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:23.572149 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-98d91c41-5084-4f11-ba33-7f2af02e0980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:23.597463 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d91c41-5084-4f11-ba33-7f2af02e0980 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:23.608959 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b1794-973f-4aca-bc0b-a3063120a113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:23.610233 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b1794-973f-4aca-bc0b-a3063120a113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:23.611893 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b1794-973f-4aca-bc0b-a3063120a113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:23.612392 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b1794-973f-4aca-bc0b-a3063120a113 admin admin] PATH_INFO: `/v3/projects/64b8db1d4dd94cfbbda22012a2720b65` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:23.614803 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b1794-973f-4aca-bc0b-a3063120a113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b8db1d4dd94cfbbda22012a2720b65)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:23.618651 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b1794-973f-4aca-bc0b-a3063120a113 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:23.713864 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-815b1794-973f-4aca-bc0b-a3063120a113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b8db1d4dd94cfbbda22012a2720b65', 'request_id': 'req-815b1794-973f-4aca-bc0b-a3063120a113'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:23.753575 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-815b1794-973f-4aca-bc0b-a3063120a113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b8db1d4dd94cfbbda22012a2720b65', 'request_id': 'req-815b1794-973f-4aca-bc0b-a3063120a113'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:23.763607 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-815b1794-973f-4aca-bc0b-a3063120a113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b8db1d4dd94cfbbda22012a2720b65', 'request_id': 'req-815b1794-973f-4aca-bc0b-a3063120a113'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:23.793697 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-815b1794-973f-4aca-bc0b-a3063120a113 admin admin] The token cache is being invalidate because project 64b8db1d4dd94cfbbda22012a2720b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:35:23.795576 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-815b1794-973f-4aca-bc0b-a3063120a113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:23.796487 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-815b1794-973f-4aca-bc0b-a3063120a113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:23.802419 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1070/2147] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:35:23 2021] DELETE /identity/v3/projects/64b8db1d4dd94cfbbda22012a2720b65 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:35:23.810394 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf25a07-b703-4b0d-9cbd-ed987a18bb7c None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:23.812490 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf25a07-b703-4b0d-9cbd-ed987a18bb7c None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:23.812934 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf25a07-b703-4b0d-9cbd-ed987a18bb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:23.942314 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-dbf25a07-b703-4b0d-9cbd-ed987a18bb7c None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:23.943629 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-dbf25a07-b703-4b0d-9cbd-ed987a18bb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:24.130025 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1078/2148] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:35:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:35:24.138929 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d22696-9cd8-4801-bd15-620709a4883f None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:24.140080 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d22696-9cd8-4801-bd15-620709a4883f None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:24.140568 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d22696-9cd8-4801-bd15-620709a4883f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:24.161774 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-23d22696-9cd8-4801-bd15-620709a4883f None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:24.163485 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-23d22696-9cd8-4801-bd15-620709a4883f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:24.175268 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1071/2149] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:35:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:35:24.179849 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf25a07-b703-4b0d-9cbd-ed987a18bb7c None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:24.190303 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf25a07-b703-4b0d-9cbd-ed987a18bb7c None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:24.199410 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab20f9-1619-4cb8-b694-be12f0ae6eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:24.199848 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab20f9-1619-4cb8-b694-be12f0ae6eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:24.200194 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab20f9-1619-4cb8-b694-be12f0ae6eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:24.200547 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab20f9-1619-4cb8-b694-be12f0ae6eb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:24.201416 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab20f9-1619-4cb8-b694-be12f0ae6eb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:35:24.204317 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab20f9-1619-4cb8-b694-be12f0ae6eb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:24.205999 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab20f9-1619-4cb8-b694-be12f0ae6eb4 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:24.233678 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1079/2150] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:35:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:35:24.234800 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d22696-9cd8-4801-bd15-620709a4883f None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:24.251554 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d22696-9cd8-4801-bd15-620709a4883f None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:24.263448 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8e5fc-b395-4b0d-b02e-b61a21218ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:24.264399 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8e5fc-b395-4b0d-b02e-b61a21218ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:24.266146 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8e5fc-b395-4b0d-b02e-b61a21218ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:24.266447 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8e5fc-b395-4b0d-b02e-b61a21218ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:24.267180 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8e5fc-b395-4b0d-b02e-b61a21218ca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:24.269111 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8e5fc-b395-4b0d-b02e-b61a21218ca4 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:24.329031 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1072/2151] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:35:24 2021] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:35:24.330743 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab20f9-1619-4cb8-b694-be12f0ae6eb4 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:24.360257 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab20f9-1619-4cb8-b694-be12f0ae6eb4 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:24.445071 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403df198-0443-4a55-b57f-57a9cbfd0356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:24.446450 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403df198-0443-4a55-b57f-57a9cbfd0356 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:24.448984 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403df198-0443-4a55-b57f-57a9cbfd0356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:24.449718 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403df198-0443-4a55-b57f-57a9cbfd0356 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:24.451089 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403df198-0443-4a55-b57f-57a9cbfd0356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:24.460365 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403df198-0443-4a55-b57f-57a9cbfd0356 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:24.508578 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1080/2152] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:35:24 2021] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:35:24.512897 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8e5fc-b395-4b0d-b02e-b61a21218ca4 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:24.532016 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8e5fc-b395-4b0d-b02e-b61a21218ca4 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:24.539659 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a47ba3-c83c-4037-be75-86e46a086996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:24.540781 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a47ba3-c83c-4037-be75-86e46a086996 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:24.541239 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a47ba3-c83c-4037-be75-86e46a086996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:24.541701 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a47ba3-c83c-4037-be75-86e46a086996 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:24.542597 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a47ba3-c83c-4037-be75-86e46a086996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:24.546020 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a47ba3-c83c-4037-be75-86e46a086996 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:24.569609 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1073/2153] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:35:24 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:35:24.573022 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403df198-0443-4a55-b57f-57a9cbfd0356 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:24.587845 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403df198-0443-4a55-b57f-57a9cbfd0356 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:24.596331 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca75d9-7cca-4d55-8510-e132a0e842b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:24.596473 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca75d9-7cca-4d55-8510-e132a0e842b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:24.596755 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca75d9-7cca-4d55-8510-e132a0e842b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:24.597041 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca75d9-7cca-4d55-8510-e132a0e842b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:24.597839 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca75d9-7cca-4d55-8510-e132a0e842b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:24.599543 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca75d9-7cca-4d55-8510-e132a0e842b6 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:24.618305 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1081/2154] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:35:24 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:35:24.622161 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a47ba3-c83c-4037-be75-86e46a086996 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:24.638686 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a47ba3-c83c-4037-be75-86e46a086996 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:24.650906 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696b553-1662-4d39-bb15-8e9537c78356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:24.650906 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696b553-1662-4d39-bb15-8e9537c78356 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:24.650906 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696b553-1662-4d39-bb15-8e9537c78356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:24.650906 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696b553-1662-4d39-bb15-8e9537c78356 admin admin] PATH_INFO: `/v3/projects/4c37f41c8f0a43fab1a2522b49a0c29d/users/aa28ca9b9ed24a90b530ebc54a7b44f2/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:24.669473 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696b553-1662-4d39-bb15-8e9537c78356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c37f41c8f0a43fab1a2522b49a0c29d, user_id=aa28ca9b9ed24a90b530ebc54a7b44f2, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:24.672764 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696b553-1662-4d39-bb15-8e9537c78356 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:24.697626 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1074/2155] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:35:24 2021] PUT /identity/v3/projects/4c37f41c8f0a43fab1a2522b49a0c29d/users/aa28ca9b9ed24a90b530ebc54a7b44f2/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:35:24.710212 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f800944-502e-4c3f-8fb7-1a99c2712d97 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:24.710212 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f800944-502e-4c3f-8fb7-1a99c2712d97 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:24.710212 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f800944-502e-4c3f-8fb7-1a99c2712d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:24.785606 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-6f800944-502e-4c3f-8fb7-1a99c2712d97 None None] MFA Rules not processed for user `aa28ca9b9ed24a90b530ebc54a7b44f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:24.787183 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-6f800944-502e-4c3f-8fb7-1a99c2712d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:24.947391 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1082/2156] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:35:24 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:35:24.960451 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696b553-1662-4d39-bb15-8e9537c78356 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:24.962186 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-c696b553-1662-4d39-bb15-8e9537c78356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:25.107707 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696b553-1662-4d39-bb15-8e9537c78356 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:25.117030 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22c469-3fcc-4027-b0e1-b165508245f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:25.117724 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22c469-3fcc-4027-b0e1-b165508245f5 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:25.118029 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22c469-3fcc-4027-b0e1-b165508245f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:25.118303 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22c469-3fcc-4027-b0e1-b165508245f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:25.138631 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22c469-3fcc-4027-b0e1-b165508245f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:25.151221 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22c469-3fcc-4027-b0e1-b165508245f5 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:25.176568 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1075/2157] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:35:24 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:35:25.210486 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f800944-502e-4c3f-8fb7-1a99c2712d97 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:25.292528 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f800944-502e-4c3f-8fb7-1a99c2712d97 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:25.301256 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84eb8e-f9c0-43da-92bf-2a104c36248f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:25.302773 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84eb8e-f9c0-43da-92bf-2a104c36248f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:25.303284 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84eb8e-f9c0-43da-92bf-2a104c36248f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:25.303835 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84eb8e-f9c0-43da-92bf-2a104c36248f admin admin] PATH_INFO: `/v3/users/aa28ca9b9ed24a90b530ebc54a7b44f2` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:25.305428 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84eb8e-f9c0-43da-92bf-2a104c36248f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa28ca9b9ed24a90b530ebc54a7b44f2)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:25.308814 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84eb8e-f9c0-43da-92bf-2a104c36248f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:25.381824 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-ff84eb8e-f9c0-43da-92bf-2a104c36248f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa28ca9b9ed24a90b530ebc54a7b44f2'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:25.392318 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-ff84eb8e-f9c0-43da-92bf-2a104c36248f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa28ca9b9ed24a90b530ebc54a7b44f2'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:25.402369 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-ff84eb8e-f9c0-43da-92bf-2a104c36248f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa28ca9b9ed24a90b530ebc54a7b44f2'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:25.403505 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-ff84eb8e-f9c0-43da-92bf-2a104c36248f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa28ca9b9ed24a90b530ebc54a7b44f2'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:25.422927 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-ff84eb8e-f9c0-43da-92bf-2a104c36248f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa28ca9b9ed24a90b530ebc54a7b44f2'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:25.428565 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1083/2158] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:35:25 2021] DELETE /identity/v3/users/aa28ca9b9ed24a90b530ebc54a7b44f2 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:35:25.433471 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158306d2-96cf-4784-9811-b5f941989fbb None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:25.433782 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158306d2-96cf-4784-9811-b5f941989fbb None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:25.434331 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158306d2-96cf-4784-9811-b5f941989fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:25.462546 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-158306d2-96cf-4784-9811-b5f941989fbb None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:25.463792 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-158306d2-96cf-4784-9811-b5f941989fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:25.612202 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1076/2159] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:35:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:35:25.622746 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84eb8e-f9c0-43da-92bf-2a104c36248f admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:25.624993 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-ff84eb8e-f9c0-43da-92bf-2a104c36248f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:25.810274 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84eb8e-f9c0-43da-92bf-2a104c36248f admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:25.819601 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27baa1-50ad-44dd-af2f-8d6a08d41307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:25.820961 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27baa1-50ad-44dd-af2f-8d6a08d41307 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:25.821379 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27baa1-50ad-44dd-af2f-8d6a08d41307 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:25.821975 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27baa1-50ad-44dd-af2f-8d6a08d41307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:25.842949 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27baa1-50ad-44dd-af2f-8d6a08d41307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:25.844418 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27baa1-50ad-44dd-af2f-8d6a08d41307 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:25.858920 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1084/2160] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:35:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:35:26.396904 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158306d2-96cf-4784-9811-b5f941989fbb None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:26.398724 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-158306d2-96cf-4784-9811-b5f941989fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:26.424864 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158306d2-96cf-4784-9811-b5f941989fbb None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:26.440837 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1ffc3-320b-4c90-bb43-cbb3d4ee4008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:26.442663 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1ffc3-320b-4c90-bb43-cbb3d4ee4008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:26.444631 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1ffc3-320b-4c90-bb43-cbb3d4ee4008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:26.445061 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1ffc3-320b-4c90-bb43-cbb3d4ee4008 admin admin] PATH_INFO: `/v3/projects/4c37f41c8f0a43fab1a2522b49a0c29d` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:26.449189 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1ffc3-320b-4c90-bb43-cbb3d4ee4008 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c37f41c8f0a43fab1a2522b49a0c29d)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:26.452280 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1ffc3-320b-4c90-bb43-cbb3d4ee4008 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:26.541274 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b8e1ffc3-320b-4c90-bb43-cbb3d4ee4008 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c37f41c8f0a43fab1a2522b49a0c29d', 'request_id': 'req-b8e1ffc3-320b-4c90-bb43-cbb3d4ee4008'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:26.551807 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b8e1ffc3-320b-4c90-bb43-cbb3d4ee4008 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c37f41c8f0a43fab1a2522b49a0c29d', 'request_id': 'req-b8e1ffc3-320b-4c90-bb43-cbb3d4ee4008'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:26.584146 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b8e1ffc3-320b-4c90-bb43-cbb3d4ee4008 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c37f41c8f0a43fab1a2522b49a0c29d', 'request_id': 'req-b8e1ffc3-320b-4c90-bb43-cbb3d4ee4008'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:26.615216 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b8e1ffc3-320b-4c90-bb43-cbb3d4ee4008 admin admin] The token cache is being invalidate because project 4c37f41c8f0a43fab1a2522b49a0c29d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:35:26.615216 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b8e1ffc3-320b-4c90-bb43-cbb3d4ee4008 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:26.615216 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b8e1ffc3-320b-4c90-bb43-cbb3d4ee4008 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:26.630289 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1077/2161] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:35:26 2021] DELETE /identity/v3/projects/4c37f41c8f0a43fab1a2522b49a0c29d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:35:26.637431 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536faa7f-a81f-4025-a030-c24835a99f4a None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:26.638513 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536faa7f-a81f-4025-a030-c24835a99f4a None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:26.638874 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536faa7f-a81f-4025-a030-c24835a99f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:26.689739 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-536faa7f-a81f-4025-a030-c24835a99f4a None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:26.690998 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-536faa7f-a81f-4025-a030-c24835a99f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:26.793939 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1085/2162] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:35:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:35:26.795680 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761aefa-a96f-48bc-bd6f-c40ee4cd083e None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:26.796440 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761aefa-a96f-48bc-bd6f-c40ee4cd083e None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:26.796852 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761aefa-a96f-48bc-bd6f-c40ee4cd083e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:26.879892 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536faa7f-a81f-4025-a030-c24835a99f4a None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:26.881605 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-536faa7f-a81f-4025-a030-c24835a99f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:26.892683 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-8761aefa-a96f-48bc-bd6f-c40ee4cd083e None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:26.899135 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-8761aefa-a96f-48bc-bd6f-c40ee4cd083e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:26.917465 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536faa7f-a81f-4025-a030-c24835a99f4a None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:26.931706 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3855f92-4fd4-43f3-92f4-8f907038b760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:26.932755 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3855f92-4fd4-43f3-92f4-8f907038b760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:26.933153 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3855f92-4fd4-43f3-92f4-8f907038b760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:26.933583 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3855f92-4fd4-43f3-92f4-8f907038b760 admin admin] PATH_INFO: `/v3/users/f0584a7760ad462591f021400d2c37cd` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:26.941613 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3855f92-4fd4-43f3-92f4-8f907038b760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0584a7760ad462591f021400d2c37cd)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:26.944586 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3855f92-4fd4-43f3-92f4-8f907038b760 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:26.948859 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1078/2163] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:35:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:35:26.956842 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761aefa-a96f-48bc-bd6f-c40ee4cd083e None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:26.977628 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761aefa-a96f-48bc-bd6f-c40ee4cd083e None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:26.987863 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b2574-deda-4dbf-86b4-a315c0891507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:26.988585 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b2574-deda-4dbf-86b4-a315c0891507 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:26.988950 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b2574-deda-4dbf-86b4-a315c0891507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:26.989215 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b2574-deda-4dbf-86b4-a315c0891507 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:26.990141 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b2574-deda-4dbf-86b4-a315c0891507 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:35:26.990828 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b2574-deda-4dbf-86b4-a315c0891507 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:27.008203 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b2574-deda-4dbf-86b4-a315c0891507 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:27.025395 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1079/2164] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:35:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:35:27.029775 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b2574-deda-4dbf-86b4-a315c0891507 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:27.060110 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b2574-deda-4dbf-86b4-a315c0891507 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:27.066662 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d52ae-0f9b-4ca9-a31d-64bd91943e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:27.067636 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d52ae-0f9b-4ca9-a31d-64bd91943e68 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:27.068181 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d52ae-0f9b-4ca9-a31d-64bd91943e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:27.073349 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d52ae-0f9b-4ca9-a31d-64bd91943e68 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:27.074446 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d52ae-0f9b-4ca9-a31d-64bd91943e68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:27.077351 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d52ae-0f9b-4ca9-a31d-64bd91943e68 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:27.100946 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-c3855f92-4fd4-43f3-92f4-8f907038b760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0584a7760ad462591f021400d2c37cd'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:27.113016 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-c3855f92-4fd4-43f3-92f4-8f907038b760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0584a7760ad462591f021400d2c37cd'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:27.120387 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1080/2165] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:35:27 2021] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:35:27.124742 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d52ae-0f9b-4ca9-a31d-64bd91943e68 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:27.136912 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-c3855f92-4fd4-43f3-92f4-8f907038b760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0584a7760ad462591f021400d2c37cd'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:27.138559 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-c3855f92-4fd4-43f3-92f4-8f907038b760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0584a7760ad462591f021400d2c37cd'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:27.173014 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-c3855f92-4fd4-43f3-92f4-8f907038b760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0584a7760ad462591f021400d2c37cd'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:27.181300 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1086/2166] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:35:26 2021] DELETE /identity/v3/users/f0584a7760ad462591f021400d2c37cd => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:35:27.186048 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d08deb-0c3c-4bac-9ea4-c13a67c6d99c None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:27.188421 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d08deb-0c3c-4bac-9ea4-c13a67c6d99c None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:27.191675 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d08deb-0c3c-4bac-9ea4-c13a67c6d99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:27.240026 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-a7d08deb-0c3c-4bac-9ea4-c13a67c6d99c None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:27.242781 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-a7d08deb-0c3c-4bac-9ea4-c13a67c6d99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:27.249018 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d52ae-0f9b-4ca9-a31d-64bd91943e68 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:27.370774 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f60e0a-7561-4708-ac82-04ddd8f13a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:27.371466 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f60e0a-7561-4708-ac82-04ddd8f13a35 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:27.371887 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1087/2167] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:35:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:35:27.372109 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f60e0a-7561-4708-ac82-04ddd8f13a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:27.372392 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f60e0a-7561-4708-ac82-04ddd8f13a35 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:27.374408 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f60e0a-7561-4708-ac82-04ddd8f13a35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:27.376405 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f60e0a-7561-4708-ac82-04ddd8f13a35 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:27.382480 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d08deb-0c3c-4bac-9ea4-c13a67c6d99c None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:27.383973 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-a7d08deb-0c3c-4bac-9ea4-c13a67c6d99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:27.421201 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1081/2168] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:35:27 2021] POST /identity/v3/users => generated 292 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:35:27.428796 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f60e0a-7561-4708-ac82-04ddd8f13a35 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:27.431637 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-c1f60e0a-7561-4708-ac82-04ddd8f13a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:27.444792 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f60e0a-7561-4708-ac82-04ddd8f13a35 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:27.450158 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821dc637-4e38-4da5-9ff0-79a444ba746d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:27.450848 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821dc637-4e38-4da5-9ff0-79a444ba746d admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:27.451321 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821dc637-4e38-4da5-9ff0-79a444ba746d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:27.451609 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821dc637-4e38-4da5-9ff0-79a444ba746d admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:27.452531 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821dc637-4e38-4da5-9ff0-79a444ba746d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:27.454198 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821dc637-4e38-4da5-9ff0-79a444ba746d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:27.470712 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1082/2169] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:35:27 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:35:27.471724 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821dc637-4e38-4da5-9ff0-79a444ba746d admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:27.483630 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821dc637-4e38-4da5-9ff0-79a444ba746d admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:27.488205 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57f344-e093-4fbb-96f8-d4b5b70dc79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:27.488802 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57f344-e093-4fbb-96f8-d4b5b70dc79f admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:27.489093 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57f344-e093-4fbb-96f8-d4b5b70dc79f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:27.489455 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57f344-e093-4fbb-96f8-d4b5b70dc79f admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:27.490211 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57f344-e093-4fbb-96f8-d4b5b70dc79f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:27.492049 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57f344-e093-4fbb-96f8-d4b5b70dc79f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:27.506995 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1083/2170] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:35:27 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:35:27.507982 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57f344-e093-4fbb-96f8-d4b5b70dc79f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:27.509128 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d08deb-0c3c-4bac-9ea4-c13a67c6d99c None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:27.519149 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57f344-e093-4fbb-96f8-d4b5b70dc79f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:27.524410 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cf888-a988-496a-8465-ff339a78304f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:27.526599 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cf888-a988-496a-8465-ff339a78304f admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:27.526599 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cf888-a988-496a-8465-ff339a78304f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:27.526599 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cf888-a988-496a-8465-ff339a78304f admin admin] PATH_INFO: `/v3/projects/e405517c4f1840b4a2e30ef7dccd2e4a/users/217b11f7f05845598980741885b4417e/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:27.535669 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50ae79-7b8f-463b-85e5-6642f9aac166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:27.539470 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50ae79-7b8f-463b-85e5-6642f9aac166 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:27.540019 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50ae79-7b8f-463b-85e5-6642f9aac166 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:27.540454 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50ae79-7b8f-463b-85e5-6642f9aac166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:27.543658 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2cf888-a988-496a-8465-ff339a78304f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e405517c4f1840b4a2e30ef7dccd2e4a, user_id=217b11f7f05845598980741885b4417e, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:27.546845 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2cf888-a988-496a-8465-ff339a78304f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:27.590786 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50ae79-7b8f-463b-85e5-6642f9aac166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:27.592196 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50ae79-7b8f-463b-85e5-6642f9aac166 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:27.624887 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1084/2171] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:35:27 2021] PUT /identity/v3/projects/e405517c4f1840b4a2e30ef7dccd2e4a/users/217b11f7f05845598980741885b4417e/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:35:27.627166 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87667bc2-04b7-4118-81b9-9e88664f3f16 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:27.627166 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87667bc2-04b7-4118-81b9-9e88664f3f16 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:27.627166 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87667bc2-04b7-4118-81b9-9e88664f3f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:27.677755 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1088/2172] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:35:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:35:27.726540 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-87667bc2-04b7-4118-81b9-9e88664f3f16 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:27.727800 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-87667bc2-04b7-4118-81b9-9e88664f3f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:27.875368 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1085/2173] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:35:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:35:27.887070 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50ae79-7b8f-463b-85e5-6642f9aac166 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:27.900703 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50ae79-7b8f-463b-85e5-6642f9aac166 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:28.031224 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554979cd-5f17-47bd-8c0e-733b391e353e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:28.032175 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554979cd-5f17-47bd-8c0e-733b391e353e service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:28.041661 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554979cd-5f17-47bd-8c0e-733b391e353e service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:28.042236 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554979cd-5f17-47bd-8c0e-733b391e353e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:28.090085 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554979cd-5f17-47bd-8c0e-733b391e353e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:28.097049 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554979cd-5f17-47bd-8c0e-733b391e353e service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:28.113646 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1089/2174] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:35:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:35:28.546778 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87667bc2-04b7-4118-81b9-9e88664f3f16 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:28.549026 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-87667bc2-04b7-4118-81b9-9e88664f3f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:28.569174 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87667bc2-04b7-4118-81b9-9e88664f3f16 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:28.591683 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca8a03-dc60-425c-aac6-6c80f6a6d656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:28.592916 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca8a03-dc60-425c-aac6-6c80f6a6d656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:28.593362 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca8a03-dc60-425c-aac6-6c80f6a6d656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:28.593841 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca8a03-dc60-425c-aac6-6c80f6a6d656 admin admin] PATH_INFO: `/v3/projects/03f6d10a5bd14e329dcb0458758cea69` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:28.595430 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca8a03-dc60-425c-aac6-6c80f6a6d656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03f6d10a5bd14e329dcb0458758cea69)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:28.597532 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca8a03-dc60-425c-aac6-6c80f6a6d656 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:28.680214 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-0dca8a03-dc60-425c-aac6-6c80f6a6d656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03f6d10a5bd14e329dcb0458758cea69', 'request_id': 'req-0dca8a03-dc60-425c-aac6-6c80f6a6d656'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:28.688072 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-0dca8a03-dc60-425c-aac6-6c80f6a6d656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03f6d10a5bd14e329dcb0458758cea69', 'request_id': 'req-0dca8a03-dc60-425c-aac6-6c80f6a6d656'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:28.721982 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-0dca8a03-dc60-425c-aac6-6c80f6a6d656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03f6d10a5bd14e329dcb0458758cea69', 'request_id': 'req-0dca8a03-dc60-425c-aac6-6c80f6a6d656'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:28.737808 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-0dca8a03-dc60-425c-aac6-6c80f6a6d656 admin admin] The token cache is being invalidate because project 03f6d10a5bd14e329dcb0458758cea69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:35:28.738239 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-0dca8a03-dc60-425c-aac6-6c80f6a6d656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:28.743330 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-0dca8a03-dc60-425c-aac6-6c80f6a6d656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:28.745382 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1086/2175] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:35:28 2021] DELETE /identity/v3/projects/03f6d10a5bd14e329dcb0458758cea69 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:35:28.753945 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed5585-b958-4b7c-8b00-7085e88a7451 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:28.754475 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed5585-b958-4b7c-8b00-7085e88a7451 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:28.754763 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed5585-b958-4b7c-8b00-7085e88a7451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:28.789946 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-1bed5585-b958-4b7c-8b00-7085e88a7451 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:28.792700 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-1bed5585-b958-4b7c-8b00-7085e88a7451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:28.925869 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1090/2176] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:35:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:35:28.927599 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce6bff-202e-4793-9f08-fb30779dcb51 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:28.927894 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce6bff-202e-4793-9f08-fb30779dcb51 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:28.928177 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce6bff-202e-4793-9f08-fb30779dcb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:28.983915 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-5cce6bff-202e-4793-9f08-fb30779dcb51 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:28.985256 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-5cce6bff-202e-4793-9f08-fb30779dcb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:29.042788 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1087/2177] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:35:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:35:29.049184 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed5585-b958-4b7c-8b00-7085e88a7451 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:29.063218 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed5585-b958-4b7c-8b00-7085e88a7451 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:29.076883 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f2eee-5d41-4729-958b-fce98f6c1418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:29.077600 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f2eee-5d41-4729-958b-fce98f6c1418 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:29.077889 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f2eee-5d41-4729-958b-fce98f6c1418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:29.078167 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f2eee-5d41-4729-958b-fce98f6c1418 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:29.078933 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f2eee-5d41-4729-958b-fce98f6c1418 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:35:29.079403 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f2eee-5d41-4729-958b-fce98f6c1418 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:29.081210 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f2eee-5d41-4729-958b-fce98f6c1418 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:29.094773 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1091/2178] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:35:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:35:29.099436 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce6bff-202e-4793-9f08-fb30779dcb51 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:29.112286 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce6bff-202e-4793-9f08-fb30779dcb51 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:29.121920 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b5f68-118e-4151-bdb0-713acc42a08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:29.122882 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b5f68-118e-4151-bdb0-713acc42a08c admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:29.123833 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b5f68-118e-4151-bdb0-713acc42a08c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:29.124253 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b5f68-118e-4151-bdb0-713acc42a08c admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:29.125042 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b5f68-118e-4151-bdb0-713acc42a08c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:29.127360 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b5f68-118e-4151-bdb0-713acc42a08c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:29.173547 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1088/2179] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:35:29 2021] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:35:29.177966 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f2eee-5d41-4729-958b-fce98f6c1418 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:29.198750 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f2eee-5d41-4729-958b-fce98f6c1418 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:29.337444 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a564bb9-7a45-4171-a3e5-758d001f8d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:29.338217 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a564bb9-7a45-4171-a3e5-758d001f8d1d admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:29.338483 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a564bb9-7a45-4171-a3e5-758d001f8d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:29.338709 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a564bb9-7a45-4171-a3e5-758d001f8d1d admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:29.339449 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a564bb9-7a45-4171-a3e5-758d001f8d1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:29.343304 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a564bb9-7a45-4171-a3e5-758d001f8d1d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:29.384798 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1092/2180] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:35:29 2021] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:35:29.389415 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b5f68-118e-4151-bdb0-713acc42a08c admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:29.408974 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b5f68-118e-4151-bdb0-713acc42a08c admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:29.414122 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6805e0c-14a7-44bf-8e71-72b5e4fae89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:29.414832 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6805e0c-14a7-44bf-8e71-72b5e4fae89d admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:29.415112 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6805e0c-14a7-44bf-8e71-72b5e4fae89d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:29.415401 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6805e0c-14a7-44bf-8e71-72b5e4fae89d admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:29.416186 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6805e0c-14a7-44bf-8e71-72b5e4fae89d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:29.418199 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6805e0c-14a7-44bf-8e71-72b5e4fae89d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:29.434259 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1089/2181] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:35:29 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:35:29.439589 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a564bb9-7a45-4171-a3e5-758d001f8d1d admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:29.457135 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a564bb9-7a45-4171-a3e5-758d001f8d1d admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:29.471590 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46b3d0-3aa9-43f8-91f9-038babed7b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:29.472538 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46b3d0-3aa9-43f8-91f9-038babed7b6f admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:29.474385 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46b3d0-3aa9-43f8-91f9-038babed7b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:29.474898 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46b3d0-3aa9-43f8-91f9-038babed7b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:29.476052 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46b3d0-3aa9-43f8-91f9-038babed7b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:29.477974 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46b3d0-3aa9-43f8-91f9-038babed7b6f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:29.504915 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1093/2182] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:35:29 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:35:29.508600 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6805e0c-14a7-44bf-8e71-72b5e4fae89d admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:29.535414 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6805e0c-14a7-44bf-8e71-72b5e4fae89d admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:29.561633 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36370f36-9a74-4d77-9177-4b9ebc3de861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:29.561633 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36370f36-9a74-4d77-9177-4b9ebc3de861 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:29.561633 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36370f36-9a74-4d77-9177-4b9ebc3de861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:29.561633 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36370f36-9a74-4d77-9177-4b9ebc3de861 admin admin] PATH_INFO: `/v3/projects/31dc98cdb2d24b2d94d555d9f38d0396/users/5620876cadaa43b3b38260b7a52d34fb/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:29.598734 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36370f36-9a74-4d77-9177-4b9ebc3de861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31dc98cdb2d24b2d94d555d9f38d0396, user_id=5620876cadaa43b3b38260b7a52d34fb, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:29.606491 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36370f36-9a74-4d77-9177-4b9ebc3de861 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:29.652192 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1090/2183] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:35:29 2021] PUT /identity/v3/projects/31dc98cdb2d24b2d94d555d9f38d0396/users/5620876cadaa43b3b38260b7a52d34fb/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:35:29.667177 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ebc25-e9f1-4fe4-ab94-9355d58e0dd9 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:29.667536 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ebc25-e9f1-4fe4-ab94-9355d58e0dd9 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:29.667740 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ebc25-e9f1-4fe4-ab94-9355d58e0dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:29.718225 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-4f5ebc25-e9f1-4fe4-ab94-9355d58e0dd9 None None] MFA Rules not processed for user `5620876cadaa43b3b38260b7a52d34fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:29.719359 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-4f5ebc25-e9f1-4fe4-ab94-9355d58e0dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:29.875647 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1094/2184] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:35:29 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:35:29.886534 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36370f36-9a74-4d77-9177-4b9ebc3de861 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:29.889639 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-36370f36-9a74-4d77-9177-4b9ebc3de861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:30.033405 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36370f36-9a74-4d77-9177-4b9ebc3de861 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:30.044272 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49cb289-c3a1-4a38-8758-5f6359aa74ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:30.045625 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49cb289-c3a1-4a38-8758-5f6359aa74ef service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:30.046705 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49cb289-c3a1-4a38-8758-5f6359aa74ef service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:30.046705 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49cb289-c3a1-4a38-8758-5f6359aa74ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:30.069566 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49cb289-c3a1-4a38-8758-5f6359aa74ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:30.073579 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49cb289-c3a1-4a38-8758-5f6359aa74ef service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:30.120929 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1091/2185] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:35:29 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:35:30.155520 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76732ae-162d-4b27-8904-2b36cf645d08 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:30.156160 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76732ae-162d-4b27-8904-2b36cf645d08 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:30.156675 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76732ae-162d-4b27-8904-2b36cf645d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:30.227040 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-e76732ae-162d-4b27-8904-2b36cf645d08 None None] MFA Rules not processed for user `217b11f7f05845598980741885b4417e`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:30.234076 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-e76732ae-162d-4b27-8904-2b36cf645d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:30.496419 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1095/2186] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:35:30 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:35:30.507488 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49cb289-c3a1-4a38-8758-5f6359aa74ef service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:30.509284 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-d49cb289-c3a1-4a38-8758-5f6359aa74ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:30.537973 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49cb289-c3a1-4a38-8758-5f6359aa74ef service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:30.543241 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d538c5-c3f6-4c78-a8cd-03a631bda1ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:30.543991 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d538c5-c3f6-4c78-a8cd-03a631bda1ed service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:30.544282 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d538c5-c3f6-4c78-a8cd-03a631bda1ed service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:30.544907 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d538c5-c3f6-4c78-a8cd-03a631bda1ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:30.568236 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d538c5-c3f6-4c78-a8cd-03a631bda1ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:30.570306 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d538c5-c3f6-4c78-a8cd-03a631bda1ed service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:30.583763 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1092/2187] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:35:30 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:35:31.478651 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76732ae-162d-4b27-8904-2b36cf645d08 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:31.480777 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-e76732ae-162d-4b27-8904-2b36cf645d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:31.640965 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76732ae-162d-4b27-8904-2b36cf645d08 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:31.647339 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d62e1-9129-49bf-b32d-1e05167a90bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:31.649337 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d62e1-9129-49bf-b32d-1e05167a90bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:31.649943 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d62e1-9129-49bf-b32d-1e05167a90bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:31.650454 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d62e1-9129-49bf-b32d-1e05167a90bb admin admin] PATH_INFO: `/v3/users/e56b922770d6465d9250f5540cb6025d` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:31.652495 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d62e1-9129-49bf-b32d-1e05167a90bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e56b922770d6465d9250f5540cb6025d)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:31.655596 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d62e1-9129-49bf-b32d-1e05167a90bb admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:31.770636 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-a83d62e1-9129-49bf-b32d-1e05167a90bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e56b922770d6465d9250f5540cb6025d'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:31.789513 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-a83d62e1-9129-49bf-b32d-1e05167a90bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e56b922770d6465d9250f5540cb6025d'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:31.807935 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-a83d62e1-9129-49bf-b32d-1e05167a90bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e56b922770d6465d9250f5540cb6025d'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:31.809304 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-a83d62e1-9129-49bf-b32d-1e05167a90bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e56b922770d6465d9250f5540cb6025d'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:31.842452 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-a83d62e1-9129-49bf-b32d-1e05167a90bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e56b922770d6465d9250f5540cb6025d'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:31.851948 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1096/2188] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:35:31 2021] DELETE /identity/v3/users/e56b922770d6465d9250f5540cb6025d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:35:31.860937 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168de2f9-47ee-4c77-bd92-753df09e9669 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:31.862321 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168de2f9-47ee-4c77-bd92-753df09e9669 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:31.863132 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168de2f9-47ee-4c77-bd92-753df09e9669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:31.898747 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-168de2f9-47ee-4c77-bd92-753df09e9669 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:31.902960 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-168de2f9-47ee-4c77-bd92-753df09e9669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:32.055692 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb18f09-ff98-4be3-939c-8128d6d00d9f None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:32.056330 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb18f09-ff98-4be3-939c-8128d6d00d9f None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:32.056694 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb18f09-ff98-4be3-939c-8128d6d00d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:32.098160 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-aeb18f09-ff98-4be3-939c-8128d6d00d9f None None] MFA Rules not processed for user `5620876cadaa43b3b38260b7a52d34fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:32.100931 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-aeb18f09-ff98-4be3-939c-8128d6d00d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:32.112177 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1093/2189] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:35:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:35:32.119069 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168de2f9-47ee-4c77-bd92-753df09e9669 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:32.120958 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-168de2f9-47ee-4c77-bd92-753df09e9669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:32.192331 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1097/2190] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:35:32 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:35:32.257746 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168de2f9-47ee-4c77-bd92-753df09e9669 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:32.262099 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719a8a5-cdee-4b3c-97a9-824cf6bf8f9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:32.263119 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719a8a5-cdee-4b3c-97a9-824cf6bf8f9f service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:32.263407 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719a8a5-cdee-4b3c-97a9-824cf6bf8f9f service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:32.263763 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719a8a5-cdee-4b3c-97a9-824cf6bf8f9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:32.281229 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719a8a5-cdee-4b3c-97a9-824cf6bf8f9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:32.284121 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719a8a5-cdee-4b3c-97a9-824cf6bf8f9f service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:32.297860 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1094/2191] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:35:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:35:32.355568 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29012f-f745-461b-b9d8-c293263edfc9 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:32.355863 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29012f-f745-461b-b9d8-c293263edfc9 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:32.356148 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29012f-f745-461b-b9d8-c293263edfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:32.387014 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-8a29012f-f745-461b-b9d8-c293263edfc9 None None] MFA Rules not processed for user `217b11f7f05845598980741885b4417e`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:32.390839 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-8a29012f-f745-461b-b9d8-c293263edfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:32.479394 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1098/2192] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:35:32 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:35:32.941591 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719a8a5-cdee-4b3c-97a9-824cf6bf8f9f service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:32.945929 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-0719a8a5-cdee-4b3c-97a9-824cf6bf8f9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:32.984592 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719a8a5-cdee-4b3c-97a9-824cf6bf8f9f service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:32.994060 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1db27-f849-4be7-a762-4aab7e758336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:32.995715 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1db27-f849-4be7-a762-4aab7e758336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:32.996215 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1db27-f849-4be7-a762-4aab7e758336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:32.997744 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1db27-f849-4be7-a762-4aab7e758336 admin admin] PATH_INFO: `/v3/projects/7a7eda7f1dae496baae6305ece0b99ae` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:33.000142 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1db27-f849-4be7-a762-4aab7e758336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a7eda7f1dae496baae6305ece0b99ae)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:33.002715 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1db27-f849-4be7-a762-4aab7e758336 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:33.068496 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-e8d1db27-f849-4be7-a762-4aab7e758336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a7eda7f1dae496baae6305ece0b99ae', 'request_id': 'req-e8d1db27-f849-4be7-a762-4aab7e758336'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:33.076870 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-e8d1db27-f849-4be7-a762-4aab7e758336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a7eda7f1dae496baae6305ece0b99ae', 'request_id': 'req-e8d1db27-f849-4be7-a762-4aab7e758336'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:33.086400 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-e8d1db27-f849-4be7-a762-4aab7e758336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a7eda7f1dae496baae6305ece0b99ae', 'request_id': 'req-e8d1db27-f849-4be7-a762-4aab7e758336'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:33.103339 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-e8d1db27-f849-4be7-a762-4aab7e758336 admin admin] The token cache is being invalidate because project 7a7eda7f1dae496baae6305ece0b99ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:35:33.104145 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-e8d1db27-f849-4be7-a762-4aab7e758336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:33.105351 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-e8d1db27-f849-4be7-a762-4aab7e758336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:33.108302 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1095/2193] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:35:32 2021] DELETE /identity/v3/projects/7a7eda7f1dae496baae6305ece0b99ae => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:35:33.112066 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29012f-f745-461b-b9d8-c293263edfc9 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:33.133415 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29012f-f745-461b-b9d8-c293263edfc9 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:33.209226 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc36d35-4cf1-4d0a-a446-0fb0d195962f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:33.210197 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc36d35-4cf1-4d0a-a446-0fb0d195962f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:33.210483 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc36d35-4cf1-4d0a-a446-0fb0d195962f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:33.210762 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc36d35-4cf1-4d0a-a446-0fb0d195962f admin admin] PATH_INFO: `/v3/users/24418da6bfe543618a113d88b3e2b0f1` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:33.212023 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc36d35-4cf1-4d0a-a446-0fb0d195962f admin admin] RBAC: Authorizing `identity:delete_user(user_id=24418da6bfe543618a113d88b3e2b0f1)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:33.214148 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc36d35-4cf1-4d0a-a446-0fb0d195962f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:33.342905 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-3bc36d35-4cf1-4d0a-a446-0fb0d195962f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24418da6bfe543618a113d88b3e2b0f1'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:33.385621 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-3bc36d35-4cf1-4d0a-a446-0fb0d195962f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24418da6bfe543618a113d88b3e2b0f1'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:33.415903 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-3bc36d35-4cf1-4d0a-a446-0fb0d195962f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24418da6bfe543618a113d88b3e2b0f1'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:33.416585 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-3bc36d35-4cf1-4d0a-a446-0fb0d195962f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24418da6bfe543618a113d88b3e2b0f1'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:33.556744 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-3bc36d35-4cf1-4d0a-a446-0fb0d195962f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24418da6bfe543618a113d88b3e2b0f1'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:33.613664 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1099/2194] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:35:33 2021] DELETE /identity/v3/users/24418da6bfe543618a113d88b3e2b0f1 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:35:34.072439 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1db27-f849-4be7-a762-4aab7e758336 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:34.074290 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-e8d1db27-f849-4be7-a762-4aab7e758336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:34.094783 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1db27-f849-4be7-a762-4aab7e758336 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:34.203874 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f258a-908a-49ef-9899-b8dc0aed8780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:34.205037 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f258a-908a-49ef-9899-b8dc0aed8780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:34.205323 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f258a-908a-49ef-9899-b8dc0aed8780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:34.207182 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f258a-908a-49ef-9899-b8dc0aed8780 admin admin] PATH_INFO: `/v3/projects/4d49165d5d9340e499c2ab741649fe41` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:34.208498 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f258a-908a-49ef-9899-b8dc0aed8780 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d49165d5d9340e499c2ab741649fe41)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:34.211002 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f258a-908a-49ef-9899-b8dc0aed8780 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:34.278454 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-425f258a-908a-49ef-9899-b8dc0aed8780 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d49165d5d9340e499c2ab741649fe41', 'request_id': 'req-425f258a-908a-49ef-9899-b8dc0aed8780'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:34.288550 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-425f258a-908a-49ef-9899-b8dc0aed8780 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d49165d5d9340e499c2ab741649fe41', 'request_id': 'req-425f258a-908a-49ef-9899-b8dc0aed8780'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:34.298914 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-425f258a-908a-49ef-9899-b8dc0aed8780 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d49165d5d9340e499c2ab741649fe41', 'request_id': 'req-425f258a-908a-49ef-9899-b8dc0aed8780'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:34.321103 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-425f258a-908a-49ef-9899-b8dc0aed8780 admin admin] The token cache is being invalidate because project 4d49165d5d9340e499c2ab741649fe41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:35:34.321445 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-425f258a-908a-49ef-9899-b8dc0aed8780 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:34.322305 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-425f258a-908a-49ef-9899-b8dc0aed8780 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:34.324995 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1096/2195] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:35:34 2021] DELETE /identity/v3/projects/4d49165d5d9340e499c2ab741649fe41 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:35:34.330718 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663ed32-9983-41c0-bde2-6904fb8c2ae4 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:34.331071 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663ed32-9983-41c0-bde2-6904fb8c2ae4 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:34.331943 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663ed32-9983-41c0-bde2-6904fb8c2ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:34.351700 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-0663ed32-9983-41c0-bde2-6904fb8c2ae4 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:34.353070 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-0663ed32-9983-41c0-bde2-6904fb8c2ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:34.457454 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1100/2196] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:35:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:35:34.458690 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12886f-6258-42f1-8e91-2adfab394fbf None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:34.459103 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12886f-6258-42f1-8e91-2adfab394fbf None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:34.459301 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12886f-6258-42f1-8e91-2adfab394fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:34.495765 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-fa12886f-6258-42f1-8e91-2adfab394fbf None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:34.497097 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-fa12886f-6258-42f1-8e91-2adfab394fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:34.522773 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1097/2197] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:35:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:35:34.527228 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663ed32-9983-41c0-bde2-6904fb8c2ae4 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:34.540701 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663ed32-9983-41c0-bde2-6904fb8c2ae4 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:34.546950 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407d11d-a850-4a08-924a-300a4c9c3d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:34.547665 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407d11d-a850-4a08-924a-300a4c9c3d03 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:34.547966 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407d11d-a850-4a08-924a-300a4c9c3d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:34.548233 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407d11d-a850-4a08-924a-300a4c9c3d03 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:34.549102 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407d11d-a850-4a08-924a-300a4c9c3d03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:35:34.549471 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407d11d-a850-4a08-924a-300a4c9c3d03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:34.551155 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407d11d-a850-4a08-924a-300a4c9c3d03 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:34.572567 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12886f-6258-42f1-8e91-2adfab394fbf None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:34.578657 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1101/2198] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:35:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:35:34.582787 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12886f-6258-42f1-8e91-2adfab394fbf None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:34.587475 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8a06f-700a-4557-9271-67af3468ae08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:34.588144 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8a06f-700a-4557-9271-67af3468ae08 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:34.588422 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8a06f-700a-4557-9271-67af3468ae08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:34.588696 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8a06f-700a-4557-9271-67af3468ae08 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:34.589407 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8a06f-700a-4557-9271-67af3468ae08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:34.591379 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8a06f-700a-4557-9271-67af3468ae08 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:34.622277 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1098/2199] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:35:34 2021] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:35:34.623510 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407d11d-a850-4a08-924a-300a4c9c3d03 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:34.641635 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407d11d-a850-4a08-924a-300a4c9c3d03 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:34.710447 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24b9e3-bcdd-4523-8eec-7a6517a31e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:34.712261 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24b9e3-bcdd-4523-8eec-7a6517a31e4a admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:34.712928 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24b9e3-bcdd-4523-8eec-7a6517a31e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:34.713468 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24b9e3-bcdd-4523-8eec-7a6517a31e4a admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:34.716232 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24b9e3-bcdd-4523-8eec-7a6517a31e4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:34.720972 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24b9e3-bcdd-4523-8eec-7a6517a31e4a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:34.749757 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1102/2200] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:35:34 2021] POST /identity/v3/users => generated 284 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:35:34.754056 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8a06f-700a-4557-9271-67af3468ae08 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:34.767455 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8a06f-700a-4557-9271-67af3468ae08 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:34.775153 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d3f60-59b7-4c3d-8575-92fbb3db6350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:34.776151 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d3f60-59b7-4c3d-8575-92fbb3db6350 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:34.776599 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d3f60-59b7-4c3d-8575-92fbb3db6350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:34.777052 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d3f60-59b7-4c3d-8575-92fbb3db6350 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:34.777980 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d3f60-59b7-4c3d-8575-92fbb3db6350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:34.780123 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d3f60-59b7-4c3d-8575-92fbb3db6350 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:34.796772 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1099/2201] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:35:34 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:35:34.797991 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24b9e3-bcdd-4523-8eec-7a6517a31e4a admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:34.809905 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24b9e3-bcdd-4523-8eec-7a6517a31e4a admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:34.815891 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eba637-68d0-4b34-b612-76f21d921b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:34.816867 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eba637-68d0-4b34-b612-76f21d921b69 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:34.817336 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eba637-68d0-4b34-b612-76f21d921b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:34.817759 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eba637-68d0-4b34-b612-76f21d921b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:34.818787 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eba637-68d0-4b34-b612-76f21d921b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:34.820490 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eba637-68d0-4b34-b612-76f21d921b69 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:34.834958 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1103/2202] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:35:34 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:35:34.836190 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d3f60-59b7-4c3d-8575-92fbb3db6350 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:34.846788 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d3f60-59b7-4c3d-8575-92fbb3db6350 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:34.851603 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9baf066-daa9-4846-8c78-98fa8c33bbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:34.852548 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baf066-daa9-4846-8c78-98fa8c33bbf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:34.852862 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baf066-daa9-4846-8c78-98fa8c33bbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:34.853913 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baf066-daa9-4846-8c78-98fa8c33bbf7 admin admin] PATH_INFO: `/v3/projects/8f33b5ae6bb34607a808417db01c03b9/users/565c5c0450a544cfa29448387a8696cb/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:34.869620 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9baf066-daa9-4846-8c78-98fa8c33bbf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f33b5ae6bb34607a808417db01c03b9, user_id=565c5c0450a544cfa29448387a8696cb, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:34.873285 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9baf066-daa9-4846-8c78-98fa8c33bbf7 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:34.889238 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1100/2203] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:35:34 2021] PUT /identity/v3/projects/8f33b5ae6bb34607a808417db01c03b9/users/565c5c0450a544cfa29448387a8696cb/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:35:34.899550 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258c703-cb0f-4518-ab3e-4c61117ec568 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:34.899922 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258c703-cb0f-4518-ab3e-4c61117ec568 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:34.900338 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258c703-cb0f-4518-ab3e-4c61117ec568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:34.950240 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-1258c703-cb0f-4518-ab3e-4c61117ec568 None None] MFA Rules not processed for user `565c5c0450a544cfa29448387a8696cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:34.960329 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-1258c703-cb0f-4518-ab3e-4c61117ec568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:35.054749 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1104/2204] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:35:34 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:35:35.059474 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9baf066-daa9-4846-8c78-98fa8c33bbf7 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:35.118939 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9baf066-daa9-4846-8c78-98fa8c33bbf7 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:35.124704 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07fc2e-4de9-46c4-86ec-15e95a023d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:35.125362 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07fc2e-4de9-46c4-86ec-15e95a023d80 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:35.125693 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07fc2e-4de9-46c4-86ec-15e95a023d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:35.125971 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07fc2e-4de9-46c4-86ec-15e95a023d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:35.126712 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07fc2e-4de9-46c4-86ec-15e95a023d80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:35.128607 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07fc2e-4de9-46c4-86ec-15e95a023d80 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:35.154359 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1101/2205] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:35:35 2021] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:35:35.158464 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258c703-cb0f-4518-ab3e-4c61117ec568 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:35.169399 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258c703-cb0f-4518-ab3e-4c61117ec568 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:35.223571 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1b30d-70fa-45a7-a65f-3c4d86ac8f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:35.224174 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1b30d-70fa-45a7-a65f-3c4d86ac8f27 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:35.224448 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1b30d-70fa-45a7-a65f-3c4d86ac8f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:35.224732 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1b30d-70fa-45a7-a65f-3c4d86ac8f27 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:35.225458 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1b30d-70fa-45a7-a65f-3c4d86ac8f27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:35.227552 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1b30d-70fa-45a7-a65f-3c4d86ac8f27 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:35.248586 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1105/2206] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:35:35 2021] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:35:35.252513 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07fc2e-4de9-46c4-86ec-15e95a023d80 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:35.262583 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07fc2e-4de9-46c4-86ec-15e95a023d80 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:35.267540 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40eab9-3de1-4924-9183-c6755c9971c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:35.268199 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40eab9-3de1-4924-9183-c6755c9971c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:35.268481 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40eab9-3de1-4924-9183-c6755c9971c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:35.268756 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40eab9-3de1-4924-9183-c6755c9971c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:35.269673 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40eab9-3de1-4924-9183-c6755c9971c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:35.271096 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40eab9-3de1-4924-9183-c6755c9971c0 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:35.282070 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1102/2207] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:35:35 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:35:35.286105 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1b30d-70fa-45a7-a65f-3c4d86ac8f27 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:35.296254 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1b30d-70fa-45a7-a65f-3c4d86ac8f27 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:35.304006 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdd949-90df-4807-a823-26e319c6cc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:35.304899 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdd949-90df-4807-a823-26e319c6cc23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:35.305185 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdd949-90df-4807-a823-26e319c6cc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:35.305466 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdd949-90df-4807-a823-26e319c6cc23 admin admin] PATH_INFO: `/v3/projects/a21e894d3d4d4a6fb066fda01f9fbac9/users/6f0a2c1c22b5430da2704851560ab249/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:35.321865 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cdd949-90df-4807-a823-26e319c6cc23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21e894d3d4d4a6fb066fda01f9fbac9, user_id=6f0a2c1c22b5430da2704851560ab249, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:35.324569 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cdd949-90df-4807-a823-26e319c6cc23 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:35.339948 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1106/2208] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:35:35 2021] PUT /identity/v3/projects/a21e894d3d4d4a6fb066fda01f9fbac9/users/6f0a2c1c22b5430da2704851560ab249/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:35:35.344631 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40eab9-3de1-4924-9183-c6755c9971c0 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:35.361362 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40eab9-3de1-4924-9183-c6755c9971c0 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:35.417238 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda493af-b940-4d3c-a0dd-68e19e1fc678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:35.417942 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda493af-b940-4d3c-a0dd-68e19e1fc678 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:35.418223 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda493af-b940-4d3c-a0dd-68e19e1fc678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:35.418530 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda493af-b940-4d3c-a0dd-68e19e1fc678 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:35.419266 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda493af-b940-4d3c-a0dd-68e19e1fc678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:35.421531 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda493af-b940-4d3c-a0dd-68e19e1fc678 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:35.436601 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1103/2209] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:35:35 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:35:35.438107 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdd949-90df-4807-a823-26e319c6cc23 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:35.449124 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdd949-90df-4807-a823-26e319c6cc23 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:35.454071 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db07ef-0bdc-4c41-9141-c426d8de2207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:35.456621 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db07ef-0bdc-4c41-9141-c426d8de2207 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:35.456621 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db07ef-0bdc-4c41-9141-c426d8de2207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:35.456863 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db07ef-0bdc-4c41-9141-c426d8de2207 admin admin] PATH_INFO: `/v3/projects/a21e894d3d4d4a6fb066fda01f9fbac9/users/6f0a2c1c22b5430da2704851560ab249/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:35.458953 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db07ef-0bdc-4c41-9141-c426d8de2207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21e894d3d4d4a6fb066fda01f9fbac9, user_id=6f0a2c1c22b5430da2704851560ab249, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:35.461601 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db07ef-0bdc-4c41-9141-c426d8de2207 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:35.479099 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1107/2210] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:35:35 2021] PUT /identity/v3/projects/a21e894d3d4d4a6fb066fda01f9fbac9/users/6f0a2c1c22b5430da2704851560ab249/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:35:35.483535 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b213e-87f1-4c90-8e29-1d7442101c93 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:35.483823 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b213e-87f1-4c90-8e29-1d7442101c93 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:35.484094 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b213e-87f1-4c90-8e29-1d7442101c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:35.512495 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-de6b213e-87f1-4c90-8e29-1d7442101c93 None None] MFA Rules not processed for user `6f0a2c1c22b5430da2704851560ab249`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:35.513795 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-de6b213e-87f1-4c90-8e29-1d7442101c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:35.593521 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1104/2211] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:35:35 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:35:35.604794 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db07ef-0bdc-4c41-9141-c426d8de2207 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:35.606564 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-a1db07ef-0bdc-4c41-9141-c426d8de2207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:35.687847 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db07ef-0bdc-4c41-9141-c426d8de2207 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:35.707104 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93160ffc-07bc-408a-ac7b-a41bf5e593d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:35.707721 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93160ffc-07bc-408a-ac7b-a41bf5e593d3 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:35.708013 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93160ffc-07bc-408a-ac7b-a41bf5e593d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:35.708302 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93160ffc-07bc-408a-ac7b-a41bf5e593d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:35.729728 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93160ffc-07bc-408a-ac7b-a41bf5e593d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:35.733333 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93160ffc-07bc-408a-ac7b-a41bf5e593d3 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:35.758491 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1108/2212] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:35:35 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:35:35.861273 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b213e-87f1-4c90-8e29-1d7442101c93 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:35.871852 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b213e-87f1-4c90-8e29-1d7442101c93 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:35.876878 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b173ca3-686b-4390-a625-d391ec7b0197 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:35.878015 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b173ca3-686b-4390-a625-d391ec7b0197 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:35.878313 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b173ca3-686b-4390-a625-d391ec7b0197 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:35.878844 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b173ca3-686b-4390-a625-d391ec7b0197 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:35.974604 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b173ca3-686b-4390-a625-d391ec7b0197 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:35.976434 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b173ca3-686b-4390-a625-d391ec7b0197 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:35.993864 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1105/2213] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:35:35 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:35:36.192766 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcff1bb-b25b-429c-88b9-52645534a9d5 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:36.193164 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcff1bb-b25b-429c-88b9-52645534a9d5 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:36.193755 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcff1bb-b25b-429c-88b9-52645534a9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:36.238949 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-3bcff1bb-b25b-429c-88b9-52645534a9d5 None None] MFA Rules not processed for user `56895529b11b4236bccb5956a8ccb5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:36.240428 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-3bcff1bb-b25b-429c-88b9-52645534a9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:36.321625 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1109/2214] 10.222.0.25 () {58 vars in 967 bytes} [Wed Oct 27 01:35:36 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:35:36.345272 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b173ca3-686b-4390-a625-d391ec7b0197 service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:36.353050 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-0b173ca3-686b-4390-a625-d391ec7b0197 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:36.460156 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b173ca3-686b-4390-a625-d391ec7b0197 service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:36.467453 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447663d-05cb-4e8a-9a0c-9bc1059e06a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f386f358fdb241f5a529a2cf3d839201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:36.468125 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447663d-05cb-4e8a-9a0c-9bc1059e06a4 service swift] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:36.468413 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447663d-05cb-4e8a-9a0c-9bc1059e06a4 service swift] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:36.468756 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447663d-05cb-4e8a-9a0c-9bc1059e06a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:36.480153 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447663d-05cb-4e8a-9a0c-9bc1059e06a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:36.482086 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447663d-05cb-4e8a-9a0c-9bc1059e06a4 service swift] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:36.501848 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1106/2215] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Oct 27 01:35:36 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:35:39.794036 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcff1bb-b25b-429c-88b9-52645534a9d5 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:39.798457 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-3bcff1bb-b25b-429c-88b9-52645534a9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:39.999324 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcff1bb-b25b-429c-88b9-52645534a9d5 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:40.004395 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a988d-2a63-4b63-8dea-57baf9122e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:40.005659 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a988d-2a63-4b63-8dea-57baf9122e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:40.006118 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a988d-2a63-4b63-8dea-57baf9122e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:40.006396 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a988d-2a63-4b63-8dea-57baf9122e6d admin admin] PATH_INFO: `/v3/users/b69a1392996542a699aa5684269bc2f8` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:40.012081 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a988d-2a63-4b63-8dea-57baf9122e6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b69a1392996542a699aa5684269bc2f8)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:40.012081 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a988d-2a63-4b63-8dea-57baf9122e6d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:40.112746 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-cb2a988d-2a63-4b63-8dea-57baf9122e6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b69a1392996542a699aa5684269bc2f8'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:40.137796 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-cb2a988d-2a63-4b63-8dea-57baf9122e6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b69a1392996542a699aa5684269bc2f8'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:40.150231 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-cb2a988d-2a63-4b63-8dea-57baf9122e6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b69a1392996542a699aa5684269bc2f8'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:40.156038 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-cb2a988d-2a63-4b63-8dea-57baf9122e6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b69a1392996542a699aa5684269bc2f8'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:40.183387 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-cb2a988d-2a63-4b63-8dea-57baf9122e6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b69a1392996542a699aa5684269bc2f8'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:40.196924 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1110/2216] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:35:39 2021] DELETE /identity/v3/users/b69a1392996542a699aa5684269bc2f8 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:35:40.609106 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447663d-05cb-4e8a-9a0c-9bc1059e06a4 service swift] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:40.649194 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447663d-05cb-4e8a-9a0c-9bc1059e06a4 service swift] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:40.736699 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69343b8-41dd-420f-8e0f-5dc67959a35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:40.737643 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69343b8-41dd-420f-8e0f-5dc67959a35a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:40.737866 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69343b8-41dd-420f-8e0f-5dc67959a35a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:40.738311 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69343b8-41dd-420f-8e0f-5dc67959a35a admin admin] PATH_INFO: `/v3/projects/c6e1169cb36d4ae4ba0b43be7cd0f5b0` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:40.739529 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69343b8-41dd-420f-8e0f-5dc67959a35a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6e1169cb36d4ae4ba0b43be7cd0f5b0)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:40.741421 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69343b8-41dd-420f-8e0f-5dc67959a35a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:40.807037 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d69343b8-41dd-420f-8e0f-5dc67959a35a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6e1169cb36d4ae4ba0b43be7cd0f5b0', 'request_id': 'req-d69343b8-41dd-420f-8e0f-5dc67959a35a'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:40.815707 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d69343b8-41dd-420f-8e0f-5dc67959a35a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6e1169cb36d4ae4ba0b43be7cd0f5b0', 'request_id': 'req-d69343b8-41dd-420f-8e0f-5dc67959a35a'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:40.823397 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d69343b8-41dd-420f-8e0f-5dc67959a35a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6e1169cb36d4ae4ba0b43be7cd0f5b0', 'request_id': 'req-d69343b8-41dd-420f-8e0f-5dc67959a35a'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:40.834881 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d69343b8-41dd-420f-8e0f-5dc67959a35a admin admin] The token cache is being invalidate because project c6e1169cb36d4ae4ba0b43be7cd0f5b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:35:40.835181 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d69343b8-41dd-420f-8e0f-5dc67959a35a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:40.836037 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d69343b8-41dd-420f-8e0f-5dc67959a35a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:40.838215 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1107/2217] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:35:40 2021] DELETE /identity/v3/projects/c6e1169cb36d4ae4ba0b43be7cd0f5b0 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:35:41.251169 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeeca47-0f65-4ba2-bea9-d03e08cc9498 None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:41.252037 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeeca47-0f65-4ba2-bea9-d03e08cc9498 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:41.252556 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeeca47-0f65-4ba2-bea9-d03e08cc9498 None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:41.254809 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1111/2218] 10.222.0.25 () {54 vars in 921 bytes} [Wed Oct 27 01:35:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:35:41.262128 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1283b5d-b77c-4f20-98a2-9bcd4d9c3e56 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:41.262631 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1283b5d-b77c-4f20-98a2-9bcd4d9c3e56 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:41.263100 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1283b5d-b77c-4f20-98a2-9bcd4d9c3e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:41.287892 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-a1283b5d-b77c-4f20-98a2-9bcd4d9c3e56 None None] MFA Rules not processed for user `b2f8304b85b64dc4ac58523897306660`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:41.289330 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-a1283b5d-b77c-4f20-98a2-9bcd4d9c3e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:41.304048 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeeca47-0f65-4ba2-bea9-d03e08cc9498 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:41.306306 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-3aeeca47-0f65-4ba2-bea9-d03e08cc9498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:41.383036 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeeca47-0f65-4ba2-bea9-d03e08cc9498 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:41.386056 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1108/2219] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Oct 27 01:35:41 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:35:41.388220 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a72cb9-3a4c-4af5-860b-7efc75af1290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:41.389382 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a72cb9-3a4c-4af5-860b-7efc75af1290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:41.389705 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a72cb9-3a4c-4af5-860b-7efc75af1290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:41.389989 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a72cb9-3a4c-4af5-860b-7efc75af1290 admin admin] PATH_INFO: `/v3/users/565c5c0450a544cfa29448387a8696cb` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:41.391629 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a72cb9-3a4c-4af5-860b-7efc75af1290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=565c5c0450a544cfa29448387a8696cb)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:41.394744 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a72cb9-3a4c-4af5-860b-7efc75af1290 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:41.400389 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1283b5d-b77c-4f20-98a2-9bcd4d9c3e56 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:41.402248 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-a1283b5d-b77c-4f20-98a2-9bcd4d9c3e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:41.450637 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-66a72cb9-3a4c-4af5-860b-7efc75af1290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '565c5c0450a544cfa29448387a8696cb'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:41.459857 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-66a72cb9-3a4c-4af5-860b-7efc75af1290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '565c5c0450a544cfa29448387a8696cb'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:41.467503 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-66a72cb9-3a4c-4af5-860b-7efc75af1290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '565c5c0450a544cfa29448387a8696cb'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:41.468394 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-66a72cb9-3a4c-4af5-860b-7efc75af1290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '565c5c0450a544cfa29448387a8696cb'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:41.470096 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1283b5d-b77c-4f20-98a2-9bcd4d9c3e56 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:41.474199 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30230127-635e-4c6d-bef9-c6169b93419c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32003a40693246d08640bc7ec45adfc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:41.474939 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30230127-635e-4c6d-bef9-c6169b93419c service glance] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:41.475306 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30230127-635e-4c6d-bef9-c6169b93419c service glance] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:41.475660 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30230127-635e-4c6d-bef9-c6169b93419c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:41.477790 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-30230127-635e-4c6d-bef9-c6169b93419c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:41.483236 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-66a72cb9-3a4c-4af5-860b-7efc75af1290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '565c5c0450a544cfa29448387a8696cb'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:41.489438 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1112/2220] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:35:41 2021] DELETE /identity/v3/users/565c5c0450a544cfa29448387a8696cb => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:35:41.493885 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e2cac-f7cb-42cd-83cc-18087cf8b993 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:41.494179 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e2cac-f7cb-42cd-83cc-18087cf8b993 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:41.494462 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e2cac-f7cb-42cd-83cc-18087cf8b993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:41.494668 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30230127-635e-4c6d-bef9-c6169b93419c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:41.496207 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30230127-635e-4c6d-bef9-c6169b93419c service glance] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:41.510597 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1109/2221] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:35:41 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:35:41.515152 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-a88e2cac-f7cb-42cd-83cc-18087cf8b993 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:41.516368 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-a88e2cac-f7cb-42cd-83cc-18087cf8b993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:41.593760 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1113/2222] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:35:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:35:41.601796 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dbe55-2482-4b6f-ba27-a2b3cf5cdd80 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:41.602327 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dbe55-2482-4b6f-ba27-a2b3cf5cdd80 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:41.602806 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dbe55-2482-4b6f-ba27-a2b3cf5cdd80 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:41.604378 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e2cac-f7cb-42cd-83cc-18087cf8b993 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:41.605405 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1110/2223] 10.222.0.25 () {54 vars in 921 bytes} [Wed Oct 27 01:35:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:35:41.605853 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-a88e2cac-f7cb-42cd-83cc-18087cf8b993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:41.611660 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04878968-841f-4193-9618-ca1a82e76cf8 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:41.612109 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04878968-841f-4193-9618-ca1a82e76cf8 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:41.612407 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04878968-841f-4193-9618-ca1a82e76cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:41.649935 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-04878968-841f-4193-9618-ca1a82e76cf8 None None] MFA Rules not processed for user `bff692322c68420186f2918d380ece98`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:41.651245 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-04878968-841f-4193-9618-ca1a82e76cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:41.667607 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e2cac-f7cb-42cd-83cc-18087cf8b993 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:41.673096 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98408120-7ae1-423b-8f70-b02c0d514d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:41.673781 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98408120-7ae1-423b-8f70-b02c0d514d7f service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:41.674512 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98408120-7ae1-423b-8f70-b02c0d514d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:41.674796 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98408120-7ae1-423b-8f70-b02c0d514d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:41.686193 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98408120-7ae1-423b-8f70-b02c0d514d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:41.687626 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98408120-7ae1-423b-8f70-b02c0d514d7f service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:41.697177 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1114/2224] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:35:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:35:41.707931 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1111/2225] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Oct 27 01:35:41 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:35:41.725966 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98408120-7ae1-423b-8f70-b02c0d514d7f service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:41.734892 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98408120-7ae1-423b-8f70-b02c0d514d7f service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:41.738666 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31872e2-7fd1-4a3c-af35-97ddf73da245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:41.739299 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31872e2-7fd1-4a3c-af35-97ddf73da245 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:41.739589 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31872e2-7fd1-4a3c-af35-97ddf73da245 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:41.739867 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31872e2-7fd1-4a3c-af35-97ddf73da245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:41.748087 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31872e2-7fd1-4a3c-af35-97ddf73da245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:41.749845 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31872e2-7fd1-4a3c-af35-97ddf73da245 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:41.759702 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1115/2226] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:35:41 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:35:42.023834 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04878968-841f-4193-9618-ca1a82e76cf8 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:42.025684 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-04878968-841f-4193-9618-ca1a82e76cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:42.046268 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04878968-841f-4193-9618-ca1a82e76cf8 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:42.052219 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79be21-a859-49d5-a4cd-51f77ef77791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:42.053262 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79be21-a859-49d5-a4cd-51f77ef77791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:42.053545 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79be21-a859-49d5-a4cd-51f77ef77791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:42.053907 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79be21-a859-49d5-a4cd-51f77ef77791 admin admin] PATH_INFO: `/v3/projects/8f33b5ae6bb34607a808417db01c03b9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:42.055355 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79be21-a859-49d5-a4cd-51f77ef77791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f33b5ae6bb34607a808417db01c03b9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:42.057704 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79be21-a859-49d5-a4cd-51f77ef77791 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:42.113992 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-1f79be21-a859-49d5-a4cd-51f77ef77791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f33b5ae6bb34607a808417db01c03b9', 'request_id': 'req-1f79be21-a859-49d5-a4cd-51f77ef77791'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:42.119659 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-1f79be21-a859-49d5-a4cd-51f77ef77791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f33b5ae6bb34607a808417db01c03b9', 'request_id': 'req-1f79be21-a859-49d5-a4cd-51f77ef77791'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:42.128389 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-1f79be21-a859-49d5-a4cd-51f77ef77791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f33b5ae6bb34607a808417db01c03b9', 'request_id': 'req-1f79be21-a859-49d5-a4cd-51f77ef77791'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:42.140836 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-1f79be21-a859-49d5-a4cd-51f77ef77791 admin admin] The token cache is being invalidate because project 8f33b5ae6bb34607a808417db01c03b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:35:42.141361 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-1f79be21-a859-49d5-a4cd-51f77ef77791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:42.142198 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-1f79be21-a859-49d5-a4cd-51f77ef77791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:42.144007 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1112/2227] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:35:42 2021] DELETE /identity/v3/projects/8f33b5ae6bb34607a808417db01c03b9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:35:42.148133 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31872e2-7fd1-4a3c-af35-97ddf73da245 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:42.161984 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31872e2-7fd1-4a3c-af35-97ddf73da245 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:42.240725 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063385c0-1b37-453f-81c4-d5e40b1715f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:42.242066 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063385c0-1b37-453f-81c4-d5e40b1715f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:42.242359 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063385c0-1b37-453f-81c4-d5e40b1715f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:42.242682 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063385c0-1b37-453f-81c4-d5e40b1715f8 admin admin] PATH_INFO: `/v3/users/6f0a2c1c22b5430da2704851560ab249` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:42.244275 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063385c0-1b37-453f-81c4-d5e40b1715f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f0a2c1c22b5430da2704851560ab249)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:42.246374 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063385c0-1b37-453f-81c4-d5e40b1715f8 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:42.300236 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-063385c0-1b37-453f-81c4-d5e40b1715f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f0a2c1c22b5430da2704851560ab249'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:42.309786 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-063385c0-1b37-453f-81c4-d5e40b1715f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f0a2c1c22b5430da2704851560ab249'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:42.317794 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-063385c0-1b37-453f-81c4-d5e40b1715f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f0a2c1c22b5430da2704851560ab249'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:42.318738 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-063385c0-1b37-453f-81c4-d5e40b1715f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f0a2c1c22b5430da2704851560ab249'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:42.331946 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-063385c0-1b37-453f-81c4-d5e40b1715f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f0a2c1c22b5430da2704851560ab249'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:42.342795 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1116/2228] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:35:42 2021] DELETE /identity/v3/users/6f0a2c1c22b5430da2704851560ab249 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:35:42.616097 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79be21-a859-49d5-a4cd-51f77ef77791 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:42.618563 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-1f79be21-a859-49d5-a4cd-51f77ef77791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:42.633130 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79be21-a859-49d5-a4cd-51f77ef77791 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:42.693268 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a0c81-864c-46f6-94fe-30bf487e53ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:42.694163 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a0c81-864c-46f6-94fe-30bf487e53ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:42.694456 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a0c81-864c-46f6-94fe-30bf487e53ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:42.694735 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a0c81-864c-46f6-94fe-30bf487e53ae admin admin] PATH_INFO: `/v3/projects/a21e894d3d4d4a6fb066fda01f9fbac9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:42.696072 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a0c81-864c-46f6-94fe-30bf487e53ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=a21e894d3d4d4a6fb066fda01f9fbac9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:42.698017 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a0c81-864c-46f6-94fe-30bf487e53ae admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:42.747996 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-3b8a0c81-864c-46f6-94fe-30bf487e53ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a21e894d3d4d4a6fb066fda01f9fbac9', 'request_id': 'req-3b8a0c81-864c-46f6-94fe-30bf487e53ae'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:42.755369 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-3b8a0c81-864c-46f6-94fe-30bf487e53ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a21e894d3d4d4a6fb066fda01f9fbac9', 'request_id': 'req-3b8a0c81-864c-46f6-94fe-30bf487e53ae'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:42.764501 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-3b8a0c81-864c-46f6-94fe-30bf487e53ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a21e894d3d4d4a6fb066fda01f9fbac9', 'request_id': 'req-3b8a0c81-864c-46f6-94fe-30bf487e53ae'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:42.776391 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-3b8a0c81-864c-46f6-94fe-30bf487e53ae admin admin] The token cache is being invalidate because project a21e894d3d4d4a6fb066fda01f9fbac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:35:42.776681 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-3b8a0c81-864c-46f6-94fe-30bf487e53ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:42.777342 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-3b8a0c81-864c-46f6-94fe-30bf487e53ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:35:42.779949 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1113/2229] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:35:42 2021] DELETE /identity/v3/projects/a21e894d3d4d4a6fb066fda01f9fbac9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:35:42.786287 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0e9f3-42c7-4936-9469-4dca199b8696 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:42.786679 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0e9f3-42c7-4936-9469-4dca199b8696 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:42.787159 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0e9f3-42c7-4936-9469-4dca199b8696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:42.814770 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-3cd0e9f3-42c7-4936-9469-4dca199b8696 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:42.816419 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-3cd0e9f3-42c7-4936-9469-4dca199b8696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:42.881403 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1117/2230] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:35:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:35:42.890030 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5ccaf-c1c2-4077-b883-078bdee8bb90 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:42.890324 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5ccaf-c1c2-4077-b883-078bdee8bb90 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:42.890608 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5ccaf-c1c2-4077-b883-078bdee8bb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:42.908893 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-aab5ccaf-c1c2-4077-b883-078bdee8bb90 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:42.910126 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-aab5ccaf-c1c2-4077-b883-078bdee8bb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:42.918756 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1114/2231] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:35:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:35:42.923367 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0e9f3-42c7-4936-9469-4dca199b8696 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:42.933635 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0e9f3-42c7-4936-9469-4dca199b8696 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:42.938860 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf0b3b-10f6-4413-9177-dd65f888a67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:42.939528 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf0b3b-10f6-4413-9177-dd65f888a67f admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:42.939814 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf0b3b-10f6-4413-9177-dd65f888a67f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:42.940125 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf0b3b-10f6-4413-9177-dd65f888a67f admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:42.940867 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf0b3b-10f6-4413-9177-dd65f888a67f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:35:42.941181 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf0b3b-10f6-4413-9177-dd65f888a67f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:42.942802 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf0b3b-10f6-4413-9177-dd65f888a67f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:42.959554 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1118/2232] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:35:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:35:42.960594 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5ccaf-c1c2-4077-b883-078bdee8bb90 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:42.970087 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5ccaf-c1c2-4077-b883-078bdee8bb90 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:42.974985 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558734a-2f84-47a3-a819-5cb25cc9e007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:42.975639 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558734a-2f84-47a3-a819-5cb25cc9e007 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:42.975926 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558734a-2f84-47a3-a819-5cb25cc9e007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:42.976206 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558734a-2f84-47a3-a819-5cb25cc9e007 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:42.976910 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558734a-2f84-47a3-a819-5cb25cc9e007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:42.978819 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558734a-2f84-47a3-a819-5cb25cc9e007 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:43.004924 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1115/2233] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:35:42 2021] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:35:43.009271 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf0b3b-10f6-4413-9177-dd65f888a67f admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:43.019957 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf0b3b-10f6-4413-9177-dd65f888a67f admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:43.076437 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0a826-f02b-4949-a64e-67afc8b32175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:43.077110 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0a826-f02b-4949-a64e-67afc8b32175 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:43.077399 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0a826-f02b-4949-a64e-67afc8b32175 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:43.077712 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0a826-f02b-4949-a64e-67afc8b32175 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:43.078457 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0a826-f02b-4949-a64e-67afc8b32175 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:43.080354 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0a826-f02b-4949-a64e-67afc8b32175 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:43.100002 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1119/2234] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:35:43 2021] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:35:43.104369 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558734a-2f84-47a3-a819-5cb25cc9e007 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:43.115056 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558734a-2f84-47a3-a819-5cb25cc9e007 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:43.120363 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2f471-da06-40ca-8e59-f4dee922d9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:43.121025 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2f471-da06-40ca-8e59-f4dee922d9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:43.121314 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2f471-da06-40ca-8e59-f4dee922d9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:43.121628 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2f471-da06-40ca-8e59-f4dee922d9c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:43.122373 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa2f471-da06-40ca-8e59-f4dee922d9c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:43.124491 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa2f471-da06-40ca-8e59-f4dee922d9c3 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:43.134907 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1116/2235] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:35:43 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:35:43.139538 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0a826-f02b-4949-a64e-67afc8b32175 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:43.149327 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0a826-f02b-4949-a64e-67afc8b32175 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:43.155234 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc4a6e-6f81-49cf-b742-8a15c6ea2ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:43.155883 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc4a6e-6f81-49cf-b742-8a15c6ea2ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:43.156169 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc4a6e-6f81-49cf-b742-8a15c6ea2ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:43.156446 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc4a6e-6f81-49cf-b742-8a15c6ea2ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:43.157206 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc4a6e-6f81-49cf-b742-8a15c6ea2ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:43.158817 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc4a6e-6f81-49cf-b742-8a15c6ea2ba4 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:43.168797 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1120/2236] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:35:43 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:35:43.173790 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2f471-da06-40ca-8e59-f4dee922d9c3 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:43.183771 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2f471-da06-40ca-8e59-f4dee922d9c3 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:43.188443 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db628044-db28-40b0-bfc3-320d84426f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:43.189306 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db628044-db28-40b0-bfc3-320d84426f9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:43.189626 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db628044-db28-40b0-bfc3-320d84426f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:43.189906 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db628044-db28-40b0-bfc3-320d84426f9c admin admin] PATH_INFO: `/v3/projects/3883de9671734134b8deb5f54e9aeb00/users/2242ab67a4004d309a15468e99bdb3f1/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:43.203744 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db628044-db28-40b0-bfc3-320d84426f9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3883de9671734134b8deb5f54e9aeb00, user_id=2242ab67a4004d309a15468e99bdb3f1, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:43.206430 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db628044-db28-40b0-bfc3-320d84426f9c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:43.219242 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1117/2237] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:35:43 2021] PUT /identity/v3/projects/3883de9671734134b8deb5f54e9aeb00/users/2242ab67a4004d309a15468e99bdb3f1/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:35:43.224270 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aa3f3-5560-4803-b3cf-a24656eacd37 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:43.224570 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aa3f3-5560-4803-b3cf-a24656eacd37 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:43.224880 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aa3f3-5560-4803-b3cf-a24656eacd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:43.242050 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-6e9aa3f3-5560-4803-b3cf-a24656eacd37 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:43.243240 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-6e9aa3f3-5560-4803-b3cf-a24656eacd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:43.300235 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1121/2238] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:35:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:35:43.310678 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db628044-db28-40b0-bfc3-320d84426f9c admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:43.312452 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-db628044-db28-40b0-bfc3-320d84426f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:43.369115 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db628044-db28-40b0-bfc3-320d84426f9c admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:43.373578 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144db6e4-f76c-458b-8f32-fca3979fd1fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:43.374311 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144db6e4-f76c-458b-8f32-fca3979fd1fb service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:43.374666 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144db6e4-f76c-458b-8f32-fca3979fd1fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:43.375016 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144db6e4-f76c-458b-8f32-fca3979fd1fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:43.385536 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144db6e4-f76c-458b-8f32-fca3979fd1fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:43.387927 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144db6e4-f76c-458b-8f32-fca3979fd1fb service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:43.399478 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1118/2239] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:35:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:35:44.790405 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a0825-f6b2-4dcd-a6db-482640c6102a None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:44.791439 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a0825-f6b2-4dcd-a6db-482640c6102a None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:44.792304 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a0825-f6b2-4dcd-a6db-482640c6102a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:44.828072 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-f17a0825-f6b2-4dcd-a6db-482640c6102a None None] MFA Rules not processed for user `2242ab67a4004d309a15468e99bdb3f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:44.830412 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-f17a0825-f6b2-4dcd-a6db-482640c6102a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:44.911263 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1122/2240] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:35:44 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:35:44.916464 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144db6e4-f76c-458b-8f32-fca3979fd1fb service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:44.928209 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144db6e4-f76c-458b-8f32-fca3979fd1fb service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:44.933148 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac3eda-9652-4baa-b653-02f9eafb26d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:44.933879 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac3eda-9652-4baa-b653-02f9eafb26d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:44.934165 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac3eda-9652-4baa-b653-02f9eafb26d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:44.934448 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac3eda-9652-4baa-b653-02f9eafb26d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:44.935731 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac3eda-9652-4baa-b653-02f9eafb26d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:44.937636 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac3eda-9652-4baa-b653-02f9eafb26d6 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:44.963010 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1119/2241] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:35:44 2021] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:35:44.967373 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a0825-f6b2-4dcd-a6db-482640c6102a None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:44.978263 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a0825-f6b2-4dcd-a6db-482640c6102a None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:45.040398 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbed66-a3f6-418d-adf7-37d0ac551ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:45.041190 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbed66-a3f6-418d-adf7-37d0ac551ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:45.041492 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbed66-a3f6-418d-adf7-37d0ac551ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:45.042030 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbed66-a3f6-418d-adf7-37d0ac551ba1 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:45.043622 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbed66-a3f6-418d-adf7-37d0ac551ba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:45.046688 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbed66-a3f6-418d-adf7-37d0ac551ba1 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:45.072121 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1123/2242] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:35:44 2021] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:35:45.076097 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac3eda-9652-4baa-b653-02f9eafb26d6 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:45.079056 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0427c-6d3c-4096-af4c-cb1f390fd08f None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:45.079534 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0427c-6d3c-4096-af4c-cb1f390fd08f None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:45.079867 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0427c-6d3c-4096-af4c-cb1f390fd08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:45.086909 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac3eda-9652-4baa-b653-02f9eafb26d6 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:45.091739 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14555fcc-d2b3-45b5-abfb-46565a9250c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:45.092683 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14555fcc-d2b3-45b5-abfb-46565a9250c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:45.092949 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14555fcc-d2b3-45b5-abfb-46565a9250c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:45.093383 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14555fcc-d2b3-45b5-abfb-46565a9250c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:45.094366 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14555fcc-d2b3-45b5-abfb-46565a9250c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:45.095988 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14555fcc-d2b3-45b5-abfb-46565a9250c8 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:45.098893 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-a0b0427c-6d3c-4096-af4c-cb1f390fd08f None None] MFA Rules not processed for user `56895529b11b4236bccb5956a8ccb5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:45.100200 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-a0b0427c-6d3c-4096-af4c-cb1f390fd08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:45.111082 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1120/2243] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:35:45 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:35:45.117934 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14555fcc-d2b3-45b5-abfb-46565a9250c8 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:45.129285 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14555fcc-d2b3-45b5-abfb-46565a9250c8 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:45.134422 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71791449-3ab2-4317-8b80-072595c2f0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:45.135565 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71791449-3ab2-4317-8b80-072595c2f0d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:45.135924 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71791449-3ab2-4317-8b80-072595c2f0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:45.136274 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71791449-3ab2-4317-8b80-072595c2f0d6 admin admin] PATH_INFO: `/v3/projects/5efb34d0960446ea9375b30dc3582fc7/users/bab31f4c35fb443f9025db9cc5d942a1/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:45.153415 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71791449-3ab2-4317-8b80-072595c2f0d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5efb34d0960446ea9375b30dc3582fc7, user_id=bab31f4c35fb443f9025db9cc5d942a1, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:45.156404 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71791449-3ab2-4317-8b80-072595c2f0d6 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:45.159673 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1124/2244] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Oct 27 01:35:45 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:35:45.173816 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1121/2245] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:35:45 2021] PUT /identity/v3/projects/5efb34d0960446ea9375b30dc3582fc7/users/bab31f4c35fb443f9025db9cc5d942a1/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:35:45.177592 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0427c-6d3c-4096-af4c-cb1f390fd08f None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:45.177771 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71791449-3ab2-4317-8b80-072595c2f0d6 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:45.179073 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-a0b0427c-6d3c-4096-af4c-cb1f390fd08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:45.244413 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71791449-3ab2-4317-8b80-072595c2f0d6 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:45.249122 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393f633-a8cc-4c2b-9e24-9dec6124aec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:45.249820 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393f633-a8cc-4c2b-9e24-9dec6124aec4 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:45.250104 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393f633-a8cc-4c2b-9e24-9dec6124aec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:45.250375 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393f633-a8cc-4c2b-9e24-9dec6124aec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:45.251198 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d393f633-a8cc-4c2b-9e24-9dec6124aec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:45.252204 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0427c-6d3c-4096-af4c-cb1f390fd08f None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:45.252691 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d393f633-a8cc-4c2b-9e24-9dec6124aec4 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:45.262794 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1122/2246] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:35:45 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:35:45.266885 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393f633-a8cc-4c2b-9e24-9dec6124aec4 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:45.277231 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393f633-a8cc-4c2b-9e24-9dec6124aec4 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:45.283295 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59daa1e-5290-4283-bb26-7b43702ca99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:45.284329 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59daa1e-5290-4283-bb26-7b43702ca99f admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:45.284614 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59daa1e-5290-4283-bb26-7b43702ca99f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:45.284897 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59daa1e-5290-4283-bb26-7b43702ca99f admin admin] PATH_INFO: `/v3/projects/5efb34d0960446ea9375b30dc3582fc7/users/bab31f4c35fb443f9025db9cc5d942a1/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:45.286975 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59daa1e-5290-4283-bb26-7b43702ca99f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5efb34d0960446ea9375b30dc3582fc7, user_id=bab31f4c35fb443f9025db9cc5d942a1, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:45.289993 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59daa1e-5290-4283-bb26-7b43702ca99f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:45.301743 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1123/2247] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:35:45 2021] PUT /identity/v3/projects/5efb34d0960446ea9375b30dc3582fc7/users/bab31f4c35fb443f9025db9cc5d942a1/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:35:45.322911 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b277f-0703-442e-9cd2-c07fe552c279 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f386f358fdb241f5a529a2cf3d839201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:45.323884 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b277f-0703-442e-9cd2-c07fe552c279 service swift] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:45.324355 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b277f-0703-442e-9cd2-c07fe552c279 service swift] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:45.324799 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b277f-0703-442e-9cd2-c07fe552c279 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:45.389503 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b277f-0703-442e-9cd2-c07fe552c279 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:45.391506 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b277f-0703-442e-9cd2-c07fe552c279 service swift] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:45.400954 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1125/2248] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Oct 27 01:35:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:35:46.174837 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66bd04-920d-40d4-a713-603f000924b0 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:46.175406 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66bd04-920d-40d4-a713-603f000924b0 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:46.175406 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66bd04-920d-40d4-a713-603f000924b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:46.206642 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-5f66bd04-920d-40d4-a713-603f000924b0 None None] MFA Rules not processed for user `bab31f4c35fb443f9025db9cc5d942a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:35:46.208649 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-5f66bd04-920d-40d4-a713-603f000924b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:46.309689 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1124/2249] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:35:46 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:35:46.321113 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b277f-0703-442e-9cd2-c07fe552c279 service swift] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:46.322208 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-353b277f-0703-442e-9cd2-c07fe552c279 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:46.395484 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b277f-0703-442e-9cd2-c07fe552c279 service swift] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:46.454174 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7a333-cd60-4c87-b937-e48d5b186707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:46.454934 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7a333-cd60-4c87-b937-e48d5b186707 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:46.455293 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7a333-cd60-4c87-b937-e48d5b186707 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:46.455764 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7a333-cd60-4c87-b937-e48d5b186707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:46.518510 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7a333-cd60-4c87-b937-e48d5b186707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:46.519960 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7a333-cd60-4c87-b937-e48d5b186707 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:46.541636 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1126/2250] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:35:46 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:35:47.895015 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66bd04-920d-40d4-a713-603f000924b0 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:35:47.896383 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-5f66bd04-920d-40d4-a713-603f000924b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:35:47.909403 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66bd04-920d-40d4-a713-603f000924b0 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:35:47.913123 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9bdbb-e2d8-4161-9720-44172e0cf91d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:35:47.913948 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9bdbb-e2d8-4161-9720-44172e0cf91d service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:47.914237 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9bdbb-e2d8-4161-9720-44172e0cf91d service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:47.914703 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9bdbb-e2d8-4161-9720-44172e0cf91d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:47.924764 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9bdbb-e2d8-4161-9720-44172e0cf91d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:35:47.926531 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9bdbb-e2d8-4161-9720-44172e0cf91d service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:35:47.938725 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1125/2251] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:35:47 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:35:59.958367 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89bbf7-6366-4c27-81db-9899272dd48c None None] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:59.958893 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89bbf7-6366-4c27-81db-9899272dd48c None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:59.958998 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89bbf7-6366-4c27-81db-9899272dd48c None None] PATH_INFO: `/` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:35:59.960703 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1127/2252] 10.222.0.25 () {54 vars in 960 bytes} [Wed Oct 27 01:35:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:35:59.966630 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8ff9e-85ab-4541-a954-d59e70faa65f None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:35:59.967143 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8ff9e-85ab-4541-a954-d59e70faa65f None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:35:59.967326 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8ff9e-85ab-4541-a954-d59e70faa65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:00.024604 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-74a8ff9e-85ab-4541-a954-d59e70faa65f None None] MFA Rules not processed for user `2ff82e315d8c42e49556ab67fbf53b32`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:36:00.025870 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-74a8ff9e-85ab-4541-a954-d59e70faa65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:00.103331 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1126/2253] 10.222.0.25 () {58 vars in 1057 bytes} [Wed Oct 27 01:35:59 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:36:00.112766 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89bbf7-6366-4c27-81db-9899272dd48c None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:00.128871 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89bbf7-6366-4c27-81db-9899272dd48c None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:00.134951 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331116c-fd24-410f-b46b-e31721620c72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff82e315d8c42e49556ab67fbf53b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:00.135912 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331116c-fd24-410f-b46b-e31721620c72 service placement] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:00.136336 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331116c-fd24-410f-b46b-e31721620c72 service placement] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:00.138549 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331116c-fd24-410f-b46b-e31721620c72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:00.140286 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-c331116c-fd24-410f-b46b-e31721620c72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:00.153988 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c331116c-fd24-410f-b46b-e31721620c72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:00.155651 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c331116c-fd24-410f-b46b-e31721620c72 service placement] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:00.181256 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1128/2254] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:36:00 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:36:01.594493 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8ff9e-85ab-4541-a954-d59e70faa65f None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:01.689033 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8ff9e-85ab-4541-a954-d59e70faa65f None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:01.695269 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a400e0b-82ce-4d4e-b995-52c3ff02108b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:01.696399 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a400e0b-82ce-4d4e-b995-52c3ff02108b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:01.696688 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a400e0b-82ce-4d4e-b995-52c3ff02108b admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:01.696990 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a400e0b-82ce-4d4e-b995-52c3ff02108b admin admin] PATH_INFO: `/v3/users/2242ab67a4004d309a15468e99bdb3f1` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:01.698510 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a400e0b-82ce-4d4e-b995-52c3ff02108b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2242ab67a4004d309a15468e99bdb3f1)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:01.700737 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a400e0b-82ce-4d4e-b995-52c3ff02108b admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:01.782345 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-6a400e0b-82ce-4d4e-b995-52c3ff02108b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2242ab67a4004d309a15468e99bdb3f1'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:01.794813 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-6a400e0b-82ce-4d4e-b995-52c3ff02108b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2242ab67a4004d309a15468e99bdb3f1'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:01.795523 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-6a400e0b-82ce-4d4e-b995-52c3ff02108b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2242ab67a4004d309a15468e99bdb3f1'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:01.810515 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-6a400e0b-82ce-4d4e-b995-52c3ff02108b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2242ab67a4004d309a15468e99bdb3f1'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:01.819330 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-6a400e0b-82ce-4d4e-b995-52c3ff02108b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2242ab67a4004d309a15468e99bdb3f1'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:01.825977 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1127/2255] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:36:01 2021] DELETE /identity/v3/users/2242ab67a4004d309a15468e99bdb3f1 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:36:02.117723 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331116c-fd24-410f-b46b-e31721620c72 service placement] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:02.135970 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331116c-fd24-410f-b46b-e31721620c72 service placement] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:02.196662 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dcd0a-d494-497e-b4b6-268dce0215ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:02.197451 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dcd0a-d494-497e-b4b6-268dce0215ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:02.197776 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dcd0a-d494-497e-b4b6-268dce0215ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:02.198058 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dcd0a-d494-497e-b4b6-268dce0215ba admin admin] PATH_INFO: `/v3/projects/3883de9671734134b8deb5f54e9aeb00` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:02.199352 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dcd0a-d494-497e-b4b6-268dce0215ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=3883de9671734134b8deb5f54e9aeb00)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:02.201716 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dcd0a-d494-497e-b4b6-268dce0215ba admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:02.247901 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-212dcd0a-d494-497e-b4b6-268dce0215ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3883de9671734134b8deb5f54e9aeb00', 'request_id': 'req-212dcd0a-d494-497e-b4b6-268dce0215ba'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:02.253734 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-212dcd0a-d494-497e-b4b6-268dce0215ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3883de9671734134b8deb5f54e9aeb00', 'request_id': 'req-212dcd0a-d494-497e-b4b6-268dce0215ba'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:02.261006 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-212dcd0a-d494-497e-b4b6-268dce0215ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3883de9671734134b8deb5f54e9aeb00', 'request_id': 'req-212dcd0a-d494-497e-b4b6-268dce0215ba'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:02.272935 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-212dcd0a-d494-497e-b4b6-268dce0215ba admin admin] The token cache is being invalidate because project 3883de9671734134b8deb5f54e9aeb00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:36:02.273336 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-212dcd0a-d494-497e-b4b6-268dce0215ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:02.274242 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-212dcd0a-d494-497e-b4b6-268dce0215ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:02.276264 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1129/2256] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:36:02 2021] DELETE /identity/v3/projects/3883de9671734134b8deb5f54e9aeb00 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:36:02.280590 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a400e0b-82ce-4d4e-b995-52c3ff02108b admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:02.282038 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-6a400e0b-82ce-4d4e-b995-52c3ff02108b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:02.296541 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a400e0b-82ce-4d4e-b995-52c3ff02108b admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:02.358213 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3b1db-3fb9-4f06-bd78-d869250ad5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:02.359179 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3b1db-3fb9-4f06-bd78-d869250ad5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:02.359458 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3b1db-3fb9-4f06-bd78-d869250ad5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:02.359733 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3b1db-3fb9-4f06-bd78-d869250ad5fc admin admin] PATH_INFO: `/v3/users/bab31f4c35fb443f9025db9cc5d942a1` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:02.361039 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3b1db-3fb9-4f06-bd78-d869250ad5fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=bab31f4c35fb443f9025db9cc5d942a1)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:02.362965 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3b1db-3fb9-4f06-bd78-d869250ad5fc admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:02.412715 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-2ef3b1db-3fb9-4f06-bd78-d869250ad5fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bab31f4c35fb443f9025db9cc5d942a1'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:02.420787 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-2ef3b1db-3fb9-4f06-bd78-d869250ad5fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bab31f4c35fb443f9025db9cc5d942a1'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:02.421464 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-2ef3b1db-3fb9-4f06-bd78-d869250ad5fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bab31f4c35fb443f9025db9cc5d942a1'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:02.433360 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-2ef3b1db-3fb9-4f06-bd78-d869250ad5fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bab31f4c35fb443f9025db9cc5d942a1'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:02.441472 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-2ef3b1db-3fb9-4f06-bd78-d869250ad5fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bab31f4c35fb443f9025db9cc5d942a1'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:02.448703 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1128/2257] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:36:02 2021] DELETE /identity/v3/users/bab31f4c35fb443f9025db9cc5d942a1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:36:02.821769 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dcd0a-d494-497e-b4b6-268dce0215ba admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:02.823354 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-212dcd0a-d494-497e-b4b6-268dce0215ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:02.842130 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dcd0a-d494-497e-b4b6-268dce0215ba admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:02.906650 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0e65d-b4e2-4b65-91c0-c30f1baa22b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:02.907741 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0e65d-b4e2-4b65-91c0-c30f1baa22b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:02.908301 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0e65d-b4e2-4b65-91c0-c30f1baa22b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:02.908867 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0e65d-b4e2-4b65-91c0-c30f1baa22b1 admin admin] PATH_INFO: `/v3/projects/5efb34d0960446ea9375b30dc3582fc7` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:02.910500 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0e65d-b4e2-4b65-91c0-c30f1baa22b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5efb34d0960446ea9375b30dc3582fc7)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:02.912588 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0e65d-b4e2-4b65-91c0-c30f1baa22b1 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:02.986049 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-fdb0e65d-b4e2-4b65-91c0-c30f1baa22b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5efb34d0960446ea9375b30dc3582fc7', 'request_id': 'req-fdb0e65d-b4e2-4b65-91c0-c30f1baa22b1'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:02.993942 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-fdb0e65d-b4e2-4b65-91c0-c30f1baa22b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5efb34d0960446ea9375b30dc3582fc7', 'request_id': 'req-fdb0e65d-b4e2-4b65-91c0-c30f1baa22b1'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:03.006602 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-fdb0e65d-b4e2-4b65-91c0-c30f1baa22b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5efb34d0960446ea9375b30dc3582fc7', 'request_id': 'req-fdb0e65d-b4e2-4b65-91c0-c30f1baa22b1'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:03.025773 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-fdb0e65d-b4e2-4b65-91c0-c30f1baa22b1 admin admin] The token cache is being invalidate because project 5efb34d0960446ea9375b30dc3582fc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:36:03.025773 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-fdb0e65d-b4e2-4b65-91c0-c30f1baa22b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:03.026384 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-fdb0e65d-b4e2-4b65-91c0-c30f1baa22b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:03.028995 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1130/2258] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:36:02 2021] DELETE /identity/v3/projects/5efb34d0960446ea9375b30dc3582fc7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:36:05.788055 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d92f9-ca43-45d5-a7c6-ac8815c4fe97 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:05.788668 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d92f9-ca43-45d5-a7c6-ac8815c4fe97 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:05.788668 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d92f9-ca43-45d5-a7c6-ac8815c4fe97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:05.807948 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-398d92f9-ca43-45d5-a7c6-ac8815c4fe97 None None] MFA Rules not processed for user `56895529b11b4236bccb5956a8ccb5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:36:05.809431 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-398d92f9-ca43-45d5-a7c6-ac8815c4fe97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:05.872086 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1129/2259] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Oct 27 01:36:05 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:36:05.885620 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0e65d-b4e2-4b65-91c0-c30f1baa22b1 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:05.888327 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-fdb0e65d-b4e2-4b65-91c0-c30f1baa22b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:05.964542 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0e65d-b4e2-4b65-91c0-c30f1baa22b1 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:05.969503 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f57ff-63ca-4cba-93f6-4b52b0cff050 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f386f358fdb241f5a529a2cf3d839201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:05.970143 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f57ff-63ca-4cba-93f6-4b52b0cff050 service swift] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:05.970429 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f57ff-63ca-4cba-93f6-4b52b0cff050 service swift] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:05.970706 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f57ff-63ca-4cba-93f6-4b52b0cff050 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:05.978770 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f57ff-63ca-4cba-93f6-4b52b0cff050 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:05.980328 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f57ff-63ca-4cba-93f6-4b52b0cff050 service swift] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:05.988608 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1131/2260] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Oct 27 01:36:05 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:36:06.597827 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e370c86-ff1f-4ea8-b8b8-b7564e924638 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:06.598118 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e370c86-ff1f-4ea8-b8b8-b7564e924638 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:06.598400 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e370c86-ff1f-4ea8-b8b8-b7564e924638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:06.616427 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-8e370c86-ff1f-4ea8-b8b8-b7564e924638 None None] MFA Rules not processed for user `56895529b11b4236bccb5956a8ccb5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:36:06.617643 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-8e370c86-ff1f-4ea8-b8b8-b7564e924638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:06.625341 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1130/2261] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Oct 27 01:36:06 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:36:06.637653 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f57ff-63ca-4cba-93f6-4b52b0cff050 service swift] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:06.647789 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f57ff-63ca-4cba-93f6-4b52b0cff050 service swift] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:06.652815 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df456a-2140-4d55-9127-c9d73542072e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f386f358fdb241f5a529a2cf3d839201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:06.653445 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df456a-2140-4d55-9127-c9d73542072e service swift] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:06.653762 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df456a-2140-4d55-9127-c9d73542072e service swift] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:06.654045 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df456a-2140-4d55-9127-c9d73542072e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:06.661914 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df456a-2140-4d55-9127-c9d73542072e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:06.663461 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df456a-2140-4d55-9127-c9d73542072e service swift] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:06.671737 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1132/2262] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Oct 27 01:36:06 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:36:06.984645 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69279f6-b374-40a6-bd11-4bec862b8539 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:06.985113 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69279f6-b374-40a6-bd11-4bec862b8539 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:06.985460 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69279f6-b374-40a6-bd11-4bec862b8539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:07.003881 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-b69279f6-b374-40a6-bd11-4bec862b8539 None None] MFA Rules not processed for user `56895529b11b4236bccb5956a8ccb5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:36:07.005053 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-b69279f6-b374-40a6-bd11-4bec862b8539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:07.012196 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1131/2263] 10.222.0.25 () {58 vars in 967 bytes} [Wed Oct 27 01:36:06 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:36:07.025421 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df456a-2140-4d55-9127-c9d73542072e service swift] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:07.035566 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df456a-2140-4d55-9127-c9d73542072e service swift] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:07.040600 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd3af4-dfc4-48d6-a8f4-43da9415a5a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f386f358fdb241f5a529a2cf3d839201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:07.041235 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd3af4-dfc4-48d6-a8f4-43da9415a5a6 service swift] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:07.041549 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd3af4-dfc4-48d6-a8f4-43da9415a5a6 service swift] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:07.041837 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd3af4-dfc4-48d6-a8f4-43da9415a5a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:07.050088 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd3af4-dfc4-48d6-a8f4-43da9415a5a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:07.051631 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd3af4-dfc4-48d6-a8f4-43da9415a5a6 service swift] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:07.060435 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1133/2264] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Oct 27 01:36:07 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:36:09.073744 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69279f6-b374-40a6-bd11-4bec862b8539 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:09.075664 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-b69279f6-b374-40a6-bd11-4bec862b8539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:09.147750 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69279f6-b374-40a6-bd11-4bec862b8539 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:09.152318 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6359f-743d-473b-b281-237face41e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:09.153824 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6359f-743d-473b-b281-237face41e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:09.154108 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6359f-743d-473b-b281-237face41e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:09.154388 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6359f-743d-473b-b281-237face41e64 admin admin] PATH_INFO: `/v3/users/5620876cadaa43b3b38260b7a52d34fb` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:09.155615 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6359f-743d-473b-b281-237face41e64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5620876cadaa43b3b38260b7a52d34fb)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:09.157562 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6359f-743d-473b-b281-237face41e64 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:09.203134 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b8c6359f-743d-473b-b281-237face41e64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5620876cadaa43b3b38260b7a52d34fb'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:09.209626 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b8c6359f-743d-473b-b281-237face41e64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5620876cadaa43b3b38260b7a52d34fb'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:09.210279 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b8c6359f-743d-473b-b281-237face41e64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5620876cadaa43b3b38260b7a52d34fb'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:09.221909 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b8c6359f-743d-473b-b281-237face41e64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5620876cadaa43b3b38260b7a52d34fb'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:09.228853 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b8c6359f-743d-473b-b281-237face41e64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5620876cadaa43b3b38260b7a52d34fb'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:09.235215 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1132/2265] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:36:09 2021] DELETE /identity/v3/users/5620876cadaa43b3b38260b7a52d34fb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:36:09.239643 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99b2df-06a8-4ece-a30a-e98c572fb03b None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:09.240146 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99b2df-06a8-4ece-a30a-e98c572fb03b None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:09.240243 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99b2df-06a8-4ece-a30a-e98c572fb03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:09.257029 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-4b99b2df-06a8-4ece-a30a-e98c572fb03b None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:36:09.258278 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-4b99b2df-06a8-4ece-a30a-e98c572fb03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:09.316109 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1134/2266] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:36:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:36:09.326002 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6359f-743d-473b-b281-237face41e64 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:09.327474 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-b8c6359f-743d-473b-b281-237face41e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:09.383598 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6359f-743d-473b-b281-237face41e64 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:09.387342 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951baede-2a41-4dde-bf1d-1603915387eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:09.388000 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951baede-2a41-4dde-bf1d-1603915387eb service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:09.388292 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951baede-2a41-4dde-bf1d-1603915387eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:09.388573 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951baede-2a41-4dde-bf1d-1603915387eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:09.397401 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951baede-2a41-4dde-bf1d-1603915387eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:09.398894 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951baede-2a41-4dde-bf1d-1603915387eb service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:09.408645 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1133/2267] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:36:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:36:09.575730 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99b2df-06a8-4ece-a30a-e98c572fb03b None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:09.577141 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-4b99b2df-06a8-4ece-a30a-e98c572fb03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:09.589731 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99b2df-06a8-4ece-a30a-e98c572fb03b None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:09.595996 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ee0eb-66c5-4af6-9352-bafaf4d2b0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:09.597381 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ee0eb-66c5-4af6-9352-bafaf4d2b0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:09.597903 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ee0eb-66c5-4af6-9352-bafaf4d2b0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:09.598188 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ee0eb-66c5-4af6-9352-bafaf4d2b0bd admin admin] PATH_INFO: `/v3/projects/31dc98cdb2d24b2d94d555d9f38d0396` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:09.599443 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ee0eb-66c5-4af6-9352-bafaf4d2b0bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=31dc98cdb2d24b2d94d555d9f38d0396)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:09.601337 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ee0eb-66c5-4af6-9352-bafaf4d2b0bd admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:09.645589 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-3b7ee0eb-66c5-4af6-9352-bafaf4d2b0bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31dc98cdb2d24b2d94d555d9f38d0396', 'request_id': 'req-3b7ee0eb-66c5-4af6-9352-bafaf4d2b0bd'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:09.650857 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-3b7ee0eb-66c5-4af6-9352-bafaf4d2b0bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31dc98cdb2d24b2d94d555d9f38d0396', 'request_id': 'req-3b7ee0eb-66c5-4af6-9352-bafaf4d2b0bd'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:09.658628 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-3b7ee0eb-66c5-4af6-9352-bafaf4d2b0bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31dc98cdb2d24b2d94d555d9f38d0396', 'request_id': 'req-3b7ee0eb-66c5-4af6-9352-bafaf4d2b0bd'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:09.669828 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-3b7ee0eb-66c5-4af6-9352-bafaf4d2b0bd admin admin] The token cache is being invalidate because project 31dc98cdb2d24b2d94d555d9f38d0396 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:36:09.670119 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-3b7ee0eb-66c5-4af6-9352-bafaf4d2b0bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:09.670744 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-3b7ee0eb-66c5-4af6-9352-bafaf4d2b0bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:09.672239 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1135/2268] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:36:09 2021] DELETE /identity/v3/projects/31dc98cdb2d24b2d94d555d9f38d0396 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:36:09.677864 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17edb4-df75-4a46-a3ef-6d83a1ad6511 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:09.678165 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17edb4-df75-4a46-a3ef-6d83a1ad6511 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:09.678437 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17edb4-df75-4a46-a3ef-6d83a1ad6511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:09.696802 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-7e17edb4-df75-4a46-a3ef-6d83a1ad6511 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:36:09.698026 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-7e17edb4-df75-4a46-a3ef-6d83a1ad6511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:09.754143 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1134/2269] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:36:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:36:09.761695 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91336ab2-56b2-424d-bb01-944dde8b3626 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:09.762033 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91336ab2-56b2-424d-bb01-944dde8b3626 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:09.762314 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91336ab2-56b2-424d-bb01-944dde8b3626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:09.779978 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-91336ab2-56b2-424d-bb01-944dde8b3626 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:36:09.781204 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-91336ab2-56b2-424d-bb01-944dde8b3626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:09.789117 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1136/2270] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:36:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:36:09.793042 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17edb4-df75-4a46-a3ef-6d83a1ad6511 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:09.802966 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17edb4-df75-4a46-a3ef-6d83a1ad6511 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:09.808433 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78054a93-9af6-4548-a4e6-d98edb8a0303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:09.809083 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78054a93-9af6-4548-a4e6-d98edb8a0303 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:09.809962 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78054a93-9af6-4548-a4e6-d98edb8a0303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:09.810239 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78054a93-9af6-4548-a4e6-d98edb8a0303 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:09.810969 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78054a93-9af6-4548-a4e6-d98edb8a0303 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:36:09.811270 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78054a93-9af6-4548-a4e6-d98edb8a0303 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:09.812903 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78054a93-9af6-4548-a4e6-d98edb8a0303 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:09.824003 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1135/2271] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:36:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:36:09.828146 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91336ab2-56b2-424d-bb01-944dde8b3626 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:09.837093 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91336ab2-56b2-424d-bb01-944dde8b3626 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:09.841865 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ead4c7-2fa1-4221-a243-bbddbdd20c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:09.842499 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ead4c7-2fa1-4221-a243-bbddbdd20c3b admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:09.842944 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ead4c7-2fa1-4221-a243-bbddbdd20c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:09.843225 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ead4c7-2fa1-4221-a243-bbddbdd20c3b admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:09.843975 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ead4c7-2fa1-4221-a243-bbddbdd20c3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:09.845884 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ead4c7-2fa1-4221-a243-bbddbdd20c3b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:09.872301 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1137/2272] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:36:09 2021] POST /identity/v3/projects => generated 397 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:36:09.875392 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78054a93-9af6-4548-a4e6-d98edb8a0303 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:09.886950 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78054a93-9af6-4548-a4e6-d98edb8a0303 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:09.947722 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc09d4e-dff2-4419-969b-01c2a68ba869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:09.948398 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc09d4e-dff2-4419-969b-01c2a68ba869 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:09.949141 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc09d4e-dff2-4419-969b-01c2a68ba869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:09.949141 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc09d4e-dff2-4419-969b-01c2a68ba869 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:09.949700 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc09d4e-dff2-4419-969b-01c2a68ba869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:09.956547 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc09d4e-dff2-4419-969b-01c2a68ba869 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:09.985872 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1136/2273] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:36:09 2021] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:36:09.989815 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ead4c7-2fa1-4221-a243-bbddbdd20c3b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:10.001355 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ead4c7-2fa1-4221-a243-bbddbdd20c3b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:10.006381 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd893c1-62ca-42da-961e-e7ca8caad139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:10.007121 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd893c1-62ca-42da-961e-e7ca8caad139 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:10.007528 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd893c1-62ca-42da-961e-e7ca8caad139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:10.007882 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd893c1-62ca-42da-961e-e7ca8caad139 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:10.008696 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd893c1-62ca-42da-961e-e7ca8caad139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:10.010388 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd893c1-62ca-42da-961e-e7ca8caad139 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:10.022757 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1138/2274] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:36:09 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:36:10.030594 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc09d4e-dff2-4419-969b-01c2a68ba869 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:10.042382 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc09d4e-dff2-4419-969b-01c2a68ba869 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:10.049346 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474786fa-bbf3-484a-8014-33e930047331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:10.050129 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474786fa-bbf3-484a-8014-33e930047331 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:10.050522 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474786fa-bbf3-484a-8014-33e930047331 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:10.050879 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474786fa-bbf3-484a-8014-33e930047331 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:10.051697 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474786fa-bbf3-484a-8014-33e930047331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:10.054262 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474786fa-bbf3-484a-8014-33e930047331 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:10.069142 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1137/2275] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:36:10 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:36:10.070881 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd893c1-62ca-42da-961e-e7ca8caad139 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:10.082972 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd893c1-62ca-42da-961e-e7ca8caad139 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:10.092647 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee364507-1dca-4d02-80cd-e06ef90470e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:10.093580 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee364507-1dca-4d02-80cd-e06ef90470e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:10.093866 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee364507-1dca-4d02-80cd-e06ef90470e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:10.094145 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee364507-1dca-4d02-80cd-e06ef90470e5 admin admin] PATH_INFO: `/v3/projects/ffe7f598377540efa5a6ba670064547f/users/c5ad4635a42d4611a7b17b1245d7ffe6/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:10.111218 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee364507-1dca-4d02-80cd-e06ef90470e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe7f598377540efa5a6ba670064547f, user_id=c5ad4635a42d4611a7b17b1245d7ffe6, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:10.113931 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee364507-1dca-4d02-80cd-e06ef90470e5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:10.128730 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1139/2276] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:36:10 2021] PUT /identity/v3/projects/ffe7f598377540efa5a6ba670064547f/users/c5ad4635a42d4611a7b17b1245d7ffe6/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:36:10.139463 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9acfe3-5b43-4577-8386-8ebb3ba7d72f None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:10.139959 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9acfe3-5b43-4577-8386-8ebb3ba7d72f None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:10.140111 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9acfe3-5b43-4577-8386-8ebb3ba7d72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:10.167540 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-0a9acfe3-5b43-4577-8386-8ebb3ba7d72f None None] MFA Rules not processed for user `c5ad4635a42d4611a7b17b1245d7ffe6`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:36:10.168837 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-0a9acfe3-5b43-4577-8386-8ebb3ba7d72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:10.238828 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1138/2277] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:36:10 2021] POST /identity/v3/auth/tokens => generated 3417 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:36:10.249378 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee364507-1dca-4d02-80cd-e06ef90470e5 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:10.251190 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-ee364507-1dca-4d02-80cd-e06ef90470e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:10.332466 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee364507-1dca-4d02-80cd-e06ef90470e5 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:10.337185 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5831ed-83f4-45eb-a78c-bae7bdc44dd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:10.338027 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5831ed-83f4-45eb-a78c-bae7bdc44dd9 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:10.338335 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5831ed-83f4-45eb-a78c-bae7bdc44dd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:10.338634 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5831ed-83f4-45eb-a78c-bae7bdc44dd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:10.349892 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5831ed-83f4-45eb-a78c-bae7bdc44dd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:10.351369 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5831ed-83f4-45eb-a78c-bae7bdc44dd9 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:10.361403 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1140/2278] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:36:10 2021] GET /identity/v3/auth/tokens => generated 3417 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:36:15.845082 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0ea21-1760-48b2-8a35-98305d73350e None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:15.845631 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0ea21-1760-48b2-8a35-98305d73350e None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:15.845729 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0ea21-1760-48b2-8a35-98305d73350e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:15.893087 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-28e0ea21-1760-48b2-8a35-98305d73350e None None] MFA Rules not processed for user `56895529b11b4236bccb5956a8ccb5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:36:15.894310 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-28e0ea21-1760-48b2-8a35-98305d73350e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:15.965822 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1139/2279] 10.222.0.25 () {58 vars in 967 bytes} [Wed Oct 27 01:36:15 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:36:15.989392 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5831ed-83f4-45eb-a78c-bae7bdc44dd9 service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:15.990886 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-8c5831ed-83f4-45eb-a78c-bae7bdc44dd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:16.079923 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5831ed-83f4-45eb-a78c-bae7bdc44dd9 service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:16.084807 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a07aa-854c-432f-bee3-cc5f69ff03e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f386f358fdb241f5a529a2cf3d839201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:16.085443 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a07aa-854c-432f-bee3-cc5f69ff03e1 service swift] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:16.085754 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a07aa-854c-432f-bee3-cc5f69ff03e1 service swift] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:16.086029 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a07aa-854c-432f-bee3-cc5f69ff03e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:16.094418 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a07aa-854c-432f-bee3-cc5f69ff03e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:16.095964 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a07aa-854c-432f-bee3-cc5f69ff03e1 service swift] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:16.104343 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1141/2280] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Oct 27 01:36:15 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:36:18.389293 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0ea21-1760-48b2-8a35-98305d73350e None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:18.447810 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0ea21-1760-48b2-8a35-98305d73350e None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:18.452871 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc903a-7c2b-4a07-973f-4232c0fbbe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:18.453758 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc903a-7c2b-4a07-973f-4232c0fbbe41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:18.454041 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc903a-7c2b-4a07-973f-4232c0fbbe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:18.454313 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc903a-7c2b-4a07-973f-4232c0fbbe41 admin admin] PATH_INFO: `/v3/users/c5ad4635a42d4611a7b17b1245d7ffe6` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:18.455482 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc903a-7c2b-4a07-973f-4232c0fbbe41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5ad4635a42d4611a7b17b1245d7ffe6)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:18.457367 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc903a-7c2b-4a07-973f-4232c0fbbe41 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:18.501580 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-76cc903a-7c2b-4a07-973f-4232c0fbbe41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5ad4635a42d4611a7b17b1245d7ffe6'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:18.507979 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-76cc903a-7c2b-4a07-973f-4232c0fbbe41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5ad4635a42d4611a7b17b1245d7ffe6'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:18.508619 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-76cc903a-7c2b-4a07-973f-4232c0fbbe41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5ad4635a42d4611a7b17b1245d7ffe6'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:18.520177 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-76cc903a-7c2b-4a07-973f-4232c0fbbe41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5ad4635a42d4611a7b17b1245d7ffe6'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:18.526367 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-76cc903a-7c2b-4a07-973f-4232c0fbbe41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5ad4635a42d4611a7b17b1245d7ffe6'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:18.532126 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1140/2281] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:36:18 2021] DELETE /identity/v3/users/c5ad4635a42d4611a7b17b1245d7ffe6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:36:18.536617 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a16da5-d28a-41f8-9d08-be710899f1eb None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:18.537123 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a16da5-d28a-41f8-9d08-be710899f1eb None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:18.537226 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a16da5-d28a-41f8-9d08-be710899f1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:18.553298 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-b0a16da5-d28a-41f8-9d08-be710899f1eb None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:36:18.554528 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-b0a16da5-d28a-41f8-9d08-be710899f1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:18.610532 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1142/2282] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:36:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:36:18.620214 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc903a-7c2b-4a07-973f-4232c0fbbe41 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:18.621701 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-76cc903a-7c2b-4a07-973f-4232c0fbbe41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:18.688010 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc903a-7c2b-4a07-973f-4232c0fbbe41 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:18.691793 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330217a3-a1cc-4b3f-bcfc-ff1d39cf2d80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:18.692445 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330217a3-a1cc-4b3f-bcfc-ff1d39cf2d80 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:18.692730 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330217a3-a1cc-4b3f-bcfc-ff1d39cf2d80 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:18.693009 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330217a3-a1cc-4b3f-bcfc-ff1d39cf2d80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:18.702933 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330217a3-a1cc-4b3f-bcfc-ff1d39cf2d80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:18.704294 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330217a3-a1cc-4b3f-bcfc-ff1d39cf2d80 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:18.713562 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1141/2283] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:36:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:36:18.977946 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a16da5-d28a-41f8-9d08-be710899f1eb None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:18.979393 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-b0a16da5-d28a-41f8-9d08-be710899f1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:18.993276 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a16da5-d28a-41f8-9d08-be710899f1eb None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:18.998972 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb8fe7-6123-4308-867d-cdac7c85c434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:19.000467 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb8fe7-6123-4308-867d-cdac7c85c434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:19.000911 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb8fe7-6123-4308-867d-cdac7c85c434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:19.001194 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb8fe7-6123-4308-867d-cdac7c85c434 admin admin] PATH_INFO: `/v3/projects/ffe7f598377540efa5a6ba670064547f` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:19.002527 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb8fe7-6123-4308-867d-cdac7c85c434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffe7f598377540efa5a6ba670064547f)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:19.004553 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb8fe7-6123-4308-867d-cdac7c85c434 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:19.051880 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-8dbb8fe7-6123-4308-867d-cdac7c85c434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe7f598377540efa5a6ba670064547f', 'request_id': 'req-8dbb8fe7-6123-4308-867d-cdac7c85c434'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:19.058287 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-8dbb8fe7-6123-4308-867d-cdac7c85c434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe7f598377540efa5a6ba670064547f', 'request_id': 'req-8dbb8fe7-6123-4308-867d-cdac7c85c434'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:19.066954 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-8dbb8fe7-6123-4308-867d-cdac7c85c434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe7f598377540efa5a6ba670064547f', 'request_id': 'req-8dbb8fe7-6123-4308-867d-cdac7c85c434'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:19.078880 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-8dbb8fe7-6123-4308-867d-cdac7c85c434 admin admin] The token cache is being invalidate because project ffe7f598377540efa5a6ba670064547f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:36:19.079175 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-8dbb8fe7-6123-4308-867d-cdac7c85c434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:19.079911 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-8dbb8fe7-6123-4308-867d-cdac7c85c434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:19.081440 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1143/2284] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:36:18 2021] DELETE /identity/v3/projects/ffe7f598377540efa5a6ba670064547f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:36:34.283734 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330217a3-a1cc-4b3f-bcfc-ff1d39cf2d80 service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:34.285731 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-330217a3-a1cc-4b3f-bcfc-ff1d39cf2d80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:34.299827 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330217a3-a1cc-4b3f-bcfc-ff1d39cf2d80 service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:34.357870 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec941f9b-dfc0-4307-9dc4-846beaba34a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:34.358740 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec941f9b-dfc0-4307-9dc4-846beaba34a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:34.359022 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec941f9b-dfc0-4307-9dc4-846beaba34a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:34.359301 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec941f9b-dfc0-4307-9dc4-846beaba34a4 admin admin] PATH_INFO: `/v3/users/714ca1b794144b1eabeed1ebdaa27669` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:34.360495 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec941f9b-dfc0-4307-9dc4-846beaba34a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=714ca1b794144b1eabeed1ebdaa27669)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:34.362517 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec941f9b-dfc0-4307-9dc4-846beaba34a4 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:34.410494 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-ec941f9b-dfc0-4307-9dc4-846beaba34a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '714ca1b794144b1eabeed1ebdaa27669'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:34.417643 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-ec941f9b-dfc0-4307-9dc4-846beaba34a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '714ca1b794144b1eabeed1ebdaa27669'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:34.418533 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-ec941f9b-dfc0-4307-9dc4-846beaba34a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '714ca1b794144b1eabeed1ebdaa27669'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:34.431470 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-ec941f9b-dfc0-4307-9dc4-846beaba34a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '714ca1b794144b1eabeed1ebdaa27669'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:34.439787 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-ec941f9b-dfc0-4307-9dc4-846beaba34a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '714ca1b794144b1eabeed1ebdaa27669'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:34.445476 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1142/2285] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 01:36:34 2021] DELETE /identity/v3/users/714ca1b794144b1eabeed1ebdaa27669 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:36:34.623217 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb8fe7-6123-4308-867d-cdac7c85c434 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:34.624830 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-8dbb8fe7-6123-4308-867d-cdac7c85c434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:34.642464 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb8fe7-6123-4308-867d-cdac7c85c434 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:34.700922 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff49a1-01c6-4304-9dd5-870ab53f4228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:34.701745 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff49a1-01c6-4304-9dd5-870ab53f4228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:34.702061 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff49a1-01c6-4304-9dd5-870ab53f4228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:34.702341 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff49a1-01c6-4304-9dd5-870ab53f4228 admin admin] PATH_INFO: `/v3/projects/1b65ee42f08f4ae3adb171819a394295` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:34.703606 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff49a1-01c6-4304-9dd5-870ab53f4228 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b65ee42f08f4ae3adb171819a394295)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:34.705630 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff49a1-01c6-4304-9dd5-870ab53f4228 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:34.749159 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-bcff49a1-01c6-4304-9dd5-870ab53f4228 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b65ee42f08f4ae3adb171819a394295', 'request_id': 'req-bcff49a1-01c6-4304-9dd5-870ab53f4228'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:34.754356 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-bcff49a1-01c6-4304-9dd5-870ab53f4228 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b65ee42f08f4ae3adb171819a394295', 'request_id': 'req-bcff49a1-01c6-4304-9dd5-870ab53f4228'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:34.761232 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-bcff49a1-01c6-4304-9dd5-870ab53f4228 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b65ee42f08f4ae3adb171819a394295', 'request_id': 'req-bcff49a1-01c6-4304-9dd5-870ab53f4228'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:34.772396 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-bcff49a1-01c6-4304-9dd5-870ab53f4228 admin admin] The token cache is being invalidate because project 1b65ee42f08f4ae3adb171819a394295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:36:34.772661 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-bcff49a1-01c6-4304-9dd5-870ab53f4228 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:34.773245 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-bcff49a1-01c6-4304-9dd5-870ab53f4228 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:36:34.774901 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1144/2286] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 01:36:34 2021] DELETE /identity/v3/projects/1b65ee42f08f4ae3adb171819a394295 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:36:34.780600 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b254419-6e20-4ae5-ae7f-f3c4db054bf8 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:34.780982 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b254419-6e20-4ae5-ae7f-f3c4db054bf8 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:34.781362 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b254419-6e20-4ae5-ae7f-f3c4db054bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:34.800366 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-7b254419-6e20-4ae5-ae7f-f3c4db054bf8 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:36:34.801697 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-7b254419-6e20-4ae5-ae7f-f3c4db054bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:34.862227 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1143/2287] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:36:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:36:34.869931 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bef922-b63c-40c1-b80a-0fe0809e691d None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:34.870222 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bef922-b63c-40c1-b80a-0fe0809e691d None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:34.870504 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bef922-b63c-40c1-b80a-0fe0809e691d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:34.889687 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-20bef922-b63c-40c1-b80a-0fe0809e691d None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:36:34.890891 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-20bef922-b63c-40c1-b80a-0fe0809e691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:34.898700 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1145/2288] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:36:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:36:34.902872 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b254419-6e20-4ae5-ae7f-f3c4db054bf8 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:34.912415 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b254419-6e20-4ae5-ae7f-f3c4db054bf8 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:34.917081 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97e4ca-d4b8-4b72-ab65-21bdab50fbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:34.917768 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97e4ca-d4b8-4b72-ab65-21bdab50fbfe admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:34.918079 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97e4ca-d4b8-4b72-ab65-21bdab50fbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:34.918358 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97e4ca-d4b8-4b72-ab65-21bdab50fbfe admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:34.919093 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97e4ca-d4b8-4b72-ab65-21bdab50fbfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:36:34.919402 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97e4ca-d4b8-4b72-ab65-21bdab50fbfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:34.920973 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97e4ca-d4b8-4b72-ab65-21bdab50fbfe admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:34.932608 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1144/2289] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 01:36:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:36:34.937017 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bef922-b63c-40c1-b80a-0fe0809e691d None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:34.946017 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bef922-b63c-40c1-b80a-0fe0809e691d None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:34.951358 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114aacc-ea9a-40d7-8b7b-2a72b3027400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:34.951949 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114aacc-ea9a-40d7-8b7b-2a72b3027400 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:34.952231 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114aacc-ea9a-40d7-8b7b-2a72b3027400 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:34.952506 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114aacc-ea9a-40d7-8b7b-2a72b3027400 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:34.953219 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114aacc-ea9a-40d7-8b7b-2a72b3027400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:34.955134 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114aacc-ea9a-40d7-8b7b-2a72b3027400 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:34.980200 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1146/2290] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 01:36:34 2021] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:36:34.984368 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97e4ca-d4b8-4b72-ab65-21bdab50fbfe admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:34.994227 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97e4ca-d4b8-4b72-ab65-21bdab50fbfe admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:35.050171 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef43481-81d6-41c0-a2a5-68cac43109b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:35.050838 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef43481-81d6-41c0-a2a5-68cac43109b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:35.051139 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef43481-81d6-41c0-a2a5-68cac43109b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:35.051445 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef43481-81d6-41c0-a2a5-68cac43109b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:35.052159 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef43481-81d6-41c0-a2a5-68cac43109b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:35.054091 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef43481-81d6-41c0-a2a5-68cac43109b7 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:35.072920 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1145/2291] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 01:36:34 2021] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:36:35.077528 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114aacc-ea9a-40d7-8b7b-2a72b3027400 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:35.087695 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114aacc-ea9a-40d7-8b7b-2a72b3027400 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:35.092686 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def460fa-ec92-4ca0-bd41-40a00d13a8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:35.093342 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def460fa-ec92-4ca0-bd41-40a00d13a8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:35.093682 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def460fa-ec92-4ca0-bd41-40a00d13a8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:35.093965 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def460fa-ec92-4ca0-bd41-40a00d13a8c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:35.094709 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def460fa-ec92-4ca0-bd41-40a00d13a8c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:35.096281 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def460fa-ec92-4ca0-bd41-40a00d13a8c0 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:35.107012 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1147/2292] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:36:35 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:36:35.110769 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef43481-81d6-41c0-a2a5-68cac43109b7 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:35.120843 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef43481-81d6-41c0-a2a5-68cac43109b7 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:35.125600 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ac1bf-48fa-4e21-b3d3-411d8504cec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:35.126251 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ac1bf-48fa-4e21-b3d3-411d8504cec2 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:35.126541 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ac1bf-48fa-4e21-b3d3-411d8504cec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:35.126824 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ac1bf-48fa-4e21-b3d3-411d8504cec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:35.127562 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ac1bf-48fa-4e21-b3d3-411d8504cec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:35.129132 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ac1bf-48fa-4e21-b3d3-411d8504cec2 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:35.139709 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1146/2293] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 01:36:35 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:36:35.143458 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def460fa-ec92-4ca0-bd41-40a00d13a8c0 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:35.154266 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def460fa-ec92-4ca0-bd41-40a00d13a8c0 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:35.158983 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67c65a-33b6-4c0a-955d-c73502638445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:35.159852 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67c65a-33b6-4c0a-955d-c73502638445 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:35.160134 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67c65a-33b6-4c0a-955d-c73502638445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:35.160413 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67c65a-33b6-4c0a-955d-c73502638445 admin admin] PATH_INFO: `/v3/projects/6f423b9700e344a68263020698e12494/users/896ad3ff1d5a4723900241fdca7c73c2/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:35.174576 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67c65a-33b6-4c0a-955d-c73502638445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f423b9700e344a68263020698e12494, user_id=896ad3ff1d5a4723900241fdca7c73c2, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:35.177180 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67c65a-33b6-4c0a-955d-c73502638445 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:35.190083 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1148/2294] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 01:36:35 2021] PUT /identity/v3/projects/6f423b9700e344a68263020698e12494/users/896ad3ff1d5a4723900241fdca7c73c2/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:36:35.195182 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b6259-c3d4-452d-ad7a-58e895ed830e None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:35.195480 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b6259-c3d4-452d-ad7a-58e895ed830e None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:35.195762 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b6259-c3d4-452d-ad7a-58e895ed830e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:35.213759 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-772b6259-c3d4-452d-ad7a-58e895ed830e None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:36:35.214890 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-772b6259-c3d4-452d-ad7a-58e895ed830e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:35.270602 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1147/2295] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:36:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:36:35.280927 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67c65a-33b6-4c0a-955d-c73502638445 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:35.282652 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-aa67c65a-33b6-4c0a-955d-c73502638445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:35.337201 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67c65a-33b6-4c0a-955d-c73502638445 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:35.341640 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e165c-093a-49a1-9708-9f4b3a0d4913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:35.342273 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e165c-093a-49a1-9708-9f4b3a0d4913 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:35.342565 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e165c-093a-49a1-9708-9f4b3a0d4913 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:35.342867 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e165c-093a-49a1-9708-9f4b3a0d4913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:35.351680 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e165c-093a-49a1-9708-9f4b3a0d4913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:35.353087 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e165c-093a-49a1-9708-9f4b3a0d4913 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:35.362296 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1149/2296] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:36:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:36:35.953893 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33e9cb-20c4-4b12-ba48-9f5fb3085d01 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:35.954377 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33e9cb-20c4-4b12-ba48-9f5fb3085d01 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:35.954459 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33e9cb-20c4-4b12-ba48-9f5fb3085d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:35.981877 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-2c33e9cb-20c4-4b12-ba48-9f5fb3085d01 None None] MFA Rules not processed for user `896ad3ff1d5a4723900241fdca7c73c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:36:35.983092 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-2c33e9cb-20c4-4b12-ba48-9f5fb3085d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:36.046570 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1148/2297] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:36:35 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:36:36.056743 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8c999-0cc0-47c8-8638-7eb368fa2307 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:36.057194 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8c999-0cc0-47c8-8638-7eb368fa2307 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:36.057301 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8c999-0cc0-47c8-8638-7eb368fa2307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:36.073839 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-c8d8c999-0cc0-47c8-8638-7eb368fa2307 None None] MFA Rules not processed for user `896ad3ff1d5a4723900241fdca7c73c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:36:36.075584 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-c8d8c999-0cc0-47c8-8638-7eb368fa2307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:36.082672 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1150/2298] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:36:36 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:36:36.094582 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c33e9cb-20c4-4b12-ba48-9f5fb3085d01 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:36:36.095949 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-2c33e9cb-20c4-4b12-ba48-9f5fb3085d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:36:36.195398 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c33e9cb-20c4-4b12-ba48-9f5fb3085d01 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:36:36.201629 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca78872-1947-47c7-b5b3-30ae8c2368a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:36:36.202290 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca78872-1947-47c7-b5b3-30ae8c2368a6 service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:36:36.202555 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca78872-1947-47c7-b5b3-30ae8c2368a6 service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:36:36.202833 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca78872-1947-47c7-b5b3-30ae8c2368a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:36:36.210363 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca78872-1947-47c7-b5b3-30ae8c2368a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:36:36.211921 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca78872-1947-47c7-b5b3-30ae8c2368a6 service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:36:36.220457 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1149/2299] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:36:36 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:37:49.053526 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8c999-0cc0-47c8-8638-7eb368fa2307 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:37:49.066830 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8c999-0cc0-47c8-8638-7eb368fa2307 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:37:49.072103 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526a9c9-f1d0-47c4-b4fd-999ad07ed8d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:37:49.072787 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526a9c9-f1d0-47c4-b4fd-999ad07ed8d0 service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:37:49.073734 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526a9c9-f1d0-47c4-b4fd-999ad07ed8d0 service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:37:49.074012 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526a9c9-f1d0-47c4-b4fd-999ad07ed8d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:37:49.075756 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-c526a9c9-f1d0-47c4-b4fd-999ad07ed8d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:37:49.130894 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526a9c9-f1d0-47c4-b4fd-999ad07ed8d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:37:49.132435 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526a9c9-f1d0-47c4-b4fd-999ad07ed8d0 service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:37:49.141697 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1151/2300] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:37:49 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:37:53.417569 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca78872-1947-47c7-b5b3-30ae8c2368a6 service nova] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:37:53.419021 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-fca78872-1947-47c7-b5b3-30ae8c2368a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:37:53.430876 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca78872-1947-47c7-b5b3-30ae8c2368a6 service nova] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:37:53.434940 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de82089-7189-4a00-b080-f443c23f69eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:37:53.435565 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de82089-7189-4a00-b080-f443c23f69eb service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:37:53.435848 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de82089-7189-4a00-b080-f443c23f69eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:37:53.436124 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de82089-7189-4a00-b080-f443c23f69eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:37:53.437903 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-7de82089-7189-4a00-b080-f443c23f69eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:37:53.446770 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de82089-7189-4a00-b080-f443c23f69eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:37:53.448902 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de82089-7189-4a00-b080-f443c23f69eb service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:37:53.456683 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1150/2301] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:37:53 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:38:01.014998 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526a9c9-f1d0-47c4-b4fd-999ad07ed8d0 service nova] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:38:01.016446 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-c526a9c9-f1d0-47c4-b4fd-999ad07ed8d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:38:01.070008 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526a9c9-f1d0-47c4-b4fd-999ad07ed8d0 service nova] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:38:01.073620 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7f0e3-e115-400e-ae86-c967f85c0f07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:38:01.074253 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7f0e3-e115-400e-ae86-c967f85c0f07 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:38:01.074543 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7f0e3-e115-400e-ae86-c967f85c0f07 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:38:01.074823 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7f0e3-e115-400e-ae86-c967f85c0f07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:38:01.076553 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-3ea7f0e3-e115-400e-ae86-c967f85c0f07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:38:01.131726 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7f0e3-e115-400e-ae86-c967f85c0f07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:38:01.133139 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7f0e3-e115-400e-ae86-c967f85c0f07 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:38:01.141919 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1152/2302] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:38:01 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:38:45.233662 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de82089-7189-4a00-b080-f443c23f69eb service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:38:45.235031 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-7de82089-7189-4a00-b080-f443c23f69eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:38:45.250558 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de82089-7189-4a00-b080-f443c23f69eb service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:38:45.256017 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7bd78-2fc5-4f1c-bf27-8a4ae8825c80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:38:45.256653 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7bd78-2fc5-4f1c-bf27-8a4ae8825c80 service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:38:45.256933 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7bd78-2fc5-4f1c-bf27-8a4ae8825c80 service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:38:45.257207 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7bd78-2fc5-4f1c-bf27-8a4ae8825c80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:38:45.258914 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-03f7bd78-2fc5-4f1c-bf27-8a4ae8825c80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:38:45.313710 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7bd78-2fc5-4f1c-bf27-8a4ae8825c80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:38:45.315269 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7bd78-2fc5-4f1c-bf27-8a4ae8825c80 service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:38:45.323943 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1151/2303] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:38:45 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:40:31.352933 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7f0e3-e115-400e-ae86-c967f85c0f07 service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:40:31.354513 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-3ea7f0e3-e115-400e-ae86-c967f85c0f07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:40:31.365255 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7f0e3-e115-400e-ae86-c967f85c0f07 service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:40:31.368856 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cae638-15c5-4fed-a4f8-7ab748447abf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:40:31.369502 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cae638-15c5-4fed-a4f8-7ab748447abf service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:40:31.369816 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cae638-15c5-4fed-a4f8-7ab748447abf service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:40:31.370099 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cae638-15c5-4fed-a4f8-7ab748447abf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:40:31.372312 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-52cae638-15c5-4fed-a4f8-7ab748447abf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:40:31.427373 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cae638-15c5-4fed-a4f8-7ab748447abf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:40:31.428779 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cae638-15c5-4fed-a4f8-7ab748447abf service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:40:31.438375 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1153/2304] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:40:31 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:41:36.434369 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7bd78-2fc5-4f1c-bf27-8a4ae8825c80 service nova] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:41:36.443462 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7bd78-2fc5-4f1c-bf27-8a4ae8825c80 service nova] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:41:36.447095 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7097608-a18c-41fe-a6bd-e2f384cc5beb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:41:36.447725 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7097608-a18c-41fe-a6bd-e2f384cc5beb service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:41:36.448008 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7097608-a18c-41fe-a6bd-e2f384cc5beb service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:41:36.448322 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7097608-a18c-41fe-a6bd-e2f384cc5beb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:41:36.456334 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7097608-a18c-41fe-a6bd-e2f384cc5beb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:41:36.457791 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7097608-a18c-41fe-a6bd-e2f384cc5beb service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:41:36.467012 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1152/2305] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:41:36 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:41:53.726464 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cae638-15c5-4fed-a4f8-7ab748447abf service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:41:53.727824 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-52cae638-15c5-4fed-a4f8-7ab748447abf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:41:53.793185 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cae638-15c5-4fed-a4f8-7ab748447abf service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:41:53.798208 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d01ab-59d0-438d-84df-6aa514aee3ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff82e315d8c42e49556ab67fbf53b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:41:53.798841 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d01ab-59d0-438d-84df-6aa514aee3ed service placement] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:41:53.799127 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d01ab-59d0-438d-84df-6aa514aee3ed service placement] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:41:53.799407 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d01ab-59d0-438d-84df-6aa514aee3ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:41:53.801121 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-858d01ab-59d0-438d-84df-6aa514aee3ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:41:53.812235 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d01ab-59d0-438d-84df-6aa514aee3ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:41:53.813820 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d01ab-59d0-438d-84df-6aa514aee3ed service placement] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:41:53.823285 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1154/2306] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:41:53 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:42:38.412598 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7097608-a18c-41fe-a6bd-e2f384cc5beb service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:42:38.421702 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7097608-a18c-41fe-a6bd-e2f384cc5beb service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:42:38.425425 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f942229-a21f-44b9-a5ad-46aba7fac26d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:42:38.426128 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f942229-a21f-44b9-a5ad-46aba7fac26d service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:42:38.426412 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f942229-a21f-44b9-a5ad-46aba7fac26d service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:42:38.426692 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f942229-a21f-44b9-a5ad-46aba7fac26d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:42:38.428495 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3f942229-a21f-44b9-a5ad-46aba7fac26d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:42:38.442941 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f942229-a21f-44b9-a5ad-46aba7fac26d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:42:38.444341 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f942229-a21f-44b9-a5ad-46aba7fac26d service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:42:38.455089 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1153/2307] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:42:38 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:42:47.870094 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c353a7-4f43-48e7-9866-28fae8e1a40a None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:42:47.870624 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c353a7-4f43-48e7-9866-28fae8e1a40a None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:42:47.870721 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c353a7-4f43-48e7-9866-28fae8e1a40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:42:47.888781 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-75c353a7-4f43-48e7-9866-28fae8e1a40a None None] MFA Rules not processed for user `896ad3ff1d5a4723900241fdca7c73c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:42:47.890034 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-75c353a7-4f43-48e7-9866-28fae8e1a40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:42:47.896903 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1155/2308] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:42:47 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:42:47.931660 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f942229-a21f-44b9-a5ad-46aba7fac26d service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:42:47.933031 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3f942229-a21f-44b9-a5ad-46aba7fac26d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:42:48.007591 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f942229-a21f-44b9-a5ad-46aba7fac26d service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:42:48.011792 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177e901-e2b4-479f-bfb7-d02d93134f3e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32003a40693246d08640bc7ec45adfc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:42:48.012429 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177e901-e2b4-479f-bfb7-d02d93134f3e service glance] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:42:48.012714 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177e901-e2b4-479f-bfb7-d02d93134f3e service glance] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:42:48.012993 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177e901-e2b4-479f-bfb7-d02d93134f3e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:42:48.014770 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-8177e901-e2b4-479f-bfb7-d02d93134f3e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:42:48.030491 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177e901-e2b4-479f-bfb7-d02d93134f3e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:42:48.031999 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177e901-e2b4-479f-bfb7-d02d93134f3e service glance] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:42:48.044303 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1154/2309] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:42:47 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:42:48.267484 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c353a7-4f43-48e7-9866-28fae8e1a40a None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:42:48.277455 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c353a7-4f43-48e7-9866-28fae8e1a40a None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:42:48.280998 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddf14b-b91d-4982-9613-aca9d6413d2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:42:48.281668 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddf14b-b91d-4982-9613-aca9d6413d2c service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:42:48.281959 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddf14b-b91d-4982-9613-aca9d6413d2c service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:42:48.282238 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddf14b-b91d-4982-9613-aca9d6413d2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:42:48.283977 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-c0ddf14b-b91d-4982-9613-aca9d6413d2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:42:48.293057 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddf14b-b91d-4982-9613-aca9d6413d2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:42:48.294498 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddf14b-b91d-4982-9613-aca9d6413d2c service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:42:48.302313 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1156/2310] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:42:48 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:42:48.616447 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177e901-e2b4-479f-bfb7-d02d93134f3e service glance] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:42:48.617889 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-8177e901-e2b4-479f-bfb7-d02d93134f3e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:42:48.631493 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177e901-e2b4-479f-bfb7-d02d93134f3e service glance] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:42:48.636681 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b25af-5ef9-4730-af34-b40958802252 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff82e315d8c42e49556ab67fbf53b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:42:48.637326 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b25af-5ef9-4730-af34-b40958802252 service placement] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:42:48.637646 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b25af-5ef9-4730-af34-b40958802252 service placement] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:42:48.638015 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b25af-5ef9-4730-af34-b40958802252 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:42:48.639761 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-087b25af-5ef9-4730-af34-b40958802252 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:42:48.651542 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b25af-5ef9-4730-af34-b40958802252 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:42:48.653639 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b25af-5ef9-4730-af34-b40958802252 service placement] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:42:48.663613 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1155/2311] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:42:48 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:42:49.221392 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddf14b-b91d-4982-9613-aca9d6413d2c service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:42:49.236631 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddf14b-b91d-4982-9613-aca9d6413d2c service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:42:49.242112 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d950fde-7fad-45ef-a3a2-87987f9d5f89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:42:49.242742 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d950fde-7fad-45ef-a3a2-87987f9d5f89 service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:42:49.243036 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d950fde-7fad-45ef-a3a2-87987f9d5f89 service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:42:49.243312 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d950fde-7fad-45ef-a3a2-87987f9d5f89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:42:49.251885 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d950fde-7fad-45ef-a3a2-87987f9d5f89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:42:49.253439 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d950fde-7fad-45ef-a3a2-87987f9d5f89 service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:42:49.262902 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1157/2312] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:42:49 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:42:51.144608 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b25af-5ef9-4730-af34-b40958802252 service placement] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:42:51.172964 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b25af-5ef9-4730-af34-b40958802252 service placement] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:42:51.179295 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6f04e-9742-4881-a7fc-fb7c2e76ecd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:42:51.179952 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6f04e-9742-4881-a7fc-fb7c2e76ecd2 service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:42:51.180486 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6f04e-9742-4881-a7fc-fb7c2e76ecd2 service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:42:51.180881 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6f04e-9742-4881-a7fc-fb7c2e76ecd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:42:51.182590 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4ac6f04e-9742-4881-a7fc-fb7c2e76ecd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:42:51.196732 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6f04e-9742-4881-a7fc-fb7c2e76ecd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:42:51.198476 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6f04e-9742-4881-a7fc-fb7c2e76ecd2 service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:42:51.210709 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1156/2313] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:42:51 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:42:56.418421 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d950fde-7fad-45ef-a3a2-87987f9d5f89 service nova] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:42:56.427760 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d950fde-7fad-45ef-a3a2-87987f9d5f89 service nova] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:42:56.431667 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b09088-3904-4379-9e3f-bb19dbee5975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:42:56.432307 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b09088-3904-4379-9e3f-bb19dbee5975 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:42:56.432584 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b09088-3904-4379-9e3f-bb19dbee5975 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:42:56.432866 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b09088-3904-4379-9e3f-bb19dbee5975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:42:56.440824 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b09088-3904-4379-9e3f-bb19dbee5975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:42:56.442260 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b09088-3904-4379-9e3f-bb19dbee5975 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:42:56.450224 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1158/2314] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:42:56 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:42:56.818750 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6f04e-9742-4881-a7fc-fb7c2e76ecd2 service nova] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:42:56.831324 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6f04e-9742-4881-a7fc-fb7c2e76ecd2 service nova] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:42:56.837271 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472b1a0-3e2f-4bdb-ba61-2de7b3de23a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:42:56.838617 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472b1a0-3e2f-4bdb-ba61-2de7b3de23a7 service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:42:56.838913 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472b1a0-3e2f-4bdb-ba61-2de7b3de23a7 service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:42:56.839364 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472b1a0-3e2f-4bdb-ba61-2de7b3de23a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:42:56.841786 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-b472b1a0-3e2f-4bdb-ba61-2de7b3de23a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:42:56.854706 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472b1a0-3e2f-4bdb-ba61-2de7b3de23a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:42:56.857693 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472b1a0-3e2f-4bdb-ba61-2de7b3de23a7 service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:42:56.873181 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1157/2315] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:42:56 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:43:01.499428 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b09088-3904-4379-9e3f-bb19dbee5975 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:43:01.512325 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b09088-3904-4379-9e3f-bb19dbee5975 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:43:01.517709 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce50b17-b4db-40b7-9076-ece0118a3b4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:43:01.518336 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce50b17-b4db-40b7-9076-ece0118a3b4d service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:43:01.518620 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce50b17-b4db-40b7-9076-ece0118a3b4d service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:43:01.518896 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce50b17-b4db-40b7-9076-ece0118a3b4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:43:01.526455 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce50b17-b4db-40b7-9076-ece0118a3b4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:43:01.528657 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce50b17-b4db-40b7-9076-ece0118a3b4d service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:43:01.537216 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1159/2316] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:43:01 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:43:45.554581 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472b1a0-3e2f-4bdb-ba61-2de7b3de23a7 service nova] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:43:45.564446 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472b1a0-3e2f-4bdb-ba61-2de7b3de23a7 service nova] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:43:45.568092 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111933ad-b3ba-4a69-8f37-d1ac76a479ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:43:45.568717 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111933ad-b3ba-4a69-8f37-d1ac76a479ec service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:43:45.569002 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111933ad-b3ba-4a69-8f37-d1ac76a479ec service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:43:45.569281 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111933ad-b3ba-4a69-8f37-d1ac76a479ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:43:45.578153 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111933ad-b3ba-4a69-8f37-d1ac76a479ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:43:45.579557 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111933ad-b3ba-4a69-8f37-d1ac76a479ec service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:43:45.606516 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1158/2317] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:43:45 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:45:32.060441 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce50b17-b4db-40b7-9076-ece0118a3b4d service nova] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:45:32.079808 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce50b17-b4db-40b7-9076-ece0118a3b4d service nova] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:45:32.083380 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e9ff4-2fe6-495e-8b2f-c344b388821a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:45:32.084045 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e9ff4-2fe6-495e-8b2f-c344b388821a service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:45:32.084330 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e9ff4-2fe6-495e-8b2f-c344b388821a service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:45:32.084610 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e9ff4-2fe6-495e-8b2f-c344b388821a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:45:32.106496 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e9ff4-2fe6-495e-8b2f-c344b388821a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:45:32.107919 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e9ff4-2fe6-495e-8b2f-c344b388821a service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:45:32.134158 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1160/2318] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:45:32 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:46:35.212849 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111933ad-b3ba-4a69-8f37-d1ac76a479ec service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:46:35.248037 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111933ad-b3ba-4a69-8f37-d1ac76a479ec service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:46:35.251539 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4cf786-c3d0-49ed-9cd9-4bcb34daefe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:46:35.252167 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cf786-c3d0-49ed-9cd9-4bcb34daefe6 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:46:35.252447 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cf786-c3d0-49ed-9cd9-4bcb34daefe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:46:35.252721 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cf786-c3d0-49ed-9cd9-4bcb34daefe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:46:35.260687 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4cf786-c3d0-49ed-9cd9-4bcb34daefe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:46:35.262133 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4cf786-c3d0-49ed-9cd9-4bcb34daefe6 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:46:35.270472 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1159/2319] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:46:35 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:46:56.759225 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e9ff4-2fe6-495e-8b2f-c344b388821a service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:46:56.788312 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e9ff4-2fe6-495e-8b2f-c344b388821a service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:46:56.793922 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4bce9-cc03-4ff8-9631-76cb2e40f168 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff82e315d8c42e49556ab67fbf53b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:46:56.794557 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4bce9-cc03-4ff8-9631-76cb2e40f168 service placement] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:46:56.794845 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4bce9-cc03-4ff8-9631-76cb2e40f168 service placement] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:46:56.795122 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4bce9-cc03-4ff8-9631-76cb2e40f168 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:46:56.804254 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4bce9-cc03-4ff8-9631-76cb2e40f168 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:46:56.805830 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4bce9-cc03-4ff8-9631-76cb2e40f168 service placement] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:46:56.816207 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1161/2320] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:46:56 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:47:49.834198 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4cf786-c3d0-49ed-9cd9-4bcb34daefe6 service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:47:49.842927 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4cf786-c3d0-49ed-9cd9-4bcb34daefe6 service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:47:49.846553 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cc052-1a32-4978-a7e5-2b49d6acfd1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:47:49.847179 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cc052-1a32-4978-a7e5-2b49d6acfd1f service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:47:49.847462 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cc052-1a32-4978-a7e5-2b49d6acfd1f service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:47:49.847740 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cc052-1a32-4978-a7e5-2b49d6acfd1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:47:49.849609 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-617cc052-1a32-4978-a7e5-2b49d6acfd1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:47:49.935039 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cc052-1a32-4978-a7e5-2b49d6acfd1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:47:49.936450 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cc052-1a32-4978-a7e5-2b49d6acfd1f service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:47:49.954057 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1160/2321] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:47:49 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:48:00.395818 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4bce9-cc03-4ff8-9631-76cb2e40f168 service placement] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:48:00.397467 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-31a4bce9-cc03-4ff8-9631-76cb2e40f168 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:48:00.473127 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4bce9-cc03-4ff8-9631-76cb2e40f168 service placement] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:48:00.482872 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd5af9-1246-4daf-8316-cb1617120f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:48:00.483541 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd5af9-1246-4daf-8316-cb1617120f58 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:48:00.483826 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd5af9-1246-4daf-8316-cb1617120f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:48:00.484103 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd5af9-1246-4daf-8316-cb1617120f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:48:00.486078 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-8ddd5af9-1246-4daf-8316-cb1617120f58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:48:00.495865 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd5af9-1246-4daf-8316-cb1617120f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:48:00.497261 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd5af9-1246-4daf-8316-cb1617120f58 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:48:00.505141 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1162/2322] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:48:00 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:48:01.789411 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cc052-1a32-4978-a7e5-2b49d6acfd1f service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:48:01.791603 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-617cc052-1a32-4978-a7e5-2b49d6acfd1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:48:01.884751 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cc052-1a32-4978-a7e5-2b49d6acfd1f service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:48:01.890216 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f0946-2038-4b5d-90ed-c81d19ee9a96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:48:01.890847 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f0946-2038-4b5d-90ed-c81d19ee9a96 service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:48:01.891134 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f0946-2038-4b5d-90ed-c81d19ee9a96 service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:48:01.891410 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f0946-2038-4b5d-90ed-c81d19ee9a96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:48:01.893249 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-ec0f0946-2038-4b5d-90ed-c81d19ee9a96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:48:01.967100 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f0946-2038-4b5d-90ed-c81d19ee9a96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:48:01.968664 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f0946-2038-4b5d-90ed-c81d19ee9a96 service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:48:01.986595 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1161/2323] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:48:01 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:48:39.364772 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd5af9-1246-4daf-8316-cb1617120f58 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:48:39.366464 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-8ddd5af9-1246-4daf-8316-cb1617120f58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:48:39.376886 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd5af9-1246-4daf-8316-cb1617120f58 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:48:39.380512 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bde5d1-955b-4f46-a63f-c59af610f331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:48:39.381150 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bde5d1-955b-4f46-a63f-c59af610f331 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:48:39.381433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bde5d1-955b-4f46-a63f-c59af610f331 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:48:39.381750 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bde5d1-955b-4f46-a63f-c59af610f331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:48:39.391749 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bde5d1-955b-4f46-a63f-c59af610f331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:48:39.393149 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bde5d1-955b-4f46-a63f-c59af610f331 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:48:39.404336 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1163/2324] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:48:39 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:48:40.573644 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f0946-2038-4b5d-90ed-c81d19ee9a96 service nova] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:48:40.582842 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f0946-2038-4b5d-90ed-c81d19ee9a96 service nova] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:48:40.586492 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30b925-ec25-4a75-a10c-3311c6db9213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:48:40.587124 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30b925-ec25-4a75-a10c-3311c6db9213 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:48:40.587408 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30b925-ec25-4a75-a10c-3311c6db9213 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:48:40.587690 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30b925-ec25-4a75-a10c-3311c6db9213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:48:40.597631 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30b925-ec25-4a75-a10c-3311c6db9213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:48:40.599042 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30b925-ec25-4a75-a10c-3311c6db9213 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:48:40.610410 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1162/2325] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:48:40 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:48:45.770694 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bde5d1-955b-4f46-a63f-c59af610f331 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:48:45.772189 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-51bde5d1-955b-4f46-a63f-c59af610f331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:48:45.836778 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bde5d1-955b-4f46-a63f-c59af610f331 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:48:45.840382 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda793ab-309b-4a6e-9314-49822633ff13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:48:45.841014 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda793ab-309b-4a6e-9314-49822633ff13 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:48:45.841299 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda793ab-309b-4a6e-9314-49822633ff13 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:48:45.841613 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda793ab-309b-4a6e-9314-49822633ff13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:48:45.843422 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-cda793ab-309b-4a6e-9314-49822633ff13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:48:45.911414 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda793ab-309b-4a6e-9314-49822633ff13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:48:45.912830 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda793ab-309b-4a6e-9314-49822633ff13 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:48:45.922376 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1164/2326] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:48:45 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:48:59.310043 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8e401-af51-4ae4-8d05-f708af611af7 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:48:59.310617 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8e401-af51-4ae4-8d05-f708af611af7 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:48:59.310617 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8e401-af51-4ae4-8d05-f708af611af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:48:59.357664 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-6bc8e401-af51-4ae4-8d05-f708af611af7 None None] MFA Rules not processed for user `896ad3ff1d5a4723900241fdca7c73c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:48:59.359006 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-6bc8e401-af51-4ae4-8d05-f708af611af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:48:59.420076 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1163/2327] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:48:59 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:48:59.668167 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda793ab-309b-4a6e-9314-49822633ff13 service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:48:59.677235 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda793ab-309b-4a6e-9314-49822633ff13 service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:48:59.681821 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10542db1-e169-4358-be87-4b6a3104bf3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:48:59.682448 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10542db1-e169-4358-be87-4b6a3104bf3d service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:48:59.682730 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10542db1-e169-4358-be87-4b6a3104bf3d service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:48:59.683004 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10542db1-e169-4358-be87-4b6a3104bf3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:48:59.690351 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10542db1-e169-4358-be87-4b6a3104bf3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:48:59.691919 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10542db1-e169-4358-be87-4b6a3104bf3d service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:48:59.700439 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1165/2328] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:48:59 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:49:00.009398 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8e401-af51-4ae4-8d05-f708af611af7 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:49:00.021001 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8e401-af51-4ae4-8d05-f708af611af7 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:49:00.025901 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c15f88-2cb9-4896-b76b-cb69ba0ca2ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff82e315d8c42e49556ab67fbf53b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:49:00.026565 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c15f88-2cb9-4896-b76b-cb69ba0ca2ed service placement] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:49:00.026865 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c15f88-2cb9-4896-b76b-cb69ba0ca2ed service placement] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:49:00.027118 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c15f88-2cb9-4896-b76b-cb69ba0ca2ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:49:00.036165 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c15f88-2cb9-4896-b76b-cb69ba0ca2ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:49:00.037758 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c15f88-2cb9-4896-b76b-cb69ba0ca2ed service placement] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:49:00.051592 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1164/2329] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:49:00 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:49:02.458355 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10542db1-e169-4358-be87-4b6a3104bf3d service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:49:02.461113 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-10542db1-e169-4358-be87-4b6a3104bf3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:49:02.486272 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10542db1-e169-4358-be87-4b6a3104bf3d service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:49:02.493762 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443de5b-fbf8-4713-974a-1636e2ce380f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:49:02.494495 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443de5b-fbf8-4713-974a-1636e2ce380f service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:49:02.494791 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443de5b-fbf8-4713-974a-1636e2ce380f service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:49:02.495074 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443de5b-fbf8-4713-974a-1636e2ce380f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:49:02.497009 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-6443de5b-fbf8-4713-974a-1636e2ce380f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:49:02.510019 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443de5b-fbf8-4713-974a-1636e2ce380f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:49:02.511699 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443de5b-fbf8-4713-974a-1636e2ce380f service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:49:02.525638 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1166/2330] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:49:02 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:49:08.493352 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c15f88-2cb9-4896-b76b-cb69ba0ca2ed service placement] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:49:08.506310 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c15f88-2cb9-4896-b76b-cb69ba0ca2ed service placement] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:49:08.512630 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf75b44-b1d2-4a12-9034-1211d505adff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:49:08.513284 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf75b44-b1d2-4a12-9034-1211d505adff service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:49:08.513596 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf75b44-b1d2-4a12-9034-1211d505adff service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:49:08.513878 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf75b44-b1d2-4a12-9034-1211d505adff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:49:08.523637 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf75b44-b1d2-4a12-9034-1211d505adff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:49:08.525253 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf75b44-b1d2-4a12-9034-1211d505adff service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:49:08.537474 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1165/2331] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:49:08 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:50:31.322548 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443de5b-fbf8-4713-974a-1636e2ce380f service nova] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:50:31.333791 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443de5b-fbf8-4713-974a-1636e2ce380f service nova] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:50:31.339326 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b98205-6e51-4090-812c-a687cbe5cbfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:50:31.339955 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b98205-6e51-4090-812c-a687cbe5cbfb service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:50:31.340243 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b98205-6e51-4090-812c-a687cbe5cbfb service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:50:31.340525 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b98205-6e51-4090-812c-a687cbe5cbfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:50:31.348184 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b98205-6e51-4090-812c-a687cbe5cbfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:50:31.349788 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b98205-6e51-4090-812c-a687cbe5cbfb service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:50:31.358867 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1167/2332] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:50:31 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:51:35.190520 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf75b44-b1d2-4a12-9034-1211d505adff service nova] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:51:35.192102 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-cdf75b44-b1d2-4a12-9034-1211d505adff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:51:35.203606 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf75b44-b1d2-4a12-9034-1211d505adff service nova] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:51:35.207297 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd764e-8158-49d7-9037-c03145615375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:51:35.207934 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd764e-8158-49d7-9037-c03145615375 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:51:35.208219 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd764e-8158-49d7-9037-c03145615375 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:51:35.208499 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd764e-8158-49d7-9037-c03145615375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:51:35.210379 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-b7bd764e-8158-49d7-9037-c03145615375 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:51:35.221136 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd764e-8158-49d7-9037-c03145615375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:51:35.222563 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd764e-8158-49d7-9037-c03145615375 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:51:35.231895 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1166/2333] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:51:35 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:51:57.751128 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b98205-6e51-4090-812c-a687cbe5cbfb service nova] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:51:57.752696 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-19b98205-6e51-4090-812c-a687cbe5cbfb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:51:57.831112 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b98205-6e51-4090-812c-a687cbe5cbfb service nova] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:51:57.836139 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcf14b-8ace-4401-b14a-e9bd4a1d3aed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff82e315d8c42e49556ab67fbf53b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:51:57.836774 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcf14b-8ace-4401-b14a-e9bd4a1d3aed service placement] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:51:57.837059 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcf14b-8ace-4401-b14a-e9bd4a1d3aed service placement] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:51:57.837332 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcf14b-8ace-4401-b14a-e9bd4a1d3aed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:51:57.839220 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-89bcf14b-8ace-4401-b14a-e9bd4a1d3aed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:51:57.850120 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcf14b-8ace-4401-b14a-e9bd4a1d3aed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:51:57.851666 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcf14b-8ace-4401-b14a-e9bd4a1d3aed service placement] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:51:57.861117 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1168/2334] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:51:57 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:52:49.262792 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd764e-8158-49d7-9037-c03145615375 service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:52:49.275244 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd764e-8158-49d7-9037-c03145615375 service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:52:49.280919 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0f489-43c0-4e48-8c78-aa2c0798049f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:52:49.281589 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0f489-43c0-4e48-8c78-aa2c0798049f service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:52:49.281877 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0f489-43c0-4e48-8c78-aa2c0798049f service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:52:49.282157 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0f489-43c0-4e48-8c78-aa2c0798049f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:52:49.290539 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0f489-43c0-4e48-8c78-aa2c0798049f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:52:49.292097 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0f489-43c0-4e48-8c78-aa2c0798049f service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:52:49.300853 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1167/2335] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:52:49 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:53:02.325081 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcf14b-8ace-4401-b14a-e9bd4a1d3aed service placement] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:53:02.334305 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcf14b-8ace-4401-b14a-e9bd4a1d3aed service placement] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:53:02.337918 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10151d7f-d13b-420a-a888-a060968d98d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:53:02.338546 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10151d7f-d13b-420a-a888-a060968d98d8 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:53:02.338832 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10151d7f-d13b-420a-a888-a060968d98d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:53:02.339111 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10151d7f-d13b-420a-a888-a060968d98d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:53:02.347523 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10151d7f-d13b-420a-a888-a060968d98d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:53:02.348943 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10151d7f-d13b-420a-a888-a060968d98d8 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:53:02.358059 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1169/2336] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:53:02 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:53:06.412949 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0f489-43c0-4e48-8c78-aa2c0798049f service nova] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:53:06.422064 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0f489-43c0-4e48-8c78-aa2c0798049f service nova] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:53:06.425660 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f53aba-6b25-48e1-8043-b2e457db32ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:53:06.426286 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f53aba-6b25-48e1-8043-b2e457db32ed service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:53:06.426564 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f53aba-6b25-48e1-8043-b2e457db32ed service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:53:06.426840 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f53aba-6b25-48e1-8043-b2e457db32ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:53:06.433986 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f53aba-6b25-48e1-8043-b2e457db32ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:53:06.435377 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f53aba-6b25-48e1-8043-b2e457db32ed service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:53:06.443499 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1168/2337] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:53:06 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:53:40.251277 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10151d7f-d13b-420a-a888-a060968d98d8 service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:53:40.260403 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10151d7f-d13b-420a-a888-a060968d98d8 service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:53:40.264072 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f01d23-415c-4c0a-8336-a440ce169783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:53:40.264706 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f01d23-415c-4c0a-8336-a440ce169783 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:53:40.264993 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f01d23-415c-4c0a-8336-a440ce169783 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:53:40.265272 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f01d23-415c-4c0a-8336-a440ce169783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:53:40.267166 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-49f01d23-415c-4c0a-8336-a440ce169783 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:53:40.281228 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f01d23-415c-4c0a-8336-a440ce169783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:53:40.282678 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f01d23-415c-4c0a-8336-a440ce169783 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:53:40.294185 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1170/2338] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:53:40 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:53:41.493150 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f53aba-6b25-48e1-8043-b2e457db32ed service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:53:41.501649 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f53aba-6b25-48e1-8043-b2e457db32ed service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:53:41.505915 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07ab02-b740-462f-9140-3c7d10b72dd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:53:41.506552 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07ab02-b740-462f-9140-3c7d10b72dd9 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:53:41.506842 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07ab02-b740-462f-9140-3c7d10b72dd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:53:41.507115 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07ab02-b740-462f-9140-3c7d10b72dd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:53:41.509010 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-2f07ab02-b740-462f-9140-3c7d10b72dd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:53:41.528814 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07ab02-b740-462f-9140-3c7d10b72dd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:53:41.530240 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07ab02-b740-462f-9140-3c7d10b72dd9 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:53:41.540882 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1169/2339] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:53:41 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:53:45.985052 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f01d23-415c-4c0a-8336-a440ce169783 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:53:45.996706 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f01d23-415c-4c0a-8336-a440ce169783 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:53:46.002570 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb118936-2c24-4e2b-8668-6f040ef23d08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:53:46.003950 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb118936-2c24-4e2b-8668-6f040ef23d08 service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:53:46.004237 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb118936-2c24-4e2b-8668-6f040ef23d08 service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:53:46.004517 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb118936-2c24-4e2b-8668-6f040ef23d08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:53:46.012476 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb118936-2c24-4e2b-8668-6f040ef23d08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:53:46.014196 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb118936-2c24-4e2b-8668-6f040ef23d08 service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:53:46.040147 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1171/2340] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:53:45 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:54:42.141292 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07ab02-b740-462f-9140-3c7d10b72dd9 service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:54:42.157822 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07ab02-b740-462f-9140-3c7d10b72dd9 service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:54:42.165311 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6dede-bbfe-47ce-bc24-7bfdd48b1ac7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:54:42.165971 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6dede-bbfe-47ce-bc24-7bfdd48b1ac7 service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:54:42.166308 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6dede-bbfe-47ce-bc24-7bfdd48b1ac7 service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:54:42.166793 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6dede-bbfe-47ce-bc24-7bfdd48b1ac7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:54:42.169664 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-63d6dede-bbfe-47ce-bc24-7bfdd48b1ac7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:54:42.186279 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6dede-bbfe-47ce-bc24-7bfdd48b1ac7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:54:42.188089 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6dede-bbfe-47ce-bc24-7bfdd48b1ac7 service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:54:42.207807 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1170/2341] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:54:42 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:55:07.213818 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb118936-2c24-4e2b-8668-6f040ef23d08 service nova] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:55:07.227451 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb118936-2c24-4e2b-8668-6f040ef23d08 service nova] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:55:07.234869 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef88697-a116-43a7-b699-c796c276be06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:55:07.235871 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef88697-a116-43a7-b699-c796c276be06 service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:55:07.236342 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef88697-a116-43a7-b699-c796c276be06 service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:55:07.236812 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef88697-a116-43a7-b699-c796c276be06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:55:07.246983 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef88697-a116-43a7-b699-c796c276be06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:55:07.249004 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef88697-a116-43a7-b699-c796c276be06 service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:55:07.261581 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1172/2342] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:55:07 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:55:09.886025 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eec451-3ff0-40ec-b0ad-200c9eb35571 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:55:09.886535 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eec451-3ff0-40ec-b0ad-200c9eb35571 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:55:09.886641 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eec451-3ff0-40ec-b0ad-200c9eb35571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:55:09.912598 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-41eec451-3ff0-40ec-b0ad-200c9eb35571 None None] MFA Rules not processed for user `b164b9dd32884e99b0b22eb7c50bdda2`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:55:09.913823 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-41eec451-3ff0-40ec-b0ad-200c9eb35571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:55:09.920774 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1171/2343] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 01:55:09 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:55:10.270860 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef88697-a116-43a7-b699-c796c276be06 service nova] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:55:10.280008 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef88697-a116-43a7-b699-c796c276be06 service nova] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:55:10.283562 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43883c8c-fdbc-4485-bc3e-a1b7ab7dec8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:55:10.284192 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43883c8c-fdbc-4485-bc3e-a1b7ab7dec8f service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:55:10.284473 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43883c8c-fdbc-4485-bc3e-a1b7ab7dec8f service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:55:10.284751 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43883c8c-fdbc-4485-bc3e-a1b7ab7dec8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:55:10.286517 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-43883c8c-fdbc-4485-bc3e-a1b7ab7dec8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:55:10.296106 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43883c8c-fdbc-4485-bc3e-a1b7ab7dec8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:55:10.297534 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43883c8c-fdbc-4485-bc3e-a1b7ab7dec8f service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:55:10.306444 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1173/2344] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:55:10 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:55:10.617148 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eec451-3ff0-40ec-b0ad-200c9eb35571 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:55:10.629632 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eec451-3ff0-40ec-b0ad-200c9eb35571 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:55:10.634862 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309068de-d5b4-4c19-92a6-2b3447590011 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff82e315d8c42e49556ab67fbf53b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:55:10.635670 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309068de-d5b4-4c19-92a6-2b3447590011 service placement] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:55:10.635976 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309068de-d5b4-4c19-92a6-2b3447590011 service placement] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:55:10.636258 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309068de-d5b4-4c19-92a6-2b3447590011 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:55:10.638199 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-309068de-d5b4-4c19-92a6-2b3447590011 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:55:10.650416 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309068de-d5b4-4c19-92a6-2b3447590011 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:55:10.651780 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309068de-d5b4-4c19-92a6-2b3447590011 service placement] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:55:10.661761 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1172/2345] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:55:10 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:55:16.289726 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70285e25-59d1-4d86-b162-17b07e52223a None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:55:16.290257 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70285e25-59d1-4d86-b162-17b07e52223a None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:55:16.290383 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70285e25-59d1-4d86-b162-17b07e52223a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:55:16.348384 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-70285e25-59d1-4d86-b162-17b07e52223a None None] MFA Rules not processed for user `56895529b11b4236bccb5956a8ccb5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:55:16.349638 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-70285e25-59d1-4d86-b162-17b07e52223a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:55:16.413131 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1174/2346] 10.222.0.25 () {58 vars in 967 bytes} [Wed Oct 27 01:55:16 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:55:16.459346 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309068de-d5b4-4c19-92a6-2b3447590011 service placement] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:55:16.460758 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-309068de-d5b4-4c19-92a6-2b3447590011 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:55:16.551179 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309068de-d5b4-4c19-92a6-2b3447590011 service placement] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:55:16.558254 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1507d64-5b5e-41b1-91d8-4f37a7470d45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f386f358fdb241f5a529a2cf3d839201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:55:16.558908 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1507d64-5b5e-41b1-91d8-4f37a7470d45 service swift] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:55:16.559197 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1507d64-5b5e-41b1-91d8-4f37a7470d45 service swift] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:55:16.559479 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1507d64-5b5e-41b1-91d8-4f37a7470d45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:55:16.568599 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1507d64-5b5e-41b1-91d8-4f37a7470d45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:55:16.570249 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1507d64-5b5e-41b1-91d8-4f37a7470d45 service swift] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:55:16.578506 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1173/2347] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Oct 27 01:55:16 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:55:17.093547 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70285e25-59d1-4d86-b162-17b07e52223a None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:55:17.103700 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70285e25-59d1-4d86-b162-17b07e52223a None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:55:17.107511 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8c667-5dc2-4ca6-87eb-21acfce3adf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:55:17.108162 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8c667-5dc2-4ca6-87eb-21acfce3adf6 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:55:17.108447 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8c667-5dc2-4ca6-87eb-21acfce3adf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:55:17.108725 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8c667-5dc2-4ca6-87eb-21acfce3adf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:55:17.111215 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-afe8c667-5dc2-4ca6-87eb-21acfce3adf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:55:17.195065 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8c667-5dc2-4ca6-87eb-21acfce3adf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:55:17.196479 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8c667-5dc2-4ca6-87eb-21acfce3adf6 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:55:17.215030 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1175/2348] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:55:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:55:18.318832 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1507d64-5b5e-41b1-91d8-4f37a7470d45 service swift] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:55:18.334284 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1507d64-5b5e-41b1-91d8-4f37a7470d45 service swift] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:55:18.340162 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73bbf39-1742-40de-b95e-1baa6abbe082 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:55:18.340810 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bbf39-1742-40de-b95e-1baa6abbe082 service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:55:18.341222 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bbf39-1742-40de-b95e-1baa6abbe082 service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:55:18.341533 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bbf39-1742-40de-b95e-1baa6abbe082 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:55:18.343550 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-e73bbf39-1742-40de-b95e-1baa6abbe082 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:55:18.358768 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73bbf39-1742-40de-b95e-1baa6abbe082 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:55:18.361626 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73bbf39-1742-40de-b95e-1baa6abbe082 service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:55:18.377981 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1174/2349] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:55:18 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:55:36.257620 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8c667-5dc2-4ca6-87eb-21acfce3adf6 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:55:36.266785 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8c667-5dc2-4ca6-87eb-21acfce3adf6 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:55:36.270375 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d175c16-ba1a-4c95-8896-4883e2260971 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:55:36.271005 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d175c16-ba1a-4c95-8896-4883e2260971 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:55:36.271292 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d175c16-ba1a-4c95-8896-4883e2260971 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:55:36.271573 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d175c16-ba1a-4c95-8896-4883e2260971 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:55:36.273401 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-1d175c16-ba1a-4c95-8896-4883e2260971 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:55:36.363087 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d175c16-ba1a-4c95-8896-4883e2260971 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:55:36.364433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d175c16-ba1a-4c95-8896-4883e2260971 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:55:36.381858 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1176/2350] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:55:36 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:56:42.233213 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73bbf39-1742-40de-b95e-1baa6abbe082 service nova] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:56:42.268362 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73bbf39-1742-40de-b95e-1baa6abbe082 service nova] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:56:42.272088 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded3738-5eed-407a-860d-f082605207f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:56:42.272718 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded3738-5eed-407a-860d-f082605207f6 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:56:42.273000 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded3738-5eed-407a-860d-f082605207f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:56:42.273275 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded3738-5eed-407a-860d-f082605207f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:56:42.281252 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded3738-5eed-407a-860d-f082605207f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:56:42.282680 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded3738-5eed-407a-860d-f082605207f6 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:56:42.291628 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1175/2351] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:56:42 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:56:59.779547 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d175c16-ba1a-4c95-8896-4883e2260971 service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:56:59.781113 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-1d175c16-ba1a-4c95-8896-4883e2260971 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:56:59.820650 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d175c16-ba1a-4c95-8896-4883e2260971 service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:56:59.825690 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078d2c0-23ff-4bd7-a5f5-55e13671368c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff82e315d8c42e49556ab67fbf53b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:56:59.826325 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078d2c0-23ff-4bd7-a5f5-55e13671368c service placement] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:56:59.826610 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078d2c0-23ff-4bd7-a5f5-55e13671368c service placement] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:56:59.826889 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078d2c0-23ff-4bd7-a5f5-55e13671368c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:56:59.835592 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078d2c0-23ff-4bd7-a5f5-55e13671368c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:56:59.837144 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078d2c0-23ff-4bd7-a5f5-55e13671368c service placement] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:56:59.846618 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1177/2352] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:56:59 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:58:03.422110 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded3738-5eed-407a-860d-f082605207f6 service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:58:03.423687 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3ded3738-5eed-407a-860d-f082605207f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:58:03.527843 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded3738-5eed-407a-860d-f082605207f6 service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:58:03.533394 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e86f2f-929e-4c95-b471-c9e6a263638e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:58:03.534058 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e86f2f-929e-4c95-b471-c9e6a263638e service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:58:03.534345 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e86f2f-929e-4c95-b471-c9e6a263638e service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:58:03.534621 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e86f2f-929e-4c95-b471-c9e6a263638e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:58:03.536482 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-25e86f2f-929e-4c95-b471-c9e6a263638e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:58:03.611661 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e86f2f-929e-4c95-b471-c9e6a263638e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:58:03.613219 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e86f2f-929e-4c95-b471-c9e6a263638e service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:58:03.630700 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1176/2353] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:58:03 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:58:09.376431 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078d2c0-23ff-4bd7-a5f5-55e13671368c service placement] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:58:09.437234 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078d2c0-23ff-4bd7-a5f5-55e13671368c service placement] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:58:09.440854 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ee565-1ea5-40a7-b3d2-793b89bdba79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:58:09.441505 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ee565-1ea5-40a7-b3d2-793b89bdba79 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:58:09.441792 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ee565-1ea5-40a7-b3d2-793b89bdba79 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:58:09.442066 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ee565-1ea5-40a7-b3d2-793b89bdba79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:58:09.443903 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-c52ee565-1ea5-40a7-b3d2-793b89bdba79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:58:09.465768 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ee565-1ea5-40a7-b3d2-793b89bdba79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:58:09.467181 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ee565-1ea5-40a7-b3d2-793b89bdba79 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:58:09.474850 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1178/2354] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:58:09 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:58:39.984370 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e86f2f-929e-4c95-b471-c9e6a263638e service nova] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:58:39.985926 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-25e86f2f-929e-4c95-b471-c9e6a263638e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:58:39.997136 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e86f2f-929e-4c95-b471-c9e6a263638e service nova] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:58:40.000701 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7ca2d-dc4b-47e0-9e92-f68947f1eb75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:58:40.001327 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7ca2d-dc4b-47e0-9e92-f68947f1eb75 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:58:40.001646 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7ca2d-dc4b-47e0-9e92-f68947f1eb75 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:58:40.001933 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7ca2d-dc4b-47e0-9e92-f68947f1eb75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:58:40.012241 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7ca2d-dc4b-47e0-9e92-f68947f1eb75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:58:40.013681 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7ca2d-dc4b-47e0-9e92-f68947f1eb75 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:58:40.024807 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1177/2355] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:58:39 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:58:41.124706 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ee565-1ea5-40a7-b3d2-793b89bdba79 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:58:41.133135 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ee565-1ea5-40a7-b3d2-793b89bdba79 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:58:41.136759 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282357d-43b5-417b-b601-bbd6f9b0a681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:58:41.137392 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282357d-43b5-417b-b601-bbd6f9b0a681 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:58:41.137710 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282357d-43b5-417b-b601-bbd6f9b0a681 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:58:41.137994 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282357d-43b5-417b-b601-bbd6f9b0a681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:58:41.148364 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282357d-43b5-417b-b601-bbd6f9b0a681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:58:41.149793 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282357d-43b5-417b-b601-bbd6f9b0a681 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:58:41.160497 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1179/2356] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:58:41 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:58:42.620987 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7ca2d-dc4b-47e0-9e92-f68947f1eb75 service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:58:42.630301 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7ca2d-dc4b-47e0-9e92-f68947f1eb75 service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:58:42.633929 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1057e-0741-452c-afa6-a1f3332be967 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:58:42.634554 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1057e-0741-452c-afa6-a1f3332be967 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:58:42.634869 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1057e-0741-452c-afa6-a1f3332be967 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:58:42.635150 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1057e-0741-452c-afa6-a1f3332be967 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:58:42.637004 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-a8b1057e-0741-452c-afa6-a1f3332be967 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:58:42.712697 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1057e-0741-452c-afa6-a1f3332be967 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:58:42.714139 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1057e-0741-452c-afa6-a1f3332be967 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:58:42.731929 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1178/2357] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 01:58:42 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:00:42.691603 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5692df7-2239-4397-abef-7a116adaabcf None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:00:42.692131 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5692df7-2239-4397-abef-7a116adaabcf None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:00:42.692241 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5692df7-2239-4397-abef-7a116adaabcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:00:42.717517 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-d5692df7-2239-4397-abef-7a116adaabcf None None] MFA Rules not processed for user `ec1f566372814a95890d41b260573dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:00:42.718715 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-d5692df7-2239-4397-abef-7a116adaabcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:00:42.725476 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1180/2358] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:00:42 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:00:42.846887 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1057e-0741-452c-afa6-a1f3332be967 service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:00:42.899642 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1057e-0741-452c-afa6-a1f3332be967 service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:00:42.903412 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c92b1-f2dd-4378-a33d-b0662f2be859 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:00:42.904003 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c92b1-f2dd-4378-a33d-b0662f2be859 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:00:42.904287 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c92b1-f2dd-4378-a33d-b0662f2be859 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:00:42.904564 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c92b1-f2dd-4378-a33d-b0662f2be859 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:00:42.906542 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-c31c92b1-f2dd-4378-a33d-b0662f2be859 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:00:42.977335 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c92b1-f2dd-4378-a33d-b0662f2be859 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:00:42.978815 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c92b1-f2dd-4378-a33d-b0662f2be859 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:00:42.987681 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1179/2359] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:00:42 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:00:43.025977 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5692df7-2239-4397-abef-7a116adaabcf None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:00:43.035230 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5692df7-2239-4397-abef-7a116adaabcf None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:00:43.039385 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5921546-937b-431d-9e61-cc05d169e4d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:00:43.040011 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5921546-937b-431d-9e61-cc05d169e4d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:00:43.040289 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5921546-937b-431d-9e61-cc05d169e4d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:00:43.040561 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5921546-937b-431d-9e61-cc05d169e4d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:00:43.047411 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5921546-937b-431d-9e61-cc05d169e4d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:00:43.048829 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5921546-937b-431d-9e61-cc05d169e4d2 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:00:43.056649 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1181/2360] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:00:43 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:00:43.358475 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c92b1-f2dd-4378-a33d-b0662f2be859 service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:00:43.370354 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c92b1-f2dd-4378-a33d-b0662f2be859 service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:00:43.375567 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa3a49-d3d0-428a-9bfd-cd46d04e2e04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff82e315d8c42e49556ab67fbf53b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:00:43.376214 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa3a49-d3d0-428a-9bfd-cd46d04e2e04 service placement] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:00:43.376501 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa3a49-d3d0-428a-9bfd-cd46d04e2e04 service placement] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:00:43.376781 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa3a49-d3d0-428a-9bfd-cd46d04e2e04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:00:43.386198 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa3a49-d3d0-428a-9bfd-cd46d04e2e04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:00:43.387775 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa3a49-d3d0-428a-9bfd-cd46d04e2e04 service placement] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:00:43.397939 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1180/2361] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:00:43 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:00:45.979085 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5921546-937b-431d-9e61-cc05d169e4d2 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:00:45.994148 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5921546-937b-431d-9e61-cc05d169e4d2 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:00:46.002842 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead02aa-04c9-4115-a59f-88560f94042e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:00:46.004158 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead02aa-04c9-4115-a59f-88560f94042e service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:00:46.004487 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead02aa-04c9-4115-a59f-88560f94042e service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:00:46.004958 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead02aa-04c9-4115-a59f-88560f94042e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:00:46.015620 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead02aa-04c9-4115-a59f-88560f94042e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:00:46.017125 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead02aa-04c9-4115-a59f-88560f94042e service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:00:46.029244 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1182/2362] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:00:45 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:00:52.190474 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa3a49-d3d0-428a-9bfd-cd46d04e2e04 service placement] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:00:52.204463 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa3a49-d3d0-428a-9bfd-cd46d04e2e04 service placement] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:00:52.210059 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9d783-6d7e-4db2-a1b4-117a536fe671 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:00:52.210796 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9d783-6d7e-4db2-a1b4-117a536fe671 service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:00:52.211095 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9d783-6d7e-4db2-a1b4-117a536fe671 service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:00:52.211375 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9d783-6d7e-4db2-a1b4-117a536fe671 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:00:52.220593 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9d783-6d7e-4db2-a1b4-117a536fe671 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:00:52.222434 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9d783-6d7e-4db2-a1b4-117a536fe671 service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:00:52.233117 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1181/2363] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:00:52 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:01:37.283921 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead02aa-04c9-4115-a59f-88560f94042e service nova] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:01:37.285514 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-1ead02aa-04c9-4115-a59f-88560f94042e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:01:37.310130 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead02aa-04c9-4115-a59f-88560f94042e service nova] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:01:37.313758 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b04c3-c4fb-4f95-8475-4f418c8f6089 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:01:37.314390 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b04c3-c4fb-4f95-8475-4f418c8f6089 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:01:37.314675 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b04c3-c4fb-4f95-8475-4f418c8f6089 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:01:37.314957 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b04c3-c4fb-4f95-8475-4f418c8f6089 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:01:37.323478 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b04c3-c4fb-4f95-8475-4f418c8f6089 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:01:37.324891 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b04c3-c4fb-4f95-8475-4f418c8f6089 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:01:37.333430 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1183/2364] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:01:37 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:02:04.781413 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9d783-6d7e-4db2-a1b4-117a536fe671 service nova] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:02:04.783001 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-9ff9d783-6d7e-4db2-a1b4-117a536fe671 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:02:04.859497 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9d783-6d7e-4db2-a1b4-117a536fe671 service nova] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:02:04.864449 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bbd5d-0412-4b18-8e23-8b6718e1784a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff82e315d8c42e49556ab67fbf53b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:02:04.865085 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bbd5d-0412-4b18-8e23-8b6718e1784a service placement] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:02:04.865371 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bbd5d-0412-4b18-8e23-8b6718e1784a service placement] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:02:04.865691 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bbd5d-0412-4b18-8e23-8b6718e1784a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:02:04.867580 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-b89bbd5d-0412-4b18-8e23-8b6718e1784a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:02:04.878422 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89bbd5d-0412-4b18-8e23-8b6718e1784a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:02:04.879968 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89bbd5d-0412-4b18-8e23-8b6718e1784a service placement] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:02:04.889393 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1182/2365] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:02:04 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:03:13.393257 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b04c3-c4fb-4f95-8475-4f418c8f6089 service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:03:13.402478 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b04c3-c4fb-4f95-8475-4f418c8f6089 service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:03:13.406141 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3216c-59ba-497c-aa4e-fc46da2ca397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:03:13.406799 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3216c-59ba-497c-aa4e-fc46da2ca397 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:03:13.407085 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3216c-59ba-497c-aa4e-fc46da2ca397 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:03:13.407369 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3216c-59ba-497c-aa4e-fc46da2ca397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:03:13.415144 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe3216c-59ba-497c-aa4e-fc46da2ca397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:03:13.416588 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe3216c-59ba-497c-aa4e-fc46da2ca397 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:03:13.424285 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1184/2366] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:03:13 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:03:37.617793 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bbd5d-0412-4b18-8e23-8b6718e1784a service placement] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:03:37.628967 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bbd5d-0412-4b18-8e23-8b6718e1784a service placement] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:03:37.633406 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cd0a8-1a61-4183-84ba-69bae056c0c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:03:37.634103 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cd0a8-1a61-4183-84ba-69bae056c0c4 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:03:37.634405 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cd0a8-1a61-4183-84ba-69bae056c0c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:03:37.634674 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cd0a8-1a61-4183-84ba-69bae056c0c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:03:37.636542 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-e17cd0a8-1a61-4183-84ba-69bae056c0c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:03:37.714556 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17cd0a8-1a61-4183-84ba-69bae056c0c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:03:37.715900 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17cd0a8-1a61-4183-84ba-69bae056c0c4 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:03:37.733565 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1183/2367] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:03:37 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:03:37.774953 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3216c-59ba-497c-aa4e-fc46da2ca397 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:03:37.783840 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3216c-59ba-497c-aa4e-fc46da2ca397 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:03:37.787403 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c693b-8485-4d77-9d0e-2342cdc6cbad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:03:37.788032 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c693b-8485-4d77-9d0e-2342cdc6cbad service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:03:37.788318 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c693b-8485-4d77-9d0e-2342cdc6cbad service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:03:37.788599 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c693b-8485-4d77-9d0e-2342cdc6cbad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:03:37.796777 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c693b-8485-4d77-9d0e-2342cdc6cbad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:03:37.798213 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c693b-8485-4d77-9d0e-2342cdc6cbad service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:03:37.807350 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1185/2368] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:03:37 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:03:39.341511 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cd0a8-1a61-4183-84ba-69bae056c0c4 service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:03:39.360292 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cd0a8-1a61-4183-84ba-69bae056c0c4 service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:03:39.367501 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e76b2f-fb78-43f3-b3e4-5bfa14658225 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:03:39.368172 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e76b2f-fb78-43f3-b3e4-5bfa14658225 service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:03:39.368461 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e76b2f-fb78-43f3-b3e4-5bfa14658225 service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:03:39.368745 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e76b2f-fb78-43f3-b3e4-5bfa14658225 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:03:39.371228 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-31e76b2f-fb78-43f3-b3e4-5bfa14658225 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:03:39.406333 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e76b2f-fb78-43f3-b3e4-5bfa14658225 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:03:39.410403 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e76b2f-fb78-43f3-b3e4-5bfa14658225 service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:03:39.426570 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1184/2369] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:03:39 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 02:04:43.082513 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c693b-8485-4d77-9d0e-2342cdc6cbad service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:04:43.084064 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-de8c693b-8485-4d77-9d0e-2342cdc6cbad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:04:43.094823 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c693b-8485-4d77-9d0e-2342cdc6cbad service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:04:43.099171 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf8f4c-74dc-42c6-b58a-f186918b1ca0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:04:43.099800 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf8f4c-74dc-42c6-b58a-f186918b1ca0 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:04:43.100088 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf8f4c-74dc-42c6-b58a-f186918b1ca0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:04:43.100365 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf8f4c-74dc-42c6-b58a-f186918b1ca0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:04:43.108527 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf8f4c-74dc-42c6-b58a-f186918b1ca0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:04:43.109984 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf8f4c-74dc-42c6-b58a-f186918b1ca0 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:04:43.118766 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1186/2370] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:04:43 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 02:06:43.187314 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e76b2f-fb78-43f3-b3e4-5bfa14658225 service nova] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:06:43.213778 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e76b2f-fb78-43f3-b3e4-5bfa14658225 service nova] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:06:43.217384 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715a0b9-d803-4642-be0c-978b148c1a6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:06:43.218055 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715a0b9-d803-4642-be0c-978b148c1a6c service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:06:43.218391 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715a0b9-d803-4642-be0c-978b148c1a6c service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:06:43.218620 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715a0b9-d803-4642-be0c-978b148c1a6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:06:43.220983 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-8715a0b9-d803-4642-be0c-978b148c1a6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:06:43.308213 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715a0b9-d803-4642-be0c-978b148c1a6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:06:43.309653 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715a0b9-d803-4642-be0c-978b148c1a6c service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:06:43.327473 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1185/2371] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:06:43 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:06:43.371137 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf8f4c-74dc-42c6-b58a-f186918b1ca0 service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:06:43.389245 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf8f4c-74dc-42c6-b58a-f186918b1ca0 service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:06:43.393554 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03294d71-a4e6-4b3d-b0de-834561e121bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:06:43.394191 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03294d71-a4e6-4b3d-b0de-834561e121bc service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:06:43.394475 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03294d71-a4e6-4b3d-b0de-834561e121bc service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:06:43.394759 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03294d71-a4e6-4b3d-b0de-834561e121bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:06:43.402845 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03294d71-a4e6-4b3d-b0de-834561e121bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:06:43.404250 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03294d71-a4e6-4b3d-b0de-834561e121bc service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:06:43.430096 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1187/2372] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:06:43 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:07:10.785300 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715a0b9-d803-4642-be0c-978b148c1a6c service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:10.822194 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715a0b9-d803-4642-be0c-978b148c1a6c service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:10.827348 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702e7d2-6722-479f-9070-9785946a2206 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff82e315d8c42e49556ab67fbf53b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:10.828473 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702e7d2-6722-479f-9070-9785946a2206 service placement] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:10.828756 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702e7d2-6722-479f-9070-9785946a2206 service placement] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:10.829044 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702e7d2-6722-479f-9070-9785946a2206 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:10.837296 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702e7d2-6722-479f-9070-9785946a2206 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:10.838924 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702e7d2-6722-479f-9070-9785946a2206 service placement] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:10.849122 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1186/2373] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:07:10 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:07:45.775539 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03294d71-a4e6-4b3d-b0de-834561e121bc service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:45.777102 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-03294d71-a4e6-4b3d-b0de-834561e121bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:45.799179 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03294d71-a4e6-4b3d-b0de-834561e121bc service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:45.803910 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8bb89-661f-4481-bd03-80d5f49cc087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:45.804645 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8bb89-661f-4481-bd03-80d5f49cc087 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:45.805064 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8bb89-661f-4481-bd03-80d5f49cc087 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:45.805456 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8bb89-661f-4481-bd03-80d5f49cc087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:45.807719 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-ced8bb89-661f-4481-bd03-80d5f49cc087 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:45.902138 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8bb89-661f-4481-bd03-80d5f49cc087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:45.904844 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8bb89-661f-4481-bd03-80d5f49cc087 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:45.928391 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1188/2374] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:07:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:07:45.965703 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702e7d2-6722-479f-9070-9785946a2206 service placement] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:45.967599 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4702e7d2-6722-479f-9070-9785946a2206 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:45.989803 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702e7d2-6722-479f-9070-9785946a2206 service placement] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:45.996150 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ea230-be6a-49ac-b720-59133edc089e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:45.996844 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ea230-be6a-49ac-b720-59133edc089e service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:45.997189 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ea230-be6a-49ac-b720-59133edc089e service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:45.997750 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ea230-be6a-49ac-b720-59133edc089e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:45.999936 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-d99ea230-be6a-49ac-b720-59133edc089e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:46.012681 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ea230-be6a-49ac-b720-59133edc089e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:46.014294 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ea230-be6a-49ac-b720-59133edc089e service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:46.026271 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1187/2375] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:07:45 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:07:49.070530 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8bb89-661f-4481-bd03-80d5f49cc087 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:49.080316 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8bb89-661f-4481-bd03-80d5f49cc087 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:49.084212 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634534f-e808-4313-bf1b-5679b7babbdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:49.084937 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634534f-e808-4313-bf1b-5679b7babbdd service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:49.085289 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634534f-e808-4313-bf1b-5679b7babbdd service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:49.085668 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634534f-e808-4313-bf1b-5679b7babbdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:49.088616 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-9634534f-e808-4313-bf1b-5679b7babbdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:49.102471 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634534f-e808-4313-bf1b-5679b7babbdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:49.104066 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634534f-e808-4313-bf1b-5679b7babbdd service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:49.114262 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1189/2376] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:07:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:07:49.435713 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ea230-be6a-49ac-b720-59133edc089e service nova] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:49.439018 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-d99ea230-be6a-49ac-b720-59133edc089e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:49.456991 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ea230-be6a-49ac-b720-59133edc089e service nova] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:49.462229 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ed850-d844-481b-97e9-685953833fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:49.463174 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ed850-d844-481b-97e9-685953833fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:49.463530 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ed850-d844-481b-97e9-685953833fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:49.464668 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ed850-d844-481b-97e9-685953833fdd admin admin] PATH_INFO: `/v3/users/ec1f566372814a95890d41b260573dc9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:49.466230 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ed850-d844-481b-97e9-685953833fdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec1f566372814a95890d41b260573dc9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:49.468350 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ed850-d844-481b-97e9-685953833fdd admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:49.513605 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-9c6ed850-d844-481b-97e9-685953833fdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec1f566372814a95890d41b260573dc9'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:49.521426 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-9c6ed850-d844-481b-97e9-685953833fdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec1f566372814a95890d41b260573dc9'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:49.522285 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-9c6ed850-d844-481b-97e9-685953833fdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec1f566372814a95890d41b260573dc9'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:49.533840 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-9c6ed850-d844-481b-97e9-685953833fdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec1f566372814a95890d41b260573dc9'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:49.541643 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-9c6ed850-d844-481b-97e9-685953833fdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec1f566372814a95890d41b260573dc9'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:49.547641 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1188/2377] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:07:49 2021] DELETE /identity/v3/users/ec1f566372814a95890d41b260573dc9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:07:49.673655 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634534f-e808-4313-bf1b-5679b7babbdd service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:49.675590 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-9634534f-e808-4313-bf1b-5679b7babbdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:49.687682 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634534f-e808-4313-bf1b-5679b7babbdd service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:49.730521 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ed850-d844-481b-97e9-685953833fdd admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:49.732010 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-9c6ed850-d844-481b-97e9-685953833fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:49.743580 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354ffc4-023a-4be7-89df-91c29f741f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:49.744453 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354ffc4-023a-4be7-89df-91c29f741f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:49.744734 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354ffc4-023a-4be7-89df-91c29f741f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:49.745013 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354ffc4-023a-4be7-89df-91c29f741f57 admin admin] PATH_INFO: `/v3/users/217b11f7f05845598980741885b4417e` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:49.746247 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354ffc4-023a-4be7-89df-91c29f741f57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=217b11f7f05845598980741885b4417e)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:49.748153 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354ffc4-023a-4be7-89df-91c29f741f57 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:49.800084 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-3354ffc4-023a-4be7-89df-91c29f741f57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '217b11f7f05845598980741885b4417e'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:49.806607 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ed850-d844-481b-97e9-685953833fdd admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:49.810105 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-3354ffc4-023a-4be7-89df-91c29f741f57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '217b11f7f05845598980741885b4417e'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:49.815747 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b6031-c2d6-4c26-a5f2-c187e15f9162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:49.816773 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b6031-c2d6-4c26-a5f2-c187e15f9162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:49.817127 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b6031-c2d6-4c26-a5f2-c187e15f9162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:49.817495 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b6031-c2d6-4c26-a5f2-c187e15f9162 admin admin] PATH_INFO: `/v3/projects/d9eced377e3f4f85826c191384777532` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:49.819013 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b6031-c2d6-4c26-a5f2-c187e15f9162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9eced377e3f4f85826c191384777532)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:49.820756 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-3354ffc4-023a-4be7-89df-91c29f741f57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '217b11f7f05845598980741885b4417e'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:49.821159 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b6031-c2d6-4c26-a5f2-c187e15f9162 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:49.821451 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-3354ffc4-023a-4be7-89df-91c29f741f57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '217b11f7f05845598980741885b4417e'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:49.833635 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-3354ffc4-023a-4be7-89df-91c29f741f57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '217b11f7f05845598980741885b4417e'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:49.839728 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1190/2378] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:07:49 2021] DELETE /identity/v3/users/217b11f7f05845598980741885b4417e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:07:49.901366 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-a33b6031-c2d6-4c26-a5f2-c187e15f9162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9eced377e3f4f85826c191384777532', 'request_id': 'req-a33b6031-c2d6-4c26-a5f2-c187e15f9162'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:49.907868 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-a33b6031-c2d6-4c26-a5f2-c187e15f9162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9eced377e3f4f85826c191384777532', 'request_id': 'req-a33b6031-c2d6-4c26-a5f2-c187e15f9162'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:49.916632 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-a33b6031-c2d6-4c26-a5f2-c187e15f9162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9eced377e3f4f85826c191384777532', 'request_id': 'req-a33b6031-c2d6-4c26-a5f2-c187e15f9162'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:49.930140 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-a33b6031-c2d6-4c26-a5f2-c187e15f9162 admin admin] The token cache is being invalidate because project d9eced377e3f4f85826c191384777532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:07:49.930613 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-a33b6031-c2d6-4c26-a5f2-c187e15f9162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:49.931393 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-a33b6031-c2d6-4c26-a5f2-c187e15f9162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:49.933894 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1189/2379] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:07:49 2021] DELETE /identity/v3/projects/d9eced377e3f4f85826c191384777532 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:07:49.939793 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ad989-4c33-4443-95ef-d13d23b870fb None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:49.940080 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ad989-4c33-4443-95ef-d13d23b870fb None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:49.940635 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ad989-4c33-4443-95ef-d13d23b870fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:50.006087 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-558ad989-4c33-4443-95ef-d13d23b870fb None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:07:50.007477 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-558ad989-4c33-4443-95ef-d13d23b870fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:50.055444 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b6031-c2d6-4c26-a5f2-c187e15f9162 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:50.056865 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-a33b6031-c2d6-4c26-a5f2-c187e15f9162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:50.080021 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1191/2380] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:07:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:07:50.088003 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c2cd3-86ab-471e-9565-c1531f546c7d None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:50.088409 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c2cd3-86ab-471e-9565-c1531f546c7d None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:50.088580 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c2cd3-86ab-471e-9565-c1531f546c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:50.106549 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-a86c2cd3-86ab-471e-9565-c1531f546c7d None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:07:50.107794 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-a86c2cd3-86ab-471e-9565-c1531f546c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:50.117349 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1192/2381] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:07:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:07:50.121619 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c2cd3-86ab-471e-9565-c1531f546c7d None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:50.123210 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b6031-c2d6-4c26-a5f2-c187e15f9162 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:50.128471 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b98b7-9af9-4481-a22e-0cc3142204be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:50.129438 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b98b7-9af9-4481-a22e-0cc3142204be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:50.129807 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b98b7-9af9-4481-a22e-0cc3142204be admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:50.130084 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b98b7-9af9-4481-a22e-0cc3142204be admin admin] PATH_INFO: `/v3/projects/e405517c4f1840b4a2e30ef7dccd2e4a` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:50.131208 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c2cd3-86ab-471e-9565-c1531f546c7d None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:50.131335 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b98b7-9af9-4481-a22e-0cc3142204be admin admin] RBAC: Authorizing `identity:delete_project(project_id=e405517c4f1840b4a2e30ef7dccd2e4a)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:50.133241 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b98b7-9af9-4481-a22e-0cc3142204be admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:50.136046 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21669361-a3d4-479e-9c3e-87cb95e539b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:50.136689 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21669361-a3d4-479e-9c3e-87cb95e539b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:50.136978 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21669361-a3d4-479e-9c3e-87cb95e539b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:50.137258 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21669361-a3d4-479e-9c3e-87cb95e539b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:50.138028 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21669361-a3d4-479e-9c3e-87cb95e539b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 02:07:50.138339 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21669361-a3d4-479e-9c3e-87cb95e539b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:50.139907 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21669361-a3d4-479e-9c3e-87cb95e539b5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:50.151318 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1193/2382] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 02:07:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 02:07:50.155468 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21669361-a3d4-479e-9c3e-87cb95e539b5 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:50.165548 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21669361-a3d4-479e-9c3e-87cb95e539b5 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:50.170129 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f946531-3b19-4a17-8df4-4d375c7a7933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:50.170757 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f946531-3b19-4a17-8df4-4d375c7a7933 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:50.171038 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f946531-3b19-4a17-8df4-4d375c7a7933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:50.171924 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f946531-3b19-4a17-8df4-4d375c7a7933 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:50.172581 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f946531-3b19-4a17-8df4-4d375c7a7933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:50.174488 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f946531-3b19-4a17-8df4-4d375c7a7933 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:50.181335 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-537b98b7-9af9-4481-a22e-0cc3142204be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e405517c4f1840b4a2e30ef7dccd2e4a', 'request_id': 'req-537b98b7-9af9-4481-a22e-0cc3142204be'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:50.186687 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-537b98b7-9af9-4481-a22e-0cc3142204be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e405517c4f1840b4a2e30ef7dccd2e4a', 'request_id': 'req-537b98b7-9af9-4481-a22e-0cc3142204be'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:50.195632 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-537b98b7-9af9-4481-a22e-0cc3142204be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e405517c4f1840b4a2e30ef7dccd2e4a', 'request_id': 'req-537b98b7-9af9-4481-a22e-0cc3142204be'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:50.209088 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-537b98b7-9af9-4481-a22e-0cc3142204be admin admin] The token cache is being invalidate because project e405517c4f1840b4a2e30ef7dccd2e4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:07:50.209381 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-537b98b7-9af9-4481-a22e-0cc3142204be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:50.210263 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-537b98b7-9af9-4481-a22e-0cc3142204be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:50.211994 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1190/2383] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:07:50 2021] DELETE /identity/v3/projects/e405517c4f1840b4a2e30ef7dccd2e4a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:07:50.217396 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1194/2384] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:07:50 2021] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:07:50.219463 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235947d2-7883-4013-b728-377e0abc0101 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:50.219755 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235947d2-7883-4013-b728-377e0abc0101 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:50.220188 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235947d2-7883-4013-b728-377e0abc0101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:50.220326 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f946531-3b19-4a17-8df4-4d375c7a7933 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:50.222115 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-4f946531-3b19-4a17-8df4-4d375c7a7933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:50.239516 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-235947d2-7883-4013-b728-377e0abc0101 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:07:50.240748 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-235947d2-7883-4013-b728-377e0abc0101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:50.283393 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f946531-3b19-4a17-8df4-4d375c7a7933 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:50.288030 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e777b1-fe91-49e1-a99f-5c7731069746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:50.288697 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e777b1-fe91-49e1-a99f-5c7731069746 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:50.288988 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e777b1-fe91-49e1-a99f-5c7731069746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:50.289270 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e777b1-fe91-49e1-a99f-5c7731069746 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:50.290008 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e777b1-fe91-49e1-a99f-5c7731069746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:50.291913 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e777b1-fe91-49e1-a99f-5c7731069746 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:50.296994 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1191/2385] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:07:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:07:50.306022 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025f711-5a26-4463-84a8-9ae7a08dbe74 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:50.306352 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025f711-5a26-4463-84a8-9ae7a08dbe74 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:50.306627 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025f711-5a26-4463-84a8-9ae7a08dbe74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:50.313731 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1195/2386] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:07:50 2021] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:07:50.317353 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e777b1-fe91-49e1-a99f-5c7731069746 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:50.324468 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-9025f711-5a26-4463-84a8-9ae7a08dbe74 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:07:50.325675 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-9025f711-5a26-4463-84a8-9ae7a08dbe74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:50.326900 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e777b1-fe91-49e1-a99f-5c7731069746 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:50.331967 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b46892-d22a-4472-a7f8-4f7ca6cae307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:50.332606 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b46892-d22a-4472-a7f8-4f7ca6cae307 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:50.332887 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b46892-d22a-4472-a7f8-4f7ca6cae307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:50.333165 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b46892-d22a-4472-a7f8-4f7ca6cae307 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:50.333926 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b46892-d22a-4472-a7f8-4f7ca6cae307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:50.334471 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1192/2387] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:07:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:07:50.335556 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b46892-d22a-4472-a7f8-4f7ca6cae307 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:50.338425 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025f711-5a26-4463-84a8-9ae7a08dbe74 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:50.347269 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1196/2388] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:07:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:07:50.348512 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025f711-5a26-4463-84a8-9ae7a08dbe74 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:50.351008 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b46892-d22a-4472-a7f8-4f7ca6cae307 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:50.353661 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539b3fb-1d0f-4c51-acad-53f92c628683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:50.354346 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539b3fb-1d0f-4c51-acad-53f92c628683 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:50.354625 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539b3fb-1d0f-4c51-acad-53f92c628683 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:50.354899 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539b3fb-1d0f-4c51-acad-53f92c628683 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:50.355638 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539b3fb-1d0f-4c51-acad-53f92c628683 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 02:07:50.355944 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539b3fb-1d0f-4c51-acad-53f92c628683 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:50.358170 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539b3fb-1d0f-4c51-acad-53f92c628683 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:50.361896 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b46892-d22a-4472-a7f8-4f7ca6cae307 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:50.366909 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb956a42-4f92-4628-9694-a7965b0b7622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:50.367688 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb956a42-4f92-4628-9694-a7965b0b7622 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:50.368077 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb956a42-4f92-4628-9694-a7965b0b7622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:50.368422 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb956a42-4f92-4628-9694-a7965b0b7622 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:50.369239 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb956a42-4f92-4628-9694-a7965b0b7622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:50.371040 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb956a42-4f92-4628-9694-a7965b0b7622 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:50.373686 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1193/2389] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 02:07:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 02:07:50.375361 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539b3fb-1d0f-4c51-acad-53f92c628683 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:50.382545 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1197/2390] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:07:50 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:07:50.386437 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539b3fb-1d0f-4c51-acad-53f92c628683 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:50.386749 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb956a42-4f92-4628-9694-a7965b0b7622 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:50.392253 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071ba52-ddb5-4253-b908-db83bd812d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:50.392933 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071ba52-ddb5-4253-b908-db83bd812d64 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:50.393222 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071ba52-ddb5-4253-b908-db83bd812d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:50.393537 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071ba52-ddb5-4253-b908-db83bd812d64 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:50.394266 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071ba52-ddb5-4253-b908-db83bd812d64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:50.396216 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071ba52-ddb5-4253-b908-db83bd812d64 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:50.398273 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb956a42-4f92-4628-9694-a7965b0b7622 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:50.403581 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106e91c-f5c8-4847-9c69-cbe5e42e61d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:50.404488 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106e91c-f5c8-4847-9c69-cbe5e42e61d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:50.404797 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106e91c-f5c8-4847-9c69-cbe5e42e61d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:50.405068 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106e91c-f5c8-4847-9c69-cbe5e42e61d5 admin admin] PATH_INFO: `/v3/projects/25f294b8a6bc46b1a21317683ee682dd/users/1738bea3061d4ea7a2d4c0deb491b77c/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:50.423283 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106e91c-f5c8-4847-9c69-cbe5e42e61d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f294b8a6bc46b1a21317683ee682dd, user_id=1738bea3061d4ea7a2d4c0deb491b77c, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:50.428688 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1194/2391] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:07:50 2021] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:07:50.428898 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106e91c-f5c8-4847-9c69-cbe5e42e61d5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:50.430632 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071ba52-ddb5-4253-b908-db83bd812d64 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:50.441105 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1198/2392] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:07:50 2021] PUT /identity/v3/projects/25f294b8a6bc46b1a21317683ee682dd/users/1738bea3061d4ea7a2d4c0deb491b77c/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:07:50.453327 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3f3ee-55ca-4880-9e62-e394ff86afd0 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:50.453666 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3f3ee-55ca-4880-9e62-e394ff86afd0 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:50.453947 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3f3ee-55ca-4880-9e62-e394ff86afd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:50.481681 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-ada3f3ee-55ca-4880-9e62-e394ff86afd0 None None] MFA Rules not processed for user `1738bea3061d4ea7a2d4c0deb491b77c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:07:50.483110 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-ada3f3ee-55ca-4880-9e62-e394ff86afd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:50.500852 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071ba52-ddb5-4253-b908-db83bd812d64 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:50.548534 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1199/2393] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:07:50 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:07:50.553275 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3f3ee-55ca-4880-9e62-e394ff86afd0 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:50.558382 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bed64-e952-4bd2-b736-751516898ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:50.559057 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bed64-e952-4bd2-b736-751516898ccb admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:50.559345 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bed64-e952-4bd2-b736-751516898ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:50.559626 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bed64-e952-4bd2-b736-751516898ccb admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:50.560418 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47bed64-e952-4bd2-b736-751516898ccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:50.562515 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47bed64-e952-4bd2-b736-751516898ccb admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:50.585052 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1195/2394] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:07:50 2021] POST /identity/v3/users => generated 296 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:07:50.586185 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bed64-e952-4bd2-b736-751516898ccb admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:50.596202 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bed64-e952-4bd2-b736-751516898ccb admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:50.600912 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ad73c-33c9-4d12-9c5f-a9a9db9f1d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:50.601594 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ad73c-33c9-4d12-9c5f-a9a9db9f1d2c admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:50.601880 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ad73c-33c9-4d12-9c5f-a9a9db9f1d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:50.602162 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ad73c-33c9-4d12-9c5f-a9a9db9f1d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:50.603024 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ad73c-33c9-4d12-9c5f-a9a9db9f1d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:50.604603 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ad73c-33c9-4d12-9c5f-a9a9db9f1d2c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:50.613160 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3f3ee-55ca-4880-9e62-e394ff86afd0 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:50.614452 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1196/2395] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:07:50 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:07:50.617962 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91b985-875f-4e18-bbb2-b5fe3d9da41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:50.618354 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ad73c-33c9-4d12-9c5f-a9a9db9f1d2c admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:50.618618 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91b985-875f-4e18-bbb2-b5fe3d9da41a admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:50.618912 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91b985-875f-4e18-bbb2-b5fe3d9da41a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:50.619194 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91b985-875f-4e18-bbb2-b5fe3d9da41a admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:50.619894 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91b985-875f-4e18-bbb2-b5fe3d9da41a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:50.621807 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91b985-875f-4e18-bbb2-b5fe3d9da41a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:50.627759 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ad73c-33c9-4d12-9c5f-a9a9db9f1d2c admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:50.632565 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23fec8-57ea-4669-8699-d9c5364c4d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:50.633389 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23fec8-57ea-4669-8699-d9c5364c4d3b admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:50.633708 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23fec8-57ea-4669-8699-d9c5364c4d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:50.633988 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23fec8-57ea-4669-8699-d9c5364c4d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:50.634739 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23fec8-57ea-4669-8699-d9c5364c4d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:50.636786 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23fec8-57ea-4669-8699-d9c5364c4d3b admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:50.650025 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1200/2396] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:07:50 2021] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:07:50.650237 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1197/2397] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:07:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:07:50.652224 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91b985-875f-4e18-bbb2-b5fe3d9da41a admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:50.652360 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23fec8-57ea-4669-8699-d9c5364c4d3b admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:50.663050 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23fec8-57ea-4669-8699-d9c5364c4d3b admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:50.712474 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91b985-875f-4e18-bbb2-b5fe3d9da41a admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:50.716281 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d7b42-6597-4986-999b-805dc638b196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:50.717354 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d7b42-6597-4986-999b-805dc638b196 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:50.717529 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60883502-a784-4db0-8bab-986df7658410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:50.717669 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d7b42-6597-4986-999b-805dc638b196 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:50.717950 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d7b42-6597-4986-999b-805dc638b196 admin admin] PATH_INFO: `/v3/projects/aa15c937c4064351839ba9baa6fd8347/users/36b217a0bdc24e46a40b55bf1447e12a/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:50.718124 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60883502-a784-4db0-8bab-986df7658410 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:50.718411 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60883502-a784-4db0-8bab-986df7658410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:50.718692 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60883502-a784-4db0-8bab-986df7658410 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:50.719412 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60883502-a784-4db0-8bab-986df7658410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:50.721300 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60883502-a784-4db0-8bab-986df7658410 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:50.734652 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d7b42-6597-4986-999b-805dc638b196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa15c937c4064351839ba9baa6fd8347, user_id=36b217a0bdc24e46a40b55bf1447e12a, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:50.737770 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d7b42-6597-4986-999b-805dc638b196 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:50.741323 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1201/2398] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:07:50 2021] POST /identity/v3/users => generated 297 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:07:50.745460 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60883502-a784-4db0-8bab-986df7658410 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:50.751651 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1198/2399] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:07:50 2021] PUT /identity/v3/projects/aa15c937c4064351839ba9baa6fd8347/users/36b217a0bdc24e46a40b55bf1447e12a/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:07:50.765802 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60883502-a784-4db0-8bab-986df7658410 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:50.808032 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0039a-2781-4b0a-a445-e89bae20d8cb None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:50.808267 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0039a-2781-4b0a-a445-e89bae20d8cb None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:50.808484 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0039a-2781-4b0a-a445-e89bae20d8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:50.815946 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49050c06-6f38-4570-bc74-96a05daa8df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:50.816619 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49050c06-6f38-4570-bc74-96a05daa8df1 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:50.816904 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49050c06-6f38-4570-bc74-96a05daa8df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:50.817188 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49050c06-6f38-4570-bc74-96a05daa8df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:50.818098 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49050c06-6f38-4570-bc74-96a05daa8df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:50.819687 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49050c06-6f38-4570-bc74-96a05daa8df1 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:50.830789 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1202/2400] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:07:50 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:07:50.834936 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49050c06-6f38-4570-bc74-96a05daa8df1 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:50.835246 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-e2c0039a-2781-4b0a-a445-e89bae20d8cb None None] MFA Rules not processed for user `36b217a0bdc24e46a40b55bf1447e12a`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:07:50.836529 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-e2c0039a-2781-4b0a-a445-e89bae20d8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:50.844518 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49050c06-6f38-4570-bc74-96a05daa8df1 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:50.849311 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811eb4f-618c-45b6-b180-e169147cbc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:50.850192 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811eb4f-618c-45b6-b180-e169147cbc9b admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:50.850474 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811eb4f-618c-45b6-b180-e169147cbc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:50.850838 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811eb4f-618c-45b6-b180-e169147cbc9b admin admin] PATH_INFO: `/v3/projects/b44669cae55d482fb40ccabf3b12a9bc/users/4e31fc54be464edc889fde15faa6a177/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:50.865452 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811eb4f-618c-45b6-b180-e169147cbc9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44669cae55d482fb40ccabf3b12a9bc, user_id=4e31fc54be464edc889fde15faa6a177, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:50.867960 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811eb4f-618c-45b6-b180-e169147cbc9b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:50.883984 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1203/2401] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:07:50 2021] PUT /identity/v3/projects/b44669cae55d482fb40ccabf3b12a9bc/users/4e31fc54be464edc889fde15faa6a177/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:07:50.887949 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811eb4f-618c-45b6-b180-e169147cbc9b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:50.906241 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1199/2402] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:07:50 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:07:50.921206 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0039a-2781-4b0a-a445-e89bae20d8cb None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:50.922925 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-e2c0039a-2781-4b0a-a445-e89bae20d8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:50.955532 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811eb4f-618c-45b6-b180-e169147cbc9b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:50.957151 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97003da-b30c-416f-a54f-19d64b43e560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:50.957853 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97003da-b30c-416f-a54f-19d64b43e560 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:50.958136 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97003da-b30c-416f-a54f-19d64b43e560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:50.958414 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97003da-b30c-416f-a54f-19d64b43e560 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:50.959554 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97003da-b30c-416f-a54f-19d64b43e560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:50.961174 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97003da-b30c-416f-a54f-19d64b43e560 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:50.973576 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1204/2403] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:07:50 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:07:50.975311 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97003da-b30c-416f-a54f-19d64b43e560 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:50.982506 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0039a-2781-4b0a-a445-e89bae20d8cb None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:50.984882 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97003da-b30c-416f-a54f-19d64b43e560 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:50.989591 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778be20-68e2-4a42-bf8f-2451acecf1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:50.990499 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778be20-68e2-4a42-bf8f-2451acecf1a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:50.990777 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778be20-68e2-4a42-bf8f-2451acecf1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:50.991083 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778be20-68e2-4a42-bf8f-2451acecf1a4 admin admin] PATH_INFO: `/v3/projects/b44669cae55d482fb40ccabf3b12a9bc/users/4e31fc54be464edc889fde15faa6a177/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:50.993030 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778be20-68e2-4a42-bf8f-2451acecf1a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44669cae55d482fb40ccabf3b12a9bc, user_id=4e31fc54be464edc889fde15faa6a177, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:50.995662 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778be20-68e2-4a42-bf8f-2451acecf1a4 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:51.006047 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1205/2404] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:07:50 2021] PUT /identity/v3/projects/b44669cae55d482fb40ccabf3b12a9bc/users/4e31fc54be464edc889fde15faa6a177/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:07:51.016860 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff64e7e-1d2f-41cd-b7d2-39cead9ea7cd None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:51.017153 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff64e7e-1d2f-41cd-b7d2-39cead9ea7cd None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:51.017438 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff64e7e-1d2f-41cd-b7d2-39cead9ea7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:51.031233 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5453b-7923-448b-8200-0d5b763abb16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:51.031882 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5453b-7923-448b-8200-0d5b763abb16 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:51.032196 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5453b-7923-448b-8200-0d5b763abb16 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:51.032475 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5453b-7923-448b-8200-0d5b763abb16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:51.043167 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-0ff64e7e-1d2f-41cd-b7d2-39cead9ea7cd None None] MFA Rules not processed for user `4e31fc54be464edc889fde15faa6a177`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:07:51.044379 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-0ff64e7e-1d2f-41cd-b7d2-39cead9ea7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:51.086982 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5453b-7923-448b-8200-0d5b763abb16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:51.088331 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5453b-7923-448b-8200-0d5b763abb16 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:51.097076 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1200/2405] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:07:50 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 02:07:51.110766 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1206/2406] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:07:51 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:07:51.120340 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5453b-7923-448b-8200-0d5b763abb16 service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:51.121803 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3ba5453b-7923-448b-8200-0d5b763abb16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:51.133203 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5453b-7923-448b-8200-0d5b763abb16 service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:51.179777 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86023b6b-9e35-4f49-9dd6-c5608ee80726 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:51.180427 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86023b6b-9e35-4f49-9dd6-c5608ee80726 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:51.180706 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86023b6b-9e35-4f49-9dd6-c5608ee80726 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:51.180980 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86023b6b-9e35-4f49-9dd6-c5608ee80726 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:51.190439 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86023b6b-9e35-4f49-9dd6-c5608ee80726 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:51.191844 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86023b6b-9e35-4f49-9dd6-c5608ee80726 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:51.201017 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1201/2407] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:07:51 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:07:51.291720 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff64e7e-1d2f-41cd-b7d2-39cead9ea7cd None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:51.302267 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff64e7e-1d2f-41cd-b7d2-39cead9ea7cd None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:51.306614 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502d14a-fb9c-4bfb-b089-42dd38b1ae58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:51.307267 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502d14a-fb9c-4bfb-b089-42dd38b1ae58 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:51.307555 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502d14a-fb9c-4bfb-b089-42dd38b1ae58 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:51.307836 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502d14a-fb9c-4bfb-b089-42dd38b1ae58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:51.371841 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502d14a-fb9c-4bfb-b089-42dd38b1ae58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:51.373965 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502d14a-fb9c-4bfb-b089-42dd38b1ae58 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:51.385437 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1207/2408] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:07:51 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:07:57.033618 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86023b6b-9e35-4f49-9dd6-c5608ee80726 service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:57.092207 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86023b6b-9e35-4f49-9dd6-c5608ee80726 service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:57.096831 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654a0ab-2529-46be-9ee9-b4349ea459a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:57.097706 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654a0ab-2529-46be-9ee9-b4349ea459a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:57.097990 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654a0ab-2529-46be-9ee9-b4349ea459a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:57.098263 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654a0ab-2529-46be-9ee9-b4349ea459a5 admin admin] PATH_INFO: `/v3/users/1738bea3061d4ea7a2d4c0deb491b77c` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:57.099449 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654a0ab-2529-46be-9ee9-b4349ea459a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1738bea3061d4ea7a2d4c0deb491b77c)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:57.101351 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654a0ab-2529-46be-9ee9-b4349ea459a5 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:57.150319 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d654a0ab-2529-46be-9ee9-b4349ea459a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1738bea3061d4ea7a2d4c0deb491b77c'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:57.158122 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d654a0ab-2529-46be-9ee9-b4349ea459a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1738bea3061d4ea7a2d4c0deb491b77c'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:57.158803 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d654a0ab-2529-46be-9ee9-b4349ea459a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1738bea3061d4ea7a2d4c0deb491b77c'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:57.170302 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d654a0ab-2529-46be-9ee9-b4349ea459a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1738bea3061d4ea7a2d4c0deb491b77c'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:57.177856 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d654a0ab-2529-46be-9ee9-b4349ea459a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1738bea3061d4ea7a2d4c0deb491b77c'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:57.184281 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1202/2409] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:07:57 2021] DELETE /identity/v3/users/1738bea3061d4ea7a2d4c0deb491b77c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:07:57.188646 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccccd4-f1e4-4ec1-8f1c-c3340f65fa9d None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:57.189119 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccccd4-f1e4-4ec1-8f1c-c3340f65fa9d None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:57.189373 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccccd4-f1e4-4ec1-8f1c-c3340f65fa9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:57.206886 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-f0ccccd4-f1e4-4ec1-8f1c-c3340f65fa9d None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:07:57.208127 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-f0ccccd4-f1e4-4ec1-8f1c-c3340f65fa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:57.265337 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1208/2410] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:07:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:07:57.275309 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654a0ab-2529-46be-9ee9-b4349ea459a5 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:57.276728 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-d654a0ab-2529-46be-9ee9-b4349ea459a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:57.331381 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654a0ab-2529-46be-9ee9-b4349ea459a5 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:57.335012 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa3453-7497-458f-a19a-021877522572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:57.335653 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa3453-7497-458f-a19a-021877522572 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:57.335936 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa3453-7497-458f-a19a-021877522572 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:57.336212 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa3453-7497-458f-a19a-021877522572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:57.345643 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa3453-7497-458f-a19a-021877522572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:57.347045 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa3453-7497-458f-a19a-021877522572 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:57.356137 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1203/2411] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:07:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 02:07:57.618499 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccccd4-f1e4-4ec1-8f1c-c3340f65fa9d None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:57.620010 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-f0ccccd4-f1e4-4ec1-8f1c-c3340f65fa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:57.632679 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccccd4-f1e4-4ec1-8f1c-c3340f65fa9d None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:57.637416 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab42de0-4145-46fd-9369-bc3bd7730b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:57.638317 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab42de0-4145-46fd-9369-bc3bd7730b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:57.638603 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab42de0-4145-46fd-9369-bc3bd7730b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:57.638883 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab42de0-4145-46fd-9369-bc3bd7730b7e admin admin] PATH_INFO: `/v3/projects/25f294b8a6bc46b1a21317683ee682dd` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:57.640750 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab42de0-4145-46fd-9369-bc3bd7730b7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f294b8a6bc46b1a21317683ee682dd)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:57.642676 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab42de0-4145-46fd-9369-bc3bd7730b7e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:57.687325 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6ab42de0-4145-46fd-9369-bc3bd7730b7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f294b8a6bc46b1a21317683ee682dd', 'request_id': 'req-6ab42de0-4145-46fd-9369-bc3bd7730b7e'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:57.692833 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6ab42de0-4145-46fd-9369-bc3bd7730b7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f294b8a6bc46b1a21317683ee682dd', 'request_id': 'req-6ab42de0-4145-46fd-9369-bc3bd7730b7e'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:57.699907 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6ab42de0-4145-46fd-9369-bc3bd7730b7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f294b8a6bc46b1a21317683ee682dd', 'request_id': 'req-6ab42de0-4145-46fd-9369-bc3bd7730b7e'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:57.711377 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6ab42de0-4145-46fd-9369-bc3bd7730b7e admin admin] The token cache is being invalidate because project 25f294b8a6bc46b1a21317683ee682dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:07:57.711669 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6ab42de0-4145-46fd-9369-bc3bd7730b7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:57.712291 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6ab42de0-4145-46fd-9369-bc3bd7730b7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:57.713852 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1209/2412] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:07:57 2021] DELETE /identity/v3/projects/25f294b8a6bc46b1a21317683ee682dd => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:07:57.717744 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa3453-7497-458f-a19a-021877522572 service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:57.727178 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa3453-7497-458f-a19a-021877522572 service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:57.779913 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefb446-8f48-4a31-9fd8-5a6d77bce78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:57.780795 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefb446-8f48-4a31-9fd8-5a6d77bce78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:57.781075 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefb446-8f48-4a31-9fd8-5a6d77bce78c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:57.781347 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefb446-8f48-4a31-9fd8-5a6d77bce78c admin admin] PATH_INFO: `/v3/users/4e31fc54be464edc889fde15faa6a177` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:57.782569 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefb446-8f48-4a31-9fd8-5a6d77bce78c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e31fc54be464edc889fde15faa6a177)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:57.784455 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefb446-8f48-4a31-9fd8-5a6d77bce78c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:57.829835 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-3fefb446-8f48-4a31-9fd8-5a6d77bce78c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e31fc54be464edc889fde15faa6a177'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:57.836702 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-3fefb446-8f48-4a31-9fd8-5a6d77bce78c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e31fc54be464edc889fde15faa6a177'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:57.837386 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-3fefb446-8f48-4a31-9fd8-5a6d77bce78c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e31fc54be464edc889fde15faa6a177'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:57.849618 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-3fefb446-8f48-4a31-9fd8-5a6d77bce78c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e31fc54be464edc889fde15faa6a177'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:57.856827 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-3fefb446-8f48-4a31-9fd8-5a6d77bce78c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e31fc54be464edc889fde15faa6a177'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:57.863135 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1204/2413] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:07:57 2021] DELETE /identity/v3/users/4e31fc54be464edc889fde15faa6a177 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:07:58.129464 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab42de0-4145-46fd-9369-bc3bd7730b7e admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:58.131352 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-6ab42de0-4145-46fd-9369-bc3bd7730b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:58.144575 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab42de0-4145-46fd-9369-bc3bd7730b7e admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:58.199493 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036e8ce-0d7f-48dc-843a-14c76bee740a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:58.200387 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036e8ce-0d7f-48dc-843a-14c76bee740a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:58.200888 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036e8ce-0d7f-48dc-843a-14c76bee740a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:58.201173 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036e8ce-0d7f-48dc-843a-14c76bee740a admin admin] PATH_INFO: `/v3/projects/b44669cae55d482fb40ccabf3b12a9bc` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:58.202395 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036e8ce-0d7f-48dc-843a-14c76bee740a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b44669cae55d482fb40ccabf3b12a9bc)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:58.204317 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036e8ce-0d7f-48dc-843a-14c76bee740a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:58.252217 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-8036e8ce-0d7f-48dc-843a-14c76bee740a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b44669cae55d482fb40ccabf3b12a9bc', 'request_id': 'req-8036e8ce-0d7f-48dc-843a-14c76bee740a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:58.257400 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-8036e8ce-0d7f-48dc-843a-14c76bee740a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b44669cae55d482fb40ccabf3b12a9bc', 'request_id': 'req-8036e8ce-0d7f-48dc-843a-14c76bee740a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:58.264528 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-8036e8ce-0d7f-48dc-843a-14c76bee740a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b44669cae55d482fb40ccabf3b12a9bc', 'request_id': 'req-8036e8ce-0d7f-48dc-843a-14c76bee740a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:58.276796 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-8036e8ce-0d7f-48dc-843a-14c76bee740a admin admin] The token cache is being invalidate because project b44669cae55d482fb40ccabf3b12a9bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:07:58.277165 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-8036e8ce-0d7f-48dc-843a-14c76bee740a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:58.277821 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-8036e8ce-0d7f-48dc-843a-14c76bee740a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:58.279329 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1210/2414] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:07:58 2021] DELETE /identity/v3/projects/b44669cae55d482fb40ccabf3b12a9bc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:07:58.286766 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a71e30-6c61-4665-a773-1471f44a175f None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:58.287237 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a71e30-6c61-4665-a773-1471f44a175f None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:58.287359 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a71e30-6c61-4665-a773-1471f44a175f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:58.307248 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-d9a71e30-6c61-4665-a773-1471f44a175f None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:07:58.308431 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-d9a71e30-6c61-4665-a773-1471f44a175f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:58.364832 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1205/2415] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:07:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:07:58.372969 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a254fa2-5590-4e77-b230-5524f18400a9 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:58.373257 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a254fa2-5590-4e77-b230-5524f18400a9 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:58.373568 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a254fa2-5590-4e77-b230-5524f18400a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:58.391562 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-4a254fa2-5590-4e77-b230-5524f18400a9 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:07:58.392752 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-4a254fa2-5590-4e77-b230-5524f18400a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:58.400464 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1211/2416] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:07:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:07:58.404452 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a71e30-6c61-4665-a773-1471f44a175f None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:58.414216 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a71e30-6c61-4665-a773-1471f44a175f None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:58.418835 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e4e65-0d05-4e28-a9db-60374b28653f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:58.419476 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e4e65-0d05-4e28-a9db-60374b28653f admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:58.419757 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e4e65-0d05-4e28-a9db-60374b28653f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:58.420032 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e4e65-0d05-4e28-a9db-60374b28653f admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:58.420761 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e4e65-0d05-4e28-a9db-60374b28653f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 02:07:58.421742 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e4e65-0d05-4e28-a9db-60374b28653f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:58.423317 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e4e65-0d05-4e28-a9db-60374b28653f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:58.434644 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1206/2417] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 02:07:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 02:07:58.438644 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a254fa2-5590-4e77-b230-5524f18400a9 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:58.447796 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a254fa2-5590-4e77-b230-5524f18400a9 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:58.452445 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64935c-6fc1-4472-a2a0-fb0788b5c06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:58.453086 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64935c-6fc1-4472-a2a0-fb0788b5c06b admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:58.453370 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64935c-6fc1-4472-a2a0-fb0788b5c06b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:58.453680 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64935c-6fc1-4472-a2a0-fb0788b5c06b admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:58.454389 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64935c-6fc1-4472-a2a0-fb0788b5c06b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:58.456259 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64935c-6fc1-4472-a2a0-fb0788b5c06b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:58.480963 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1212/2418] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:07:58 2021] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:07:58.485420 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e4e65-0d05-4e28-a9db-60374b28653f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:58.495078 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e4e65-0d05-4e28-a9db-60374b28653f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:58.549982 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0de672-de24-49ef-b9fb-3df28197b7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:58.550581 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0de672-de24-49ef-b9fb-3df28197b7af admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:58.550869 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0de672-de24-49ef-b9fb-3df28197b7af admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:58.551153 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0de672-de24-49ef-b9fb-3df28197b7af admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:58.551863 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0de672-de24-49ef-b9fb-3df28197b7af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:58.553788 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0de672-de24-49ef-b9fb-3df28197b7af admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:58.572058 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1207/2419] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:07:58 2021] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:07:58.576150 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64935c-6fc1-4472-a2a0-fb0788b5c06b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:58.586669 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64935c-6fc1-4472-a2a0-fb0788b5c06b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:58.591225 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31af2a-d151-4615-a248-bc913c024ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:58.591871 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31af2a-d151-4615-a248-bc913c024ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:58.592158 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31af2a-d151-4615-a248-bc913c024ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:58.592436 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31af2a-d151-4615-a248-bc913c024ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:58.593816 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31af2a-d151-4615-a248-bc913c024ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:58.595390 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31af2a-d151-4615-a248-bc913c024ff9 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:58.605685 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1213/2420] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:07:58 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:07:58.609346 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0de672-de24-49ef-b9fb-3df28197b7af admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:58.618895 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0de672-de24-49ef-b9fb-3df28197b7af admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:58.623539 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3007f-9d57-4a09-857c-983bd8de10c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:58.624212 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3007f-9d57-4a09-857c-983bd8de10c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:58.624493 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3007f-9d57-4a09-857c-983bd8de10c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:58.624771 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3007f-9d57-4a09-857c-983bd8de10c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:58.625530 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3007f-9d57-4a09-857c-983bd8de10c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:58.627362 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3007f-9d57-4a09-857c-983bd8de10c8 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:58.637153 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1208/2421] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:07:58 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:07:58.641475 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31af2a-d151-4615-a248-bc913c024ff9 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:58.651159 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31af2a-d151-4615-a248-bc913c024ff9 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:58.656309 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb11f0a-a09f-4b55-af94-796f3f2272e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:58.657168 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb11f0a-a09f-4b55-af94-796f3f2272e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:58.657452 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb11f0a-a09f-4b55-af94-796f3f2272e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:58.657768 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb11f0a-a09f-4b55-af94-796f3f2272e5 admin admin] PATH_INFO: `/v3/projects/e9b3ce4ea28940309837b12c62ff8dee/users/d2ae78d882fd4fc79d1d01e2482ca345/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:58.671637 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb11f0a-a09f-4b55-af94-796f3f2272e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9b3ce4ea28940309837b12c62ff8dee, user_id=d2ae78d882fd4fc79d1d01e2482ca345, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:58.674282 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb11f0a-a09f-4b55-af94-796f3f2272e5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:58.687000 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1214/2422] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:07:58 2021] PUT /identity/v3/projects/e9b3ce4ea28940309837b12c62ff8dee/users/d2ae78d882fd4fc79d1d01e2482ca345/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:07:58.698133 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75a246-f1c6-42ba-855a-afcd0deafd14 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:58.698432 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75a246-f1c6-42ba-855a-afcd0deafd14 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:58.698718 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75a246-f1c6-42ba-855a-afcd0deafd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:58.725031 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-ab75a246-f1c6-42ba-855a-afcd0deafd14 None None] MFA Rules not processed for user `d2ae78d882fd4fc79d1d01e2482ca345`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:07:58.726407 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-ab75a246-f1c6-42ba-855a-afcd0deafd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:58.786695 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1209/2423] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:07:58 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:07:58.797030 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb11f0a-a09f-4b55-af94-796f3f2272e5 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:58.798713 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-8eb11f0a-a09f-4b55-af94-796f3f2272e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:58.853726 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb11f0a-a09f-4b55-af94-796f3f2272e5 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:58.857457 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd690c0-f5fd-4aaa-88c4-accf3711c6cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:58.858132 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd690c0-f5fd-4aaa-88c4-accf3711c6cf service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:58.858432 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd690c0-f5fd-4aaa-88c4-accf3711c6cf service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:58.858703 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd690c0-f5fd-4aaa-88c4-accf3711c6cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:58.867378 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd690c0-f5fd-4aaa-88c4-accf3711c6cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:58.868787 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd690c0-f5fd-4aaa-88c4-accf3711c6cf service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:58.877865 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1215/2424] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:07:58 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:07:58.897911 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75a246-f1c6-42ba-855a-afcd0deafd14 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:58.957951 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75a246-f1c6-42ba-855a-afcd0deafd14 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:58.962599 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65403692-8d06-407d-8142-30cf66857578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:58.963466 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65403692-8d06-407d-8142-30cf66857578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:58.963756 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65403692-8d06-407d-8142-30cf66857578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:58.964041 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65403692-8d06-407d-8142-30cf66857578 admin admin] PATH_INFO: `/v3/users/d2ae78d882fd4fc79d1d01e2482ca345` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:58.965261 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65403692-8d06-407d-8142-30cf66857578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2ae78d882fd4fc79d1d01e2482ca345)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:58.967211 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65403692-8d06-407d-8142-30cf66857578 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:59.011858 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-65403692-8d06-407d-8142-30cf66857578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2ae78d882fd4fc79d1d01e2482ca345'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:59.019143 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-65403692-8d06-407d-8142-30cf66857578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2ae78d882fd4fc79d1d01e2482ca345'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:59.019811 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-65403692-8d06-407d-8142-30cf66857578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2ae78d882fd4fc79d1d01e2482ca345'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:59.031216 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-65403692-8d06-407d-8142-30cf66857578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2ae78d882fd4fc79d1d01e2482ca345'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:59.038174 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-65403692-8d06-407d-8142-30cf66857578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2ae78d882fd4fc79d1d01e2482ca345'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:59.043888 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1210/2425] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:07:58 2021] DELETE /identity/v3/users/d2ae78d882fd4fc79d1d01e2482ca345 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:07:59.048526 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aac9e-fc9e-4683-aff1-dc5fed0637d4 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:59.048822 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aac9e-fc9e-4683-aff1-dc5fed0637d4 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:59.049106 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aac9e-fc9e-4683-aff1-dc5fed0637d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:59.066423 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-e00aac9e-fc9e-4683-aff1-dc5fed0637d4 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:07:59.067621 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-e00aac9e-fc9e-4683-aff1-dc5fed0637d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:59.122990 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1216/2426] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:07:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:07:59.133828 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65403692-8d06-407d-8142-30cf66857578 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:59.135265 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-65403692-8d06-407d-8142-30cf66857578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:59.198633 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65403692-8d06-407d-8142-30cf66857578 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:59.203027 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2b2a9-a398-4941-a47c-5e95e9810001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:59.203664 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2b2a9-a398-4941-a47c-5e95e9810001 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:59.203947 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2b2a9-a398-4941-a47c-5e95e9810001 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:59.204226 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2b2a9-a398-4941-a47c-5e95e9810001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:59.213042 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2b2a9-a398-4941-a47c-5e95e9810001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:59.214472 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2b2a9-a398-4941-a47c-5e95e9810001 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:59.223560 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1211/2427] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:07:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:07:59.480451 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aac9e-fc9e-4683-aff1-dc5fed0637d4 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:59.482027 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-e00aac9e-fc9e-4683-aff1-dc5fed0637d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:59.495156 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aac9e-fc9e-4683-aff1-dc5fed0637d4 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:59.500787 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64064e16-6081-4e21-aa6c-891a5590a521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:59.501903 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64064e16-6081-4e21-aa6c-891a5590a521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:59.502319 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64064e16-6081-4e21-aa6c-891a5590a521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:59.502727 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64064e16-6081-4e21-aa6c-891a5590a521 admin admin] PATH_INFO: `/v3/projects/e9b3ce4ea28940309837b12c62ff8dee` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:59.504110 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64064e16-6081-4e21-aa6c-891a5590a521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9b3ce4ea28940309837b12c62ff8dee)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:59.506022 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64064e16-6081-4e21-aa6c-891a5590a521 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:59.551408 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-64064e16-6081-4e21-aa6c-891a5590a521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9b3ce4ea28940309837b12c62ff8dee', 'request_id': 'req-64064e16-6081-4e21-aa6c-891a5590a521'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:59.556559 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-64064e16-6081-4e21-aa6c-891a5590a521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9b3ce4ea28940309837b12c62ff8dee', 'request_id': 'req-64064e16-6081-4e21-aa6c-891a5590a521'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:59.563849 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-64064e16-6081-4e21-aa6c-891a5590a521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9b3ce4ea28940309837b12c62ff8dee', 'request_id': 'req-64064e16-6081-4e21-aa6c-891a5590a521'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:59.574495 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-64064e16-6081-4e21-aa6c-891a5590a521 admin admin] The token cache is being invalidate because project e9b3ce4ea28940309837b12c62ff8dee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:07:59.574777 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-64064e16-6081-4e21-aa6c-891a5590a521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:59.575481 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-64064e16-6081-4e21-aa6c-891a5590a521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:07:59.577055 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1217/2428] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:07:59 2021] DELETE /identity/v3/projects/e9b3ce4ea28940309837b12c62ff8dee => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:07:59.582952 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63304be2-4e83-4cea-a5da-5d0dcc67b9a0 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:59.583439 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63304be2-4e83-4cea-a5da-5d0dcc67b9a0 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:59.583553 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63304be2-4e83-4cea-a5da-5d0dcc67b9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:59.600595 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-63304be2-4e83-4cea-a5da-5d0dcc67b9a0 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:07:59.601804 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-63304be2-4e83-4cea-a5da-5d0dcc67b9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:59.657001 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1212/2429] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:07:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:07:59.664539 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f43ecd-99e3-47fe-b8ef-0678c221461f None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:59.664835 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f43ecd-99e3-47fe-b8ef-0678c221461f None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:59.665118 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f43ecd-99e3-47fe-b8ef-0678c221461f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:59.683560 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-56f43ecd-99e3-47fe-b8ef-0678c221461f None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:07:59.684758 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-56f43ecd-99e3-47fe-b8ef-0678c221461f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:07:59.693161 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1218/2430] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:07:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:07:59.697017 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63304be2-4e83-4cea-a5da-5d0dcc67b9a0 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:59.706504 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63304be2-4e83-4cea-a5da-5d0dcc67b9a0 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:59.711080 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b3bec-fe12-423a-baab-0dc108b87a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:59.711760 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b3bec-fe12-423a-baab-0dc108b87a2a admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:59.712050 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b3bec-fe12-423a-baab-0dc108b87a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:59.712328 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b3bec-fe12-423a-baab-0dc108b87a2a admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:59.713117 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b3bec-fe12-423a-baab-0dc108b87a2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 02:07:59.713423 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b3bec-fe12-423a-baab-0dc108b87a2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:59.715028 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b3bec-fe12-423a-baab-0dc108b87a2a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:59.726803 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1213/2431] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 02:07:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 02:07:59.730761 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f43ecd-99e3-47fe-b8ef-0678c221461f None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:59.740591 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f43ecd-99e3-47fe-b8ef-0678c221461f None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:59.745200 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f34a9-74d2-433b-a9e4-e34d89e5fc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:59.745886 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f34a9-74d2-433b-a9e4-e34d89e5fc53 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:59.746178 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f34a9-74d2-433b-a9e4-e34d89e5fc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:59.746460 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f34a9-74d2-433b-a9e4-e34d89e5fc53 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:59.747172 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f34a9-74d2-433b-a9e4-e34d89e5fc53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:59.749137 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f34a9-74d2-433b-a9e4-e34d89e5fc53 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:59.773417 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1219/2432] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:07:59 2021] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:07:59.777391 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b3bec-fe12-423a-baab-0dc108b87a2a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:59.787512 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b3bec-fe12-423a-baab-0dc108b87a2a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:59.841108 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f367ac-ac87-4c6a-aa4f-3648b626c3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:59.841803 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f367ac-ac87-4c6a-aa4f-3648b626c3b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:59.842094 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f367ac-ac87-4c6a-aa4f-3648b626c3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:59.842394 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f367ac-ac87-4c6a-aa4f-3648b626c3b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:59.843565 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f367ac-ac87-4c6a-aa4f-3648b626c3b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:59.845531 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f367ac-ac87-4c6a-aa4f-3648b626c3b7 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:59.864868 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1214/2433] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:07:59 2021] POST /identity/v3/users => generated 286 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:07:59.868703 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f34a9-74d2-433b-a9e4-e34d89e5fc53 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:59.879116 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f34a9-74d2-433b-a9e4-e34d89e5fc53 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:59.883746 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50331dd9-fe42-4f36-9535-d75d34ccea14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:59.884395 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50331dd9-fe42-4f36-9535-d75d34ccea14 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:59.884683 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50331dd9-fe42-4f36-9535-d75d34ccea14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:59.884962 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50331dd9-fe42-4f36-9535-d75d34ccea14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:59.885761 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50331dd9-fe42-4f36-9535-d75d34ccea14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:59.887348 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50331dd9-fe42-4f36-9535-d75d34ccea14 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:59.899244 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1220/2434] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:07:59 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:07:59.903155 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f367ac-ac87-4c6a-aa4f-3648b626c3b7 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:59.913407 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f367ac-ac87-4c6a-aa4f-3648b626c3b7 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:59.918067 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a130afa-b1a5-4868-923f-e0640dafac77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:59.918719 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a130afa-b1a5-4868-923f-e0640dafac77 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:59.919003 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a130afa-b1a5-4868-923f-e0640dafac77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:59.919280 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a130afa-b1a5-4868-923f-e0640dafac77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:59.920009 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a130afa-b1a5-4868-923f-e0640dafac77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:59.922289 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a130afa-b1a5-4868-923f-e0640dafac77 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:59.932079 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1215/2435] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:07:59 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:07:59.935930 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50331dd9-fe42-4f36-9535-d75d34ccea14 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:07:59.945752 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50331dd9-fe42-4f36-9535-d75d34ccea14 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:07:59.950399 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978ab97-76e8-4697-8371-e27d19b30e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:07:59.951265 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978ab97-76e8-4697-8371-e27d19b30e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:59.951551 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978ab97-76e8-4697-8371-e27d19b30e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:59.951826 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978ab97-76e8-4697-8371-e27d19b30e28 admin admin] PATH_INFO: `/v3/projects/6702a9c3c7db49d583ac69899e87e9fe/users/c637635d36d144f0b10260c149fd6d01/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:07:59.966290 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978ab97-76e8-4697-8371-e27d19b30e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6702a9c3c7db49d583ac69899e87e9fe, user_id=c637635d36d144f0b10260c149fd6d01, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:07:59.969876 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978ab97-76e8-4697-8371-e27d19b30e28 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:07:59.983279 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1221/2436] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:07:59 2021] PUT /identity/v3/projects/6702a9c3c7db49d583ac69899e87e9fe/users/c637635d36d144f0b10260c149fd6d01/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:07:59.993763 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0c266-1265-4feb-9bb0-4407a6317b2a None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:07:59.994057 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0c266-1265-4feb-9bb0-4407a6317b2a None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:07:59.994346 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0c266-1265-4feb-9bb0-4407a6317b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:00.020313 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-33f0c266-1265-4feb-9bb0-4407a6317b2a None None] MFA Rules not processed for user `c637635d36d144f0b10260c149fd6d01`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:08:00.021543 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-33f0c266-1265-4feb-9bb0-4407a6317b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:00.084165 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1216/2437] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:07:59 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:08:00.094816 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978ab97-76e8-4697-8371-e27d19b30e28 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:00.096483 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-8978ab97-76e8-4697-8371-e27d19b30e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:00.149601 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978ab97-76e8-4697-8371-e27d19b30e28 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:00.153200 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263914ea-c067-4d84-8fcf-722854ccf53a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:00.153864 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263914ea-c067-4d84-8fcf-722854ccf53a service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:00.154159 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263914ea-c067-4d84-8fcf-722854ccf53a service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:00.154439 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263914ea-c067-4d84-8fcf-722854ccf53a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:00.163059 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263914ea-c067-4d84-8fcf-722854ccf53a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:00.164500 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263914ea-c067-4d84-8fcf-722854ccf53a service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:00.172978 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1222/2438] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:08:00 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:08:00.193440 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0c266-1265-4feb-9bb0-4407a6317b2a None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:00.254171 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0c266-1265-4feb-9bb0-4407a6317b2a None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:00.258791 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301e212-0f10-4f46-9e72-24d35b61678e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:00.259647 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301e212-0f10-4f46-9e72-24d35b61678e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:00.259932 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301e212-0f10-4f46-9e72-24d35b61678e admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:00.260209 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301e212-0f10-4f46-9e72-24d35b61678e admin admin] PATH_INFO: `/v3/users/c637635d36d144f0b10260c149fd6d01` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:00.261418 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301e212-0f10-4f46-9e72-24d35b61678e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c637635d36d144f0b10260c149fd6d01)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:00.263362 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301e212-0f10-4f46-9e72-24d35b61678e admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:00.308047 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-f301e212-0f10-4f46-9e72-24d35b61678e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c637635d36d144f0b10260c149fd6d01'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:00.314824 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-f301e212-0f10-4f46-9e72-24d35b61678e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c637635d36d144f0b10260c149fd6d01'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:00.315536 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-f301e212-0f10-4f46-9e72-24d35b61678e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c637635d36d144f0b10260c149fd6d01'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:00.328031 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-f301e212-0f10-4f46-9e72-24d35b61678e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c637635d36d144f0b10260c149fd6d01'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:00.336264 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-f301e212-0f10-4f46-9e72-24d35b61678e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c637635d36d144f0b10260c149fd6d01'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:00.342453 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1217/2439] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:08:00 2021] DELETE /identity/v3/users/c637635d36d144f0b10260c149fd6d01 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:08:00.347418 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aaa8da-d5a0-4e4a-851e-2c36511dc1bf None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:00.347706 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aaa8da-d5a0-4e4a-851e-2c36511dc1bf None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:00.348009 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aaa8da-d5a0-4e4a-851e-2c36511dc1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:00.364450 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-c5aaa8da-d5a0-4e4a-851e-2c36511dc1bf None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:08:00.365686 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-c5aaa8da-d5a0-4e4a-851e-2c36511dc1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:00.420835 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1223/2440] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:08:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:08:00.431363 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301e212-0f10-4f46-9e72-24d35b61678e admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:00.432744 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-f301e212-0f10-4f46-9e72-24d35b61678e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:00.487765 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301e212-0f10-4f46-9e72-24d35b61678e admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:00.491626 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61471d1a-2935-434e-b77e-8e8b5a0b919c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:00.492270 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61471d1a-2935-434e-b77e-8e8b5a0b919c service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:00.492557 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61471d1a-2935-434e-b77e-8e8b5a0b919c service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:00.492843 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61471d1a-2935-434e-b77e-8e8b5a0b919c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:00.502259 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61471d1a-2935-434e-b77e-8e8b5a0b919c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:00.503687 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61471d1a-2935-434e-b77e-8e8b5a0b919c service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:00.512892 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1218/2441] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:08:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:08:00.767710 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aaa8da-d5a0-4e4a-851e-2c36511dc1bf None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:00.769197 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-c5aaa8da-d5a0-4e4a-851e-2c36511dc1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:00.781747 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aaa8da-d5a0-4e4a-851e-2c36511dc1bf None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:00.786347 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a20d4-5c76-4e70-8324-a5905c5d23a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:00.787209 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a20d4-5c76-4e70-8324-a5905c5d23a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:00.787495 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a20d4-5c76-4e70-8324-a5905c5d23a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:00.787774 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a20d4-5c76-4e70-8324-a5905c5d23a8 admin admin] PATH_INFO: `/v3/projects/6702a9c3c7db49d583ac69899e87e9fe` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:00.789022 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a20d4-5c76-4e70-8324-a5905c5d23a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6702a9c3c7db49d583ac69899e87e9fe)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:00.790957 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a20d4-5c76-4e70-8324-a5905c5d23a8 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:00.838669 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-d59a20d4-5c76-4e70-8324-a5905c5d23a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6702a9c3c7db49d583ac69899e87e9fe', 'request_id': 'req-d59a20d4-5c76-4e70-8324-a5905c5d23a8'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:00.843866 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-d59a20d4-5c76-4e70-8324-a5905c5d23a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6702a9c3c7db49d583ac69899e87e9fe', 'request_id': 'req-d59a20d4-5c76-4e70-8324-a5905c5d23a8'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:00.850857 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-d59a20d4-5c76-4e70-8324-a5905c5d23a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6702a9c3c7db49d583ac69899e87e9fe', 'request_id': 'req-d59a20d4-5c76-4e70-8324-a5905c5d23a8'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:00.862221 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-d59a20d4-5c76-4e70-8324-a5905c5d23a8 admin admin] The token cache is being invalidate because project 6702a9c3c7db49d583ac69899e87e9fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:08:00.862506 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-d59a20d4-5c76-4e70-8324-a5905c5d23a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:00.863137 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-d59a20d4-5c76-4e70-8324-a5905c5d23a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:00.864652 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1224/2442] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:08:00 2021] DELETE /identity/v3/projects/6702a9c3c7db49d583ac69899e87e9fe => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:08:00.870268 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a345ba-72d7-42d9-aa6b-0672bdc9c06c None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:00.870753 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a345ba-72d7-42d9-aa6b-0672bdc9c06c None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:00.870858 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a345ba-72d7-42d9-aa6b-0672bdc9c06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:00.888992 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-29a345ba-72d7-42d9-aa6b-0672bdc9c06c None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:08:00.890219 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-29a345ba-72d7-42d9-aa6b-0672bdc9c06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:00.949443 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1219/2443] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:08:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:08:00.957352 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00d863-853f-4c76-9c26-2c243edfdc07 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:00.957696 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00d863-853f-4c76-9c26-2c243edfdc07 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:00.957991 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00d863-853f-4c76-9c26-2c243edfdc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:00.976679 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-bc00d863-853f-4c76-9c26-2c243edfdc07 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:08:00.978006 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-bc00d863-853f-4c76-9c26-2c243edfdc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:00.988398 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1225/2444] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:08:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:08:00.992633 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a345ba-72d7-42d9-aa6b-0672bdc9c06c None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:01.005433 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a345ba-72d7-42d9-aa6b-0672bdc9c06c None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:01.010418 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8362bf-42a8-4f83-9174-281a73bf5a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:01.011083 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8362bf-42a8-4f83-9174-281a73bf5a39 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:01.011392 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8362bf-42a8-4f83-9174-281a73bf5a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:01.011674 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8362bf-42a8-4f83-9174-281a73bf5a39 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:01.012412 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8362bf-42a8-4f83-9174-281a73bf5a39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 02:08:01.012718 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8362bf-42a8-4f83-9174-281a73bf5a39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:01.014338 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8362bf-42a8-4f83-9174-281a73bf5a39 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:01.029705 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1220/2445] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 02:08:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 02:08:01.031207 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00d863-853f-4c76-9c26-2c243edfdc07 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:01.041868 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00d863-853f-4c76-9c26-2c243edfdc07 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:01.048659 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2c38f-cf66-4e77-8c50-ebcdbbaedf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:01.049512 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2c38f-cf66-4e77-8c50-ebcdbbaedf1f admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:01.050339 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2c38f-cf66-4e77-8c50-ebcdbbaedf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:01.050510 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2c38f-cf66-4e77-8c50-ebcdbbaedf1f admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:01.051109 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2c38f-cf66-4e77-8c50-ebcdbbaedf1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:01.052992 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2c38f-cf66-4e77-8c50-ebcdbbaedf1f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:01.080362 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1226/2446] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:08:01 2021] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:08:01.084382 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8362bf-42a8-4f83-9174-281a73bf5a39 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:01.094293 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8362bf-42a8-4f83-9174-281a73bf5a39 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:01.149688 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3ab6a-98ac-40a0-a748-7faf08b49c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:01.150355 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3ab6a-98ac-40a0-a748-7faf08b49c09 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:01.150639 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3ab6a-98ac-40a0-a748-7faf08b49c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:01.150919 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3ab6a-98ac-40a0-a748-7faf08b49c09 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:01.151616 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3ab6a-98ac-40a0-a748-7faf08b49c09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:01.153527 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3ab6a-98ac-40a0-a748-7faf08b49c09 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:01.172909 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1221/2447] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:08:01 2021] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:08:01.177294 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2c38f-cf66-4e77-8c50-ebcdbbaedf1f admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:01.187999 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2c38f-cf66-4e77-8c50-ebcdbbaedf1f admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:01.192906 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d61962-1af7-470e-8d12-99103c284514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:01.193589 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d61962-1af7-470e-8d12-99103c284514 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:01.193877 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d61962-1af7-470e-8d12-99103c284514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:01.194154 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d61962-1af7-470e-8d12-99103c284514 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:01.194890 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d61962-1af7-470e-8d12-99103c284514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:01.196461 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d61962-1af7-470e-8d12-99103c284514 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:01.206796 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1227/2448] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:08:01 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:08:01.211086 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3ab6a-98ac-40a0-a748-7faf08b49c09 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:01.221359 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3ab6a-98ac-40a0-a748-7faf08b49c09 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:01.226794 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155746b-b019-41fa-aa15-ebb89789b2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:01.227558 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155746b-b019-41fa-aa15-ebb89789b2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:01.227879 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155746b-b019-41fa-aa15-ebb89789b2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:01.228166 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155746b-b019-41fa-aa15-ebb89789b2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:01.228902 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155746b-b019-41fa-aa15-ebb89789b2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:01.230523 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155746b-b019-41fa-aa15-ebb89789b2e2 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:01.241078 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1222/2449] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:08:01 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:08:01.245188 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d61962-1af7-470e-8d12-99103c284514 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:01.255046 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d61962-1af7-470e-8d12-99103c284514 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:01.259649 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d99923-710a-4467-9e5c-b0f3db362691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:01.260518 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d99923-710a-4467-9e5c-b0f3db362691 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:01.260809 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d99923-710a-4467-9e5c-b0f3db362691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:01.261082 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d99923-710a-4467-9e5c-b0f3db362691 admin admin] PATH_INFO: `/v3/projects/0e8070a44dcf4cdf923038111ae03191/users/42c14a1cc9c3470aaeb4490e88cce1f7/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:01.275041 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d99923-710a-4467-9e5c-b0f3db362691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8070a44dcf4cdf923038111ae03191, user_id=42c14a1cc9c3470aaeb4490e88cce1f7, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:01.277690 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d99923-710a-4467-9e5c-b0f3db362691 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:01.290865 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1228/2450] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:08:01 2021] PUT /identity/v3/projects/0e8070a44dcf4cdf923038111ae03191/users/42c14a1cc9c3470aaeb4490e88cce1f7/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:08:01.302035 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e77609-b432-43fd-b333-3eb1cfe0608b None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:01.302331 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e77609-b432-43fd-b333-3eb1cfe0608b None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:01.302640 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e77609-b432-43fd-b333-3eb1cfe0608b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:01.328882 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-e7e77609-b432-43fd-b333-3eb1cfe0608b None None] MFA Rules not processed for user `42c14a1cc9c3470aaeb4490e88cce1f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:08:01.330080 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-e7e77609-b432-43fd-b333-3eb1cfe0608b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:01.394828 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1223/2451] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:08:01 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:08:01.404653 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d99923-710a-4467-9e5c-b0f3db362691 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:01.406938 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-50d99923-710a-4467-9e5c-b0f3db362691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:01.461037 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d99923-710a-4467-9e5c-b0f3db362691 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:01.464567 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328be98-c958-4461-897b-31fef08766c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:01.465207 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328be98-c958-4461-897b-31fef08766c5 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:01.465508 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328be98-c958-4461-897b-31fef08766c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:01.465804 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328be98-c958-4461-897b-31fef08766c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:01.474417 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328be98-c958-4461-897b-31fef08766c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:01.475820 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328be98-c958-4461-897b-31fef08766c5 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:01.485077 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1229/2452] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:08:01 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:08:06.507979 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e77609-b432-43fd-b333-3eb1cfe0608b None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:06.568508 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e77609-b432-43fd-b333-3eb1cfe0608b None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:06.572964 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb0307-f79a-4bdd-92ad-ba3768ea5331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:06.573857 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb0307-f79a-4bdd-92ad-ba3768ea5331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:06.574136 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb0307-f79a-4bdd-92ad-ba3768ea5331 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:06.574413 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb0307-f79a-4bdd-92ad-ba3768ea5331 admin admin] PATH_INFO: `/v3/users/42c14a1cc9c3470aaeb4490e88cce1f7` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:06.575606 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb0307-f79a-4bdd-92ad-ba3768ea5331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42c14a1cc9c3470aaeb4490e88cce1f7)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:06.577536 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb0307-f79a-4bdd-92ad-ba3768ea5331 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:06.624158 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-ecbb0307-f79a-4bdd-92ad-ba3768ea5331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42c14a1cc9c3470aaeb4490e88cce1f7'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:06.630831 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-ecbb0307-f79a-4bdd-92ad-ba3768ea5331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42c14a1cc9c3470aaeb4490e88cce1f7'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:06.631513 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-ecbb0307-f79a-4bdd-92ad-ba3768ea5331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42c14a1cc9c3470aaeb4490e88cce1f7'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:06.642851 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-ecbb0307-f79a-4bdd-92ad-ba3768ea5331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42c14a1cc9c3470aaeb4490e88cce1f7'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:06.649865 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-ecbb0307-f79a-4bdd-92ad-ba3768ea5331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42c14a1cc9c3470aaeb4490e88cce1f7'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:06.656692 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1224/2453] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:08:06 2021] DELETE /identity/v3/users/42c14a1cc9c3470aaeb4490e88cce1f7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:08:06.661032 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5eee18-6955-4f9c-aba9-c435c89f98f2 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:06.661552 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5eee18-6955-4f9c-aba9-c435c89f98f2 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:06.661661 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5eee18-6955-4f9c-aba9-c435c89f98f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:06.688115 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-ce5eee18-6955-4f9c-aba9-c435c89f98f2 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:08:06.689315 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-ce5eee18-6955-4f9c-aba9-c435c89f98f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:06.746164 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1230/2454] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:08:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:08:06.755932 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb0307-f79a-4bdd-92ad-ba3768ea5331 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:06.757318 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-ecbb0307-f79a-4bdd-92ad-ba3768ea5331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:06.812569 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb0307-f79a-4bdd-92ad-ba3768ea5331 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:06.816346 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e499eeb-7237-4874-9e64-5417dd8d528a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:06.816986 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e499eeb-7237-4874-9e64-5417dd8d528a service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:06.817271 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e499eeb-7237-4874-9e64-5417dd8d528a service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:06.817594 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e499eeb-7237-4874-9e64-5417dd8d528a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:06.826466 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e499eeb-7237-4874-9e64-5417dd8d528a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:06.828374 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e499eeb-7237-4874-9e64-5417dd8d528a service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:06.837591 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1225/2455] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:08:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:08:07.107116 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5eee18-6955-4f9c-aba9-c435c89f98f2 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:07.108789 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-ce5eee18-6955-4f9c-aba9-c435c89f98f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:07.122680 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5eee18-6955-4f9c-aba9-c435c89f98f2 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:07.127364 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1506f-1611-4e58-9869-9888ef8b7d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:07.128222 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1506f-1611-4e58-9869-9888ef8b7d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:07.128506 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1506f-1611-4e58-9869-9888ef8b7d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:07.128781 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1506f-1611-4e58-9869-9888ef8b7d49 admin admin] PATH_INFO: `/v3/projects/0e8070a44dcf4cdf923038111ae03191` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:07.130005 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb1506f-1611-4e58-9869-9888ef8b7d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e8070a44dcf4cdf923038111ae03191)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:07.131918 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb1506f-1611-4e58-9869-9888ef8b7d49 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:07.182497 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-2cb1506f-1611-4e58-9869-9888ef8b7d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e8070a44dcf4cdf923038111ae03191', 'request_id': 'req-2cb1506f-1611-4e58-9869-9888ef8b7d49'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:07.188435 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-2cb1506f-1611-4e58-9869-9888ef8b7d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e8070a44dcf4cdf923038111ae03191', 'request_id': 'req-2cb1506f-1611-4e58-9869-9888ef8b7d49'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:07.195095 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-2cb1506f-1611-4e58-9869-9888ef8b7d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e8070a44dcf4cdf923038111ae03191', 'request_id': 'req-2cb1506f-1611-4e58-9869-9888ef8b7d49'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:07.211457 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-2cb1506f-1611-4e58-9869-9888ef8b7d49 admin admin] The token cache is being invalidate because project 0e8070a44dcf4cdf923038111ae03191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:08:07.211753 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-2cb1506f-1611-4e58-9869-9888ef8b7d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:07.212405 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-2cb1506f-1611-4e58-9869-9888ef8b7d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:07.213991 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1231/2456] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:08:07 2021] DELETE /identity/v3/projects/0e8070a44dcf4cdf923038111ae03191 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:08:07.219890 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef61f66-78b5-4c24-a9be-81da97adfbb6 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:07.220182 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef61f66-78b5-4c24-a9be-81da97adfbb6 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:07.220465 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef61f66-78b5-4c24-a9be-81da97adfbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:07.239445 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-6ef61f66-78b5-4c24-a9be-81da97adfbb6 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:08:07.240641 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-6ef61f66-78b5-4c24-a9be-81da97adfbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:07.295923 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1226/2457] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:08:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:08:07.304733 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d1970-e4e9-42be-9c2a-3b1b48cfda46 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:07.305025 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d1970-e4e9-42be-9c2a-3b1b48cfda46 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:07.305310 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d1970-e4e9-42be-9c2a-3b1b48cfda46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:07.324603 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-697d1970-e4e9-42be-9c2a-3b1b48cfda46 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:08:07.325885 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-697d1970-e4e9-42be-9c2a-3b1b48cfda46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:07.334285 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1232/2458] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:08:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:08:07.338251 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef61f66-78b5-4c24-a9be-81da97adfbb6 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:07.347524 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef61f66-78b5-4c24-a9be-81da97adfbb6 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:07.352032 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe4f9c-0045-40ff-b5cb-57d49aff5735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:07.352669 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe4f9c-0045-40ff-b5cb-57d49aff5735 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:07.352947 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe4f9c-0045-40ff-b5cb-57d49aff5735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:07.353220 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe4f9c-0045-40ff-b5cb-57d49aff5735 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:07.353994 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe4f9c-0045-40ff-b5cb-57d49aff5735 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 02:08:07.354321 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe4f9c-0045-40ff-b5cb-57d49aff5735 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:07.355911 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe4f9c-0045-40ff-b5cb-57d49aff5735 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:07.366795 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1227/2459] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 02:08:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 02:08:07.370825 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d1970-e4e9-42be-9c2a-3b1b48cfda46 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:07.380161 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d1970-e4e9-42be-9c2a-3b1b48cfda46 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:07.384740 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799dc56-4c3a-47e3-8b1f-6b57b7a9ec7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:07.385373 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799dc56-4c3a-47e3-8b1f-6b57b7a9ec7f admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:07.385689 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799dc56-4c3a-47e3-8b1f-6b57b7a9ec7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:07.385972 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799dc56-4c3a-47e3-8b1f-6b57b7a9ec7f admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:07.386677 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799dc56-4c3a-47e3-8b1f-6b57b7a9ec7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:07.388544 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799dc56-4c3a-47e3-8b1f-6b57b7a9ec7f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:07.413224 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1233/2460] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:08:07 2021] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:08:07.417751 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe4f9c-0045-40ff-b5cb-57d49aff5735 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:07.428115 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe4f9c-0045-40ff-b5cb-57d49aff5735 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:07.482427 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c13e6d-5bb5-4b12-a643-0b6c7d1f3b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:07.483092 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c13e6d-5bb5-4b12-a643-0b6c7d1f3b57 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:07.483371 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c13e6d-5bb5-4b12-a643-0b6c7d1f3b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:07.483645 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c13e6d-5bb5-4b12-a643-0b6c7d1f3b57 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:07.484374 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c13e6d-5bb5-4b12-a643-0b6c7d1f3b57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:07.486375 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c13e6d-5bb5-4b12-a643-0b6c7d1f3b57 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:07.506171 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1228/2461] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:08:07 2021] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:08:07.510268 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799dc56-4c3a-47e3-8b1f-6b57b7a9ec7f admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:07.520857 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799dc56-4c3a-47e3-8b1f-6b57b7a9ec7f admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:07.525462 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b149b5d-f253-46cf-a7b6-be126209d622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:07.526126 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b149b5d-f253-46cf-a7b6-be126209d622 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:07.526410 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b149b5d-f253-46cf-a7b6-be126209d622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:07.526684 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b149b5d-f253-46cf-a7b6-be126209d622 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:07.527443 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b149b5d-f253-46cf-a7b6-be126209d622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:07.529012 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b149b5d-f253-46cf-a7b6-be126209d622 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:07.539789 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1234/2462] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:08:07 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:08:07.543838 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c13e6d-5bb5-4b12-a643-0b6c7d1f3b57 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:07.555195 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c13e6d-5bb5-4b12-a643-0b6c7d1f3b57 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:07.560082 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da78431-c5c9-41c6-918c-b999e6b9bc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:07.560742 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da78431-c5c9-41c6-918c-b999e6b9bc19 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:07.561031 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da78431-c5c9-41c6-918c-b999e6b9bc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:07.561347 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da78431-c5c9-41c6-918c-b999e6b9bc19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:07.562895 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da78431-c5c9-41c6-918c-b999e6b9bc19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:07.564647 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da78431-c5c9-41c6-918c-b999e6b9bc19 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:07.574721 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1229/2463] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:08:07 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:08:07.578819 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b149b5d-f253-46cf-a7b6-be126209d622 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:07.588661 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b149b5d-f253-46cf-a7b6-be126209d622 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:07.593286 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481c831-6080-45df-842d-ff696fd5faef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:07.594193 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481c831-6080-45df-842d-ff696fd5faef admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:07.594479 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481c831-6080-45df-842d-ff696fd5faef admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:07.594762 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481c831-6080-45df-842d-ff696fd5faef admin admin] PATH_INFO: `/v3/projects/d803ce26681e47af830031a924cc922d/users/29791af6448e48578867267aaccf87e7/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:07.609059 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481c831-6080-45df-842d-ff696fd5faef admin admin] RBAC: Authorizing `identity:create_grant(project_id=d803ce26681e47af830031a924cc922d, user_id=29791af6448e48578867267aaccf87e7, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:07.612227 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481c831-6080-45df-842d-ff696fd5faef admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:07.626137 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1235/2464] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:08:07 2021] PUT /identity/v3/projects/d803ce26681e47af830031a924cc922d/users/29791af6448e48578867267aaccf87e7/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:08:07.636623 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467aeaca-3ab1-4bf0-be6c-49b6628abd34 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:07.644616 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467aeaca-3ab1-4bf0-be6c-49b6628abd34 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:07.644616 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467aeaca-3ab1-4bf0-be6c-49b6628abd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:07.663473 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-467aeaca-3ab1-4bf0-be6c-49b6628abd34 None None] MFA Rules not processed for user `29791af6448e48578867267aaccf87e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:08:07.664681 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-467aeaca-3ab1-4bf0-be6c-49b6628abd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:07.727291 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1230/2465] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:08:07 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:08:07.731659 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481c831-6080-45df-842d-ff696fd5faef admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:07.790752 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481c831-6080-45df-842d-ff696fd5faef admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:07.795353 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a12d7e-5895-40d7-bfb1-bb4e83ca15c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:07.795995 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a12d7e-5895-40d7-bfb1-bb4e83ca15c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:07.796279 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a12d7e-5895-40d7-bfb1-bb4e83ca15c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:07.796556 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a12d7e-5895-40d7-bfb1-bb4e83ca15c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:07.797773 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a12d7e-5895-40d7-bfb1-bb4e83ca15c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:07.799636 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a12d7e-5895-40d7-bfb1-bb4e83ca15c4 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:07.823874 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1236/2466] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:08:07 2021] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:08:07.827791 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467aeaca-3ab1-4bf0-be6c-49b6628abd34 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:07.838842 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467aeaca-3ab1-4bf0-be6c-49b6628abd34 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:07.892837 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248376a-099b-45db-8553-6871f99bf478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:07.893528 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248376a-099b-45db-8553-6871f99bf478 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:07.893825 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248376a-099b-45db-8553-6871f99bf478 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:07.894107 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248376a-099b-45db-8553-6871f99bf478 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:07.894845 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248376a-099b-45db-8553-6871f99bf478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:07.896748 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248376a-099b-45db-8553-6871f99bf478 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:07.915628 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1231/2467] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:08:07 2021] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:08:07.919453 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a12d7e-5895-40d7-bfb1-bb4e83ca15c4 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:07.930228 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a12d7e-5895-40d7-bfb1-bb4e83ca15c4 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:07.935280 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdae35c-a3ed-4c09-9834-30b8f48e3cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:07.935942 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdae35c-a3ed-4c09-9834-30b8f48e3cec admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:07.936380 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdae35c-a3ed-4c09-9834-30b8f48e3cec admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:07.936488 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdae35c-a3ed-4c09-9834-30b8f48e3cec admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:07.937256 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdae35c-a3ed-4c09-9834-30b8f48e3cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:07.939387 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdae35c-a3ed-4c09-9834-30b8f48e3cec admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:07.949966 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1237/2468] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:08:07 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:08:07.956839 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248376a-099b-45db-8553-6871f99bf478 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:07.968361 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248376a-099b-45db-8553-6871f99bf478 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:07.973678 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dc3cc-f865-49ac-99aa-9f91b8a252be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:07.974338 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dc3cc-f865-49ac-99aa-9f91b8a252be admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:07.974622 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dc3cc-f865-49ac-99aa-9f91b8a252be admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:07.975031 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dc3cc-f865-49ac-99aa-9f91b8a252be admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:07.975779 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44dc3cc-f865-49ac-99aa-9f91b8a252be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:07.977352 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44dc3cc-f865-49ac-99aa-9f91b8a252be admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:07.988576 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1232/2469] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:08:07 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:08:07.994234 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdae35c-a3ed-4c09-9834-30b8f48e3cec admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:08.004897 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdae35c-a3ed-4c09-9834-30b8f48e3cec admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:08.009808 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0d42f-3981-4763-9c9a-50c147d88c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:08.010785 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0d42f-3981-4763-9c9a-50c147d88c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:08.011144 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0d42f-3981-4763-9c9a-50c147d88c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:08.011433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0d42f-3981-4763-9c9a-50c147d88c96 admin admin] PATH_INFO: `/v3/projects/2c32b4949cfd467c912c9824d457aaff/users/ee93cbb3734d4a36abd7daa4ccd6a568/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:08.026182 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0d42f-3981-4763-9c9a-50c147d88c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c32b4949cfd467c912c9824d457aaff, user_id=ee93cbb3734d4a36abd7daa4ccd6a568, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:08.029146 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0d42f-3981-4763-9c9a-50c147d88c96 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:08.043145 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1238/2470] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:08:07 2021] PUT /identity/v3/projects/2c32b4949cfd467c912c9824d457aaff/users/ee93cbb3734d4a36abd7daa4ccd6a568/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:08:08.054071 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b461e7-3fbf-47f9-9e5b-a51efce0ff9e None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:08.054393 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b461e7-3fbf-47f9-9e5b-a51efce0ff9e None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:08.054742 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b461e7-3fbf-47f9-9e5b-a51efce0ff9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:08.080370 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-48b461e7-3fbf-47f9-9e5b-a51efce0ff9e None None] MFA Rules not processed for user `ee93cbb3734d4a36abd7daa4ccd6a568`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:08:08.081506 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-48b461e7-3fbf-47f9-9e5b-a51efce0ff9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:08.142793 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1233/2471] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:08:08 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:08:08.147393 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0d42f-3981-4763-9c9a-50c147d88c96 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:08.209102 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0d42f-3981-4763-9c9a-50c147d88c96 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:08.214376 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad7998-a04c-4f20-8a4b-191e36a36da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:08.215018 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad7998-a04c-4f20-8a4b-191e36a36da3 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:08.215318 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad7998-a04c-4f20-8a4b-191e36a36da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:08.215721 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad7998-a04c-4f20-8a4b-191e36a36da3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:08.216452 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad7998-a04c-4f20-8a4b-191e36a36da3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:08.218380 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad7998-a04c-4f20-8a4b-191e36a36da3 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:08.243662 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1239/2472] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:08:08 2021] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:08:08.247712 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b461e7-3fbf-47f9-9e5b-a51efce0ff9e None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:08.258159 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b461e7-3fbf-47f9-9e5b-a51efce0ff9e None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:08.311126 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37c65c-1c53-47c3-915e-bd2d2d24fc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:08.311779 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37c65c-1c53-47c3-915e-bd2d2d24fc6a admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:08.312066 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37c65c-1c53-47c3-915e-bd2d2d24fc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:08.312415 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37c65c-1c53-47c3-915e-bd2d2d24fc6a admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:08.313107 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37c65c-1c53-47c3-915e-bd2d2d24fc6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:08.315067 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37c65c-1c53-47c3-915e-bd2d2d24fc6a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:08.334641 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1234/2473] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:08:08 2021] POST /identity/v3/users => generated 298 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:08:08.338492 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad7998-a04c-4f20-8a4b-191e36a36da3 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:08.349197 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad7998-a04c-4f20-8a4b-191e36a36da3 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:08.353818 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973186eb-29d2-4ba7-b12a-f9bab3e6a3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:08.354466 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973186eb-29d2-4ba7-b12a-f9bab3e6a3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:08.354754 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973186eb-29d2-4ba7-b12a-f9bab3e6a3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:08.355036 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973186eb-29d2-4ba7-b12a-f9bab3e6a3f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:08.355792 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973186eb-29d2-4ba7-b12a-f9bab3e6a3f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:08.357341 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973186eb-29d2-4ba7-b12a-f9bab3e6a3f4 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:08.367548 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1240/2474] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:08:08 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:08:08.371528 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37c65c-1c53-47c3-915e-bd2d2d24fc6a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:08.381249 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37c65c-1c53-47c3-915e-bd2d2d24fc6a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:08.385890 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83180c71-15bd-483a-a14f-c828afe61228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:08.386760 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83180c71-15bd-483a-a14f-c828afe61228 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:08.387045 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83180c71-15bd-483a-a14f-c828afe61228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:08.387327 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83180c71-15bd-483a-a14f-c828afe61228 admin admin] PATH_INFO: `/v3/projects/a881821d3a29478fbc61ebde15b3a988/users/eb97ac01eaa94d22aea5ae20bda91288/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:08.401838 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83180c71-15bd-483a-a14f-c828afe61228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a881821d3a29478fbc61ebde15b3a988, user_id=eb97ac01eaa94d22aea5ae20bda91288, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:08.404462 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83180c71-15bd-483a-a14f-c828afe61228 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:08.418420 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1235/2475] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:08:08 2021] PUT /identity/v3/projects/a881821d3a29478fbc61ebde15b3a988/users/eb97ac01eaa94d22aea5ae20bda91288/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:08:08.422238 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973186eb-29d2-4ba7-b12a-f9bab3e6a3f4 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:08.432379 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973186eb-29d2-4ba7-b12a-f9bab3e6a3f4 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:08.485901 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ce1a4-8d62-4f25-a934-f7d867b91e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:08.486551 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ce1a4-8d62-4f25-a934-f7d867b91e4a admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:08.486837 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ce1a4-8d62-4f25-a934-f7d867b91e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:08.487114 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ce1a4-8d62-4f25-a934-f7d867b91e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:08.487839 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ce1a4-8d62-4f25-a934-f7d867b91e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:08.489396 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ce1a4-8d62-4f25-a934-f7d867b91e4a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:08.498735 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1241/2476] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:08:08 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:08:08.502688 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83180c71-15bd-483a-a14f-c828afe61228 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:08.512738 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83180c71-15bd-483a-a14f-c828afe61228 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:08.518011 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798bfa9-6007-4959-be64-96452c53fc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:08.518882 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798bfa9-6007-4959-be64-96452c53fc72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:08.519170 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798bfa9-6007-4959-be64-96452c53fc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:08.519450 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798bfa9-6007-4959-be64-96452c53fc72 admin admin] PATH_INFO: `/v3/projects/a881821d3a29478fbc61ebde15b3a988/users/eb97ac01eaa94d22aea5ae20bda91288/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:08.521439 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798bfa9-6007-4959-be64-96452c53fc72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a881821d3a29478fbc61ebde15b3a988, user_id=eb97ac01eaa94d22aea5ae20bda91288, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:08.524078 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798bfa9-6007-4959-be64-96452c53fc72 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:08.534614 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1236/2477] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:08:08 2021] PUT /identity/v3/projects/a881821d3a29478fbc61ebde15b3a988/users/eb97ac01eaa94d22aea5ae20bda91288/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:08:08.587054 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfce9cf-d104-41e9-b6b7-2222d00af637 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:08.587263 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfce9cf-d104-41e9-b6b7-2222d00af637 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:08.587531 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfce9cf-d104-41e9-b6b7-2222d00af637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:08.614647 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-ebfce9cf-d104-41e9-b6b7-2222d00af637 None None] MFA Rules not processed for user `eb97ac01eaa94d22aea5ae20bda91288`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:08:08.615849 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-ebfce9cf-d104-41e9-b6b7-2222d00af637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:08.681894 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1242/2478] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:08:08 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:08:08.692800 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798bfa9-6007-4959-be64-96452c53fc72 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:08.694590 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3798bfa9-6007-4959-be64-96452c53fc72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:08.749420 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798bfa9-6007-4959-be64-96452c53fc72 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:08.753653 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a809d-8871-4bc1-a2cd-cbf3862c4c7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:08.754289 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a809d-8871-4bc1-a2cd-cbf3862c4c7a service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:08.754576 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a809d-8871-4bc1-a2cd-cbf3862c4c7a service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:08.754857 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a809d-8871-4bc1-a2cd-cbf3862c4c7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:08.807818 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a809d-8871-4bc1-a2cd-cbf3862c4c7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:08.809231 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a809d-8871-4bc1-a2cd-cbf3862c4c7a service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:08.818293 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1237/2479] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:08:08 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:08:10.161509 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfce9cf-d104-41e9-b6b7-2222d00af637 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:10.163122 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-ebfce9cf-d104-41e9-b6b7-2222d00af637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:10.227592 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfce9cf-d104-41e9-b6b7-2222d00af637 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:10.232428 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b960a6-bf73-4b6d-a7a0-779966c25430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:10.233507 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b960a6-bf73-4b6d-a7a0-779966c25430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:10.233861 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b960a6-bf73-4b6d-a7a0-779966c25430 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:10.234210 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b960a6-bf73-4b6d-a7a0-779966c25430 admin admin] PATH_INFO: `/v3/users/36b217a0bdc24e46a40b55bf1447e12a` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:10.235842 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b960a6-bf73-4b6d-a7a0-779966c25430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36b217a0bdc24e46a40b55bf1447e12a)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:10.237789 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b960a6-bf73-4b6d-a7a0-779966c25430 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:10.284552 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-75b960a6-bf73-4b6d-a7a0-779966c25430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36b217a0bdc24e46a40b55bf1447e12a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:10.285277 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a809d-8871-4bc1-a2cd-cbf3862c4c7a service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:10.286719 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-9c8a809d-8871-4bc1-a2cd-cbf3862c4c7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:10.292481 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-75b960a6-bf73-4b6d-a7a0-779966c25430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36b217a0bdc24e46a40b55bf1447e12a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:10.298536 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a809d-8871-4bc1-a2cd-cbf3862c4c7a service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:10.299479 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-75b960a6-bf73-4b6d-a7a0-779966c25430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36b217a0bdc24e46a40b55bf1447e12a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:10.300384 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-75b960a6-bf73-4b6d-a7a0-779966c25430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36b217a0bdc24e46a40b55bf1447e12a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:10.302682 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef49ec8-42a5-4d35-a00a-75857560554b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:10.303317 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef49ec8-42a5-4d35-a00a-75857560554b service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:10.303606 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef49ec8-42a5-4d35-a00a-75857560554b service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:10.303911 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef49ec8-42a5-4d35-a00a-75857560554b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:10.305787 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-6ef49ec8-42a5-4d35-a00a-75857560554b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:10.311910 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-75b960a6-bf73-4b6d-a7a0-779966c25430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36b217a0bdc24e46a40b55bf1447e12a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:10.318419 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1243/2480] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:08:10 2021] DELETE /identity/v3/users/36b217a0bdc24e46a40b55bf1447e12a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:08:10.322750 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd381ed-0427-4675-a0dc-991570f61a02 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:10.323038 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd381ed-0427-4675-a0dc-991570f61a02 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:10.323315 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd381ed-0427-4675-a0dc-991570f61a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:10.341046 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-4dd381ed-0427-4675-a0dc-991570f61a02 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:08:10.342392 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-4dd381ed-0427-4675-a0dc-991570f61a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:10.368030 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef49ec8-42a5-4d35-a00a-75857560554b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:10.369449 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef49ec8-42a5-4d35-a00a-75857560554b service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:10.378928 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1238/2481] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:08:10 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 02:08:10.400355 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1244/2482] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:08:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:08:10.410219 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef49ec8-42a5-4d35-a00a-75857560554b service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:10.411663 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-6ef49ec8-42a5-4d35-a00a-75857560554b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:10.491876 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef49ec8-42a5-4d35-a00a-75857560554b service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:10.542007 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f49ee-282f-44a4-a21f-69c7629a0c17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:10.542661 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f49ee-282f-44a4-a21f-69c7629a0c17 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:10.542953 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f49ee-282f-44a4-a21f-69c7629a0c17 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:10.543226 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f49ee-282f-44a4-a21f-69c7629a0c17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:10.553401 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f49ee-282f-44a4-a21f-69c7629a0c17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:10.554962 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f49ee-282f-44a4-a21f-69c7629a0c17 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:10.570412 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1239/2483] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:08:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:08:10.860821 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd381ed-0427-4675-a0dc-991570f61a02 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:10.862467 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-4dd381ed-0427-4675-a0dc-991570f61a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:10.881952 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd381ed-0427-4675-a0dc-991570f61a02 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:10.888222 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3a823-2b41-45e5-ab73-33deb38f6f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:10.889391 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3a823-2b41-45e5-ab73-33deb38f6f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:10.889647 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3a823-2b41-45e5-ab73-33deb38f6f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:10.890000 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3a823-2b41-45e5-ab73-33deb38f6f8a admin admin] PATH_INFO: `/v3/projects/aa15c937c4064351839ba9baa6fd8347` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:10.891508 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3a823-2b41-45e5-ab73-33deb38f6f8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa15c937c4064351839ba9baa6fd8347)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:10.894413 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3a823-2b41-45e5-ab73-33deb38f6f8a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:10.930836 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f49ee-282f-44a4-a21f-69c7629a0c17 service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:10.932298 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-9d1f49ee-282f-44a4-a21f-69c7629a0c17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:10.943809 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-2bb3a823-2b41-45e5-ab73-33deb38f6f8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa15c937c4064351839ba9baa6fd8347', 'request_id': 'req-2bb3a823-2b41-45e5-ab73-33deb38f6f8a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:10.949155 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-2bb3a823-2b41-45e5-ab73-33deb38f6f8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa15c937c4064351839ba9baa6fd8347', 'request_id': 'req-2bb3a823-2b41-45e5-ab73-33deb38f6f8a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:10.958305 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-2bb3a823-2b41-45e5-ab73-33deb38f6f8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa15c937c4064351839ba9baa6fd8347', 'request_id': 'req-2bb3a823-2b41-45e5-ab73-33deb38f6f8a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:10.970800 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-2bb3a823-2b41-45e5-ab73-33deb38f6f8a admin admin] The token cache is being invalidate because project aa15c937c4064351839ba9baa6fd8347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:08:10.971095 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-2bb3a823-2b41-45e5-ab73-33deb38f6f8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:10.971766 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-2bb3a823-2b41-45e5-ab73-33deb38f6f8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:10.973330 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1245/2484] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:08:10 2021] DELETE /identity/v3/projects/aa15c937c4064351839ba9baa6fd8347 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:08:10.994370 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f49ee-282f-44a4-a21f-69c7629a0c17 service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:11.048441 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8ea44-481c-4170-b7c3-814e9422e9f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:11.049104 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8ea44-481c-4170-b7c3-814e9422e9f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:11.049387 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8ea44-481c-4170-b7c3-814e9422e9f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:11.049942 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8ea44-481c-4170-b7c3-814e9422e9f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:11.051882 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-deb8ea44-481c-4170-b7c3-814e9422e9f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:11.120918 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8ea44-481c-4170-b7c3-814e9422e9f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:11.122400 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8ea44-481c-4170-b7c3-814e9422e9f3 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:11.133290 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1240/2485] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:08:10 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 02:08:14.923227 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3a823-2b41-45e5-ab73-33deb38f6f8a admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:14.925525 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-2bb3a823-2b41-45e5-ab73-33deb38f6f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:14.990228 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3a823-2b41-45e5-ab73-33deb38f6f8a admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:14.995346 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48169314-d5ea-4585-b1b9-b28e9a74ffb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:14.996415 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48169314-d5ea-4585-b1b9-b28e9a74ffb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:14.996702 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48169314-d5ea-4585-b1b9-b28e9a74ffb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:14.996984 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48169314-d5ea-4585-b1b9-b28e9a74ffb2 admin admin] PATH_INFO: `/v3/users/29791af6448e48578867267aaccf87e7` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:14.998224 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48169314-d5ea-4585-b1b9-b28e9a74ffb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29791af6448e48578867267aaccf87e7)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:15.000127 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48169314-d5ea-4585-b1b9-b28e9a74ffb2 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:15.044022 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-48169314-d5ea-4585-b1b9-b28e9a74ffb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29791af6448e48578867267aaccf87e7'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:15.051430 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-48169314-d5ea-4585-b1b9-b28e9a74ffb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29791af6448e48578867267aaccf87e7'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:15.058044 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-48169314-d5ea-4585-b1b9-b28e9a74ffb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29791af6448e48578867267aaccf87e7'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:15.058712 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-48169314-d5ea-4585-b1b9-b28e9a74ffb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29791af6448e48578867267aaccf87e7'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:15.070422 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-48169314-d5ea-4585-b1b9-b28e9a74ffb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29791af6448e48578867267aaccf87e7'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:15.076038 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1246/2486] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:08:14 2021] DELETE /identity/v3/users/29791af6448e48578867267aaccf87e7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:08:15.080787 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5409a-4a39-47be-bf65-282a2735742a None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:15.081257 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5409a-4a39-47be-bf65-282a2735742a None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:15.081361 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5409a-4a39-47be-bf65-282a2735742a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:15.098122 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-c3b5409a-4a39-47be-bf65-282a2735742a None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:08:15.099302 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-c3b5409a-4a39-47be-bf65-282a2735742a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:15.154353 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1241/2487] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:08:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:08:15.164292 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48169314-d5ea-4585-b1b9-b28e9a74ffb2 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:15.165725 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-48169314-d5ea-4585-b1b9-b28e9a74ffb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:15.220369 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48169314-d5ea-4585-b1b9-b28e9a74ffb2 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:15.224069 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e4d31-0464-496f-9692-90694954e5ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:15.224707 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e4d31-0464-496f-9692-90694954e5ff service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:15.224994 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e4d31-0464-496f-9692-90694954e5ff service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:15.225270 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e4d31-0464-496f-9692-90694954e5ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:15.234075 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e4d31-0464-496f-9692-90694954e5ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:15.235488 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e4d31-0464-496f-9692-90694954e5ff service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:15.245172 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1247/2488] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:08:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:08:15.496683 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5409a-4a39-47be-bf65-282a2735742a None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:15.498552 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-c3b5409a-4a39-47be-bf65-282a2735742a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:15.510347 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5409a-4a39-47be-bf65-282a2735742a None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:15.515465 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e8d32-a5fb-4687-97bf-9c4599399ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:15.516422 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e8d32-a5fb-4687-97bf-9c4599399ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:15.516699 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e8d32-a5fb-4687-97bf-9c4599399ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:15.517105 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e8d32-a5fb-4687-97bf-9c4599399ce4 admin admin] PATH_INFO: `/v3/projects/d803ce26681e47af830031a924cc922d` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:15.518385 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e8d32-a5fb-4687-97bf-9c4599399ce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d803ce26681e47af830031a924cc922d)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:15.520263 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e8d32-a5fb-4687-97bf-9c4599399ce4 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:15.565673 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-594e8d32-a5fb-4687-97bf-9c4599399ce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd803ce26681e47af830031a924cc922d', 'request_id': 'req-594e8d32-a5fb-4687-97bf-9c4599399ce4'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:15.570947 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-594e8d32-a5fb-4687-97bf-9c4599399ce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd803ce26681e47af830031a924cc922d', 'request_id': 'req-594e8d32-a5fb-4687-97bf-9c4599399ce4'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:15.577609 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-594e8d32-a5fb-4687-97bf-9c4599399ce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd803ce26681e47af830031a924cc922d', 'request_id': 'req-594e8d32-a5fb-4687-97bf-9c4599399ce4'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:15.588275 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-594e8d32-a5fb-4687-97bf-9c4599399ce4 admin admin] The token cache is being invalidate because project d803ce26681e47af830031a924cc922d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:08:15.588567 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-594e8d32-a5fb-4687-97bf-9c4599399ce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:15.589197 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-594e8d32-a5fb-4687-97bf-9c4599399ce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:15.590735 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1242/2489] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:08:15 2021] DELETE /identity/v3/projects/d803ce26681e47af830031a924cc922d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:08:15.594641 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e4d31-0464-496f-9692-90694954e5ff service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:15.604488 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e4d31-0464-496f-9692-90694954e5ff service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:15.657699 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a7feb-aeb8-467c-97e1-a10d1c650869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:15.659071 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a7feb-aeb8-467c-97e1-a10d1c650869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:15.659348 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a7feb-aeb8-467c-97e1-a10d1c650869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:15.659620 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a7feb-aeb8-467c-97e1-a10d1c650869 admin admin] PATH_INFO: `/v3/users/ee93cbb3734d4a36abd7daa4ccd6a568` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:15.660799 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a7feb-aeb8-467c-97e1-a10d1c650869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee93cbb3734d4a36abd7daa4ccd6a568)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:15.662725 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a7feb-aeb8-467c-97e1-a10d1c650869 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:15.706014 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-249a7feb-aeb8-467c-97e1-a10d1c650869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee93cbb3734d4a36abd7daa4ccd6a568'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:15.712619 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-249a7feb-aeb8-467c-97e1-a10d1c650869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee93cbb3734d4a36abd7daa4ccd6a568'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:15.719173 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-249a7feb-aeb8-467c-97e1-a10d1c650869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee93cbb3734d4a36abd7daa4ccd6a568'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:15.719823 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-249a7feb-aeb8-467c-97e1-a10d1c650869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee93cbb3734d4a36abd7daa4ccd6a568'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:15.731681 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-249a7feb-aeb8-467c-97e1-a10d1c650869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee93cbb3734d4a36abd7daa4ccd6a568'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:15.737868 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1248/2490] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:08:15 2021] DELETE /identity/v3/users/ee93cbb3734d4a36abd7daa4ccd6a568 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:08:16.001262 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e8d32-a5fb-4687-97bf-9c4599399ce4 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:16.003049 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-594e8d32-a5fb-4687-97bf-9c4599399ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:16.032447 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e8d32-a5fb-4687-97bf-9c4599399ce4 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:16.089594 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a9b49-2eea-49aa-85c6-2b5fca11f0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:16.090458 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a9b49-2eea-49aa-85c6-2b5fca11f0fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:16.090745 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a9b49-2eea-49aa-85c6-2b5fca11f0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:16.091023 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a9b49-2eea-49aa-85c6-2b5fca11f0fb admin admin] PATH_INFO: `/v3/projects/2c32b4949cfd467c912c9824d457aaff` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:16.092214 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a9b49-2eea-49aa-85c6-2b5fca11f0fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c32b4949cfd467c912c9824d457aaff)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:16.094153 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a9b49-2eea-49aa-85c6-2b5fca11f0fb admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:16.143599 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-6b5a9b49-2eea-49aa-85c6-2b5fca11f0fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c32b4949cfd467c912c9824d457aaff', 'request_id': 'req-6b5a9b49-2eea-49aa-85c6-2b5fca11f0fb'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:16.149273 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-6b5a9b49-2eea-49aa-85c6-2b5fca11f0fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c32b4949cfd467c912c9824d457aaff', 'request_id': 'req-6b5a9b49-2eea-49aa-85c6-2b5fca11f0fb'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:16.156356 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-6b5a9b49-2eea-49aa-85c6-2b5fca11f0fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c32b4949cfd467c912c9824d457aaff', 'request_id': 'req-6b5a9b49-2eea-49aa-85c6-2b5fca11f0fb'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:16.166868 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-6b5a9b49-2eea-49aa-85c6-2b5fca11f0fb admin admin] The token cache is being invalidate because project 2c32b4949cfd467c912c9824d457aaff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:08:16.167154 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-6b5a9b49-2eea-49aa-85c6-2b5fca11f0fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:16.167762 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-6b5a9b49-2eea-49aa-85c6-2b5fca11f0fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:16.169274 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1243/2491] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:08:16 2021] DELETE /identity/v3/projects/2c32b4949cfd467c912c9824d457aaff => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:08:16.173211 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a7feb-aeb8-467c-97e1-a10d1c650869 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:16.174630 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-249a7feb-aeb8-467c-97e1-a10d1c650869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:16.187133 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a7feb-aeb8-467c-97e1-a10d1c650869 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:16.240462 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163c89f-3d91-4f86-8adf-31a5ff0a3a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:16.241252 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163c89f-3d91-4f86-8adf-31a5ff0a3a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:16.241560 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163c89f-3d91-4f86-8adf-31a5ff0a3a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:16.241838 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163c89f-3d91-4f86-8adf-31a5ff0a3a18 admin admin] PATH_INFO: `/v3/users/eb97ac01eaa94d22aea5ae20bda91288` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:16.243010 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163c89f-3d91-4f86-8adf-31a5ff0a3a18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb97ac01eaa94d22aea5ae20bda91288)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:16.244890 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163c89f-3d91-4f86-8adf-31a5ff0a3a18 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:16.287431 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-d163c89f-3d91-4f86-8adf-31a5ff0a3a18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb97ac01eaa94d22aea5ae20bda91288'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:16.293878 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-d163c89f-3d91-4f86-8adf-31a5ff0a3a18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb97ac01eaa94d22aea5ae20bda91288'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:16.300945 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-d163c89f-3d91-4f86-8adf-31a5ff0a3a18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb97ac01eaa94d22aea5ae20bda91288'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:16.301644 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-d163c89f-3d91-4f86-8adf-31a5ff0a3a18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb97ac01eaa94d22aea5ae20bda91288'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:16.312924 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-d163c89f-3d91-4f86-8adf-31a5ff0a3a18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb97ac01eaa94d22aea5ae20bda91288'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:16.319125 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1249/2492] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:08:16 2021] DELETE /identity/v3/users/eb97ac01eaa94d22aea5ae20bda91288 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:08:16.577969 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a9b49-2eea-49aa-85c6-2b5fca11f0fb admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:16.580176 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-6b5a9b49-2eea-49aa-85c6-2b5fca11f0fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:16.593878 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a9b49-2eea-49aa-85c6-2b5fca11f0fb admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:16.649853 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97412598-1d27-4c5c-9e52-e568fa58d9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:16.650721 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97412598-1d27-4c5c-9e52-e568fa58d9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:16.651005 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97412598-1d27-4c5c-9e52-e568fa58d9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:16.651284 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97412598-1d27-4c5c-9e52-e568fa58d9d0 admin admin] PATH_INFO: `/v3/projects/a881821d3a29478fbc61ebde15b3a988` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:16.652715 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97412598-1d27-4c5c-9e52-e568fa58d9d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a881821d3a29478fbc61ebde15b3a988)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:16.654695 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97412598-1d27-4c5c-9e52-e568fa58d9d0 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:16.701609 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-97412598-1d27-4c5c-9e52-e568fa58d9d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a881821d3a29478fbc61ebde15b3a988', 'request_id': 'req-97412598-1d27-4c5c-9e52-e568fa58d9d0'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:16.706937 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-97412598-1d27-4c5c-9e52-e568fa58d9d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a881821d3a29478fbc61ebde15b3a988', 'request_id': 'req-97412598-1d27-4c5c-9e52-e568fa58d9d0'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:16.713667 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-97412598-1d27-4c5c-9e52-e568fa58d9d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a881821d3a29478fbc61ebde15b3a988', 'request_id': 'req-97412598-1d27-4c5c-9e52-e568fa58d9d0'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:16.724092 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-97412598-1d27-4c5c-9e52-e568fa58d9d0 admin admin] The token cache is being invalidate because project a881821d3a29478fbc61ebde15b3a988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:08:16.724383 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-97412598-1d27-4c5c-9e52-e568fa58d9d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:16.725019 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-97412598-1d27-4c5c-9e52-e568fa58d9d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:16.726596 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1244/2493] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:08:16 2021] DELETE /identity/v3/projects/a881821d3a29478fbc61ebde15b3a988 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:08:16.732203 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332fde0-367c-4f17-a405-0d2924df7a57 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:16.732523 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332fde0-367c-4f17-a405-0d2924df7a57 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:16.732804 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332fde0-367c-4f17-a405-0d2924df7a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:16.751140 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-e332fde0-367c-4f17-a405-0d2924df7a57 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:08:16.752932 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-e332fde0-367c-4f17-a405-0d2924df7a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:16.807177 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1250/2494] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:08:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:08:16.815719 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfc2e2-7ac6-49ac-ade7-8cd35a29531d None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:16.816010 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfc2e2-7ac6-49ac-ade7-8cd35a29531d None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:16.816292 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfc2e2-7ac6-49ac-ade7-8cd35a29531d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:16.834662 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-65dfc2e2-7ac6-49ac-ade7-8cd35a29531d None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:08:16.835861 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-65dfc2e2-7ac6-49ac-ade7-8cd35a29531d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:16.843746 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1245/2495] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:08:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:08:16.847880 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332fde0-367c-4f17-a405-0d2924df7a57 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:16.857612 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332fde0-367c-4f17-a405-0d2924df7a57 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:16.862906 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab652ef-ba31-4d7e-8a8c-50de29ee9218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:16.863554 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab652ef-ba31-4d7e-8a8c-50de29ee9218 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:16.863837 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab652ef-ba31-4d7e-8a8c-50de29ee9218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:16.864112 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab652ef-ba31-4d7e-8a8c-50de29ee9218 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:16.864892 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab652ef-ba31-4d7e-8a8c-50de29ee9218 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 02:08:16.865199 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab652ef-ba31-4d7e-8a8c-50de29ee9218 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:16.866891 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab652ef-ba31-4d7e-8a8c-50de29ee9218 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:16.878788 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1251/2496] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 02:08:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 02:08:16.882820 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfc2e2-7ac6-49ac-ade7-8cd35a29531d None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:16.891753 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfc2e2-7ac6-49ac-ade7-8cd35a29531d None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:16.896542 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22118ee1-94e1-4630-983f-754776266248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:16.897205 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22118ee1-94e1-4630-983f-754776266248 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:16.897514 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22118ee1-94e1-4630-983f-754776266248 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:16.897801 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22118ee1-94e1-4630-983f-754776266248 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:16.898517 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22118ee1-94e1-4630-983f-754776266248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:16.900389 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22118ee1-94e1-4630-983f-754776266248 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:16.925919 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1246/2497] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:08:16 2021] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:08:16.929855 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab652ef-ba31-4d7e-8a8c-50de29ee9218 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:16.939678 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab652ef-ba31-4d7e-8a8c-50de29ee9218 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:16.997516 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679757d8-ba4f-4253-af2a-ad715d998e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:16.998191 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679757d8-ba4f-4253-af2a-ad715d998e44 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:16.998472 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679757d8-ba4f-4253-af2a-ad715d998e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:16.998748 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679757d8-ba4f-4253-af2a-ad715d998e44 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:16.999461 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679757d8-ba4f-4253-af2a-ad715d998e44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:17.001345 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679757d8-ba4f-4253-af2a-ad715d998e44 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:17.020944 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1252/2498] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:08:16 2021] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:08:17.023648 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22118ee1-94e1-4630-983f-754776266248 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:17.034327 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22118ee1-94e1-4630-983f-754776266248 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:17.039308 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32885cc7-e55a-49e0-8010-2a33fb1fe350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:17.039849 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32885cc7-e55a-49e0-8010-2a33fb1fe350 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:17.040131 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32885cc7-e55a-49e0-8010-2a33fb1fe350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:17.040408 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32885cc7-e55a-49e0-8010-2a33fb1fe350 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:17.041144 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32885cc7-e55a-49e0-8010-2a33fb1fe350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:17.042936 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32885cc7-e55a-49e0-8010-2a33fb1fe350 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:17.054534 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1247/2499] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:08:17 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:08:17.058507 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679757d8-ba4f-4253-af2a-ad715d998e44 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:17.068714 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679757d8-ba4f-4253-af2a-ad715d998e44 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:17.073603 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44b658-a91c-4369-8f97-000620795b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:17.074417 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44b658-a91c-4369-8f97-000620795b14 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:17.074702 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44b658-a91c-4369-8f97-000620795b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:17.074982 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44b658-a91c-4369-8f97-000620795b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:17.075719 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44b658-a91c-4369-8f97-000620795b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:17.077287 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44b658-a91c-4369-8f97-000620795b14 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:17.087488 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1253/2500] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:08:17 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:08:17.091630 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32885cc7-e55a-49e0-8010-2a33fb1fe350 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:17.102142 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32885cc7-e55a-49e0-8010-2a33fb1fe350 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:17.106859 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e60712-677b-4a1e-b1fd-dc20a502e6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:17.107800 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e60712-677b-4a1e-b1fd-dc20a502e6f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:17.108146 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e60712-677b-4a1e-b1fd-dc20a502e6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:17.108487 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e60712-677b-4a1e-b1fd-dc20a502e6f7 admin admin] PATH_INFO: `/v3/projects/e27977cba1954c1a89ff3bd774cb6ef9/users/e36adaa6538a48fe8bc7998a08f6fbf9/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:17.123059 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e60712-677b-4a1e-b1fd-dc20a502e6f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e27977cba1954c1a89ff3bd774cb6ef9, user_id=e36adaa6538a48fe8bc7998a08f6fbf9, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:17.125689 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e60712-677b-4a1e-b1fd-dc20a502e6f7 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:17.137921 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1248/2501] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:08:17 2021] PUT /identity/v3/projects/e27977cba1954c1a89ff3bd774cb6ef9/users/e36adaa6538a48fe8bc7998a08f6fbf9/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:08:17.149847 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd5a64-cb6b-469f-8a6a-059e4cc8e98c None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:17.150192 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd5a64-cb6b-469f-8a6a-059e4cc8e98c None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:17.150621 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd5a64-cb6b-469f-8a6a-059e4cc8e98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:17.178397 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-0ffd5a64-cb6b-469f-8a6a-059e4cc8e98c None None] MFA Rules not processed for user `e36adaa6538a48fe8bc7998a08f6fbf9`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:08:17.179623 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-0ffd5a64-cb6b-469f-8a6a-059e4cc8e98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:17.240682 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1254/2502] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:08:17 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:08:17.253062 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e60712-677b-4a1e-b1fd-dc20a502e6f7 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:17.254763 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-d6e60712-677b-4a1e-b1fd-dc20a502e6f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:17.327867 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e60712-677b-4a1e-b1fd-dc20a502e6f7 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:17.331940 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250e81b-c8ef-4de0-98b2-9b058d94af3b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32003a40693246d08640bc7ec45adfc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:17.332568 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250e81b-c8ef-4de0-98b2-9b058d94af3b service glance] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:17.332848 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250e81b-c8ef-4de0-98b2-9b058d94af3b service glance] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:17.333123 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250e81b-c8ef-4de0-98b2-9b058d94af3b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:17.341040 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250e81b-c8ef-4de0-98b2-9b058d94af3b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:17.342502 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250e81b-c8ef-4de0-98b2-9b058d94af3b service glance] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:17.351484 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1249/2503] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:08:17 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:08:20.377249 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd5a64-cb6b-469f-8a6a-059e4cc8e98c None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:20.378676 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-0ffd5a64-cb6b-469f-8a6a-059e4cc8e98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:20.432984 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd5a64-cb6b-469f-8a6a-059e4cc8e98c None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:20.436484 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735391d-3907-48bc-95f1-d6ce0708448d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:20.437248 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735391d-3907-48bc-95f1-d6ce0708448d service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:20.437552 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735391d-3907-48bc-95f1-d6ce0708448d service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:20.437841 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735391d-3907-48bc-95f1-d6ce0708448d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:20.440009 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-0735391d-3907-48bc-95f1-d6ce0708448d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:20.451428 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735391d-3907-48bc-95f1-d6ce0708448d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:20.452858 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735391d-3907-48bc-95f1-d6ce0708448d service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:20.461140 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1255/2504] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:08:20 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:08:37.935012 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250e81b-c8ef-4de0-98b2-9b058d94af3b service glance] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:37.936470 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3250e81b-c8ef-4de0-98b2-9b058d94af3b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:37.994537 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250e81b-c8ef-4de0-98b2-9b058d94af3b service glance] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:37.998254 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58e13c-d269-4d0a-8520-ff23a95a979f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:37.998894 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58e13c-d269-4d0a-8520-ff23a95a979f service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:37.999182 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58e13c-d269-4d0a-8520-ff23a95a979f service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:37.999465 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58e13c-d269-4d0a-8520-ff23a95a979f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:38.001458 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3d58e13c-d269-4d0a-8520-ff23a95a979f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:38.058068 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58e13c-d269-4d0a-8520-ff23a95a979f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:38.059490 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58e13c-d269-4d0a-8520-ff23a95a979f service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:38.068871 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1250/2505] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:08:37 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:08:48.960663 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735391d-3907-48bc-95f1-d6ce0708448d service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:49.022230 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735391d-3907-48bc-95f1-d6ce0708448d service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:49.026828 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a282db-11cd-428a-ab30-b2b8391e8f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:49.027688 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a282db-11cd-428a-ab30-b2b8391e8f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:49.027976 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a282db-11cd-428a-ab30-b2b8391e8f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:49.028259 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a282db-11cd-428a-ab30-b2b8391e8f2b admin admin] PATH_INFO: `/v3/users/e36adaa6538a48fe8bc7998a08f6fbf9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:49.029460 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a282db-11cd-428a-ab30-b2b8391e8f2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e36adaa6538a48fe8bc7998a08f6fbf9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:49.031394 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a282db-11cd-428a-ab30-b2b8391e8f2b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:49.074773 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-a3a282db-11cd-428a-ab30-b2b8391e8f2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e36adaa6538a48fe8bc7998a08f6fbf9'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:49.081667 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-a3a282db-11cd-428a-ab30-b2b8391e8f2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e36adaa6538a48fe8bc7998a08f6fbf9'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:49.088371 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-a3a282db-11cd-428a-ab30-b2b8391e8f2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e36adaa6538a48fe8bc7998a08f6fbf9'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:49.088995 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-a3a282db-11cd-428a-ab30-b2b8391e8f2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e36adaa6538a48fe8bc7998a08f6fbf9'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:49.100896 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-a3a282db-11cd-428a-ab30-b2b8391e8f2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e36adaa6538a48fe8bc7998a08f6fbf9'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:49.106672 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1256/2506] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:08:48 2021] DELETE /identity/v3/users/e36adaa6538a48fe8bc7998a08f6fbf9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:08:49.111173 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb928b-8935-4dbd-b54e-cac5e5df3bba None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:49.111679 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb928b-8935-4dbd-b54e-cac5e5df3bba None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:49.111799 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb928b-8935-4dbd-b54e-cac5e5df3bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:49.129328 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-bfeb928b-8935-4dbd-b54e-cac5e5df3bba None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:08:49.130533 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-bfeb928b-8935-4dbd-b54e-cac5e5df3bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:49.186269 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1251/2507] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:08:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:08:49.196000 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a282db-11cd-428a-ab30-b2b8391e8f2b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:49.197421 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-a3a282db-11cd-428a-ab30-b2b8391e8f2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:49.251967 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a282db-11cd-428a-ab30-b2b8391e8f2b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:49.255682 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58dde5-986e-4804-adb1-23e7f3457f91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:49.256326 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58dde5-986e-4804-adb1-23e7f3457f91 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:49.256612 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58dde5-986e-4804-adb1-23e7f3457f91 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:49.256893 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58dde5-986e-4804-adb1-23e7f3457f91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:49.265727 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58dde5-986e-4804-adb1-23e7f3457f91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:49.267133 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58dde5-986e-4804-adb1-23e7f3457f91 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:49.276358 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1257/2508] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:08:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 02:08:49.537737 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb928b-8935-4dbd-b54e-cac5e5df3bba None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:08:49.539247 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-bfeb928b-8935-4dbd-b54e-cac5e5df3bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:08:49.551422 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb928b-8935-4dbd-b54e-cac5e5df3bba None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:08:49.557012 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6dcd7b-0183-422d-adab-15469fa3922b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:08:49.557944 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6dcd7b-0183-422d-adab-15469fa3922b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:08:49.558308 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6dcd7b-0183-422d-adab-15469fa3922b admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:08:49.558511 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6dcd7b-0183-422d-adab-15469fa3922b admin admin] PATH_INFO: `/v3/projects/e27977cba1954c1a89ff3bd774cb6ef9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:08:49.560326 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6dcd7b-0183-422d-adab-15469fa3922b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e27977cba1954c1a89ff3bd774cb6ef9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:08:49.562474 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6dcd7b-0183-422d-adab-15469fa3922b admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:08:49.611203 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-cb6dcd7b-0183-422d-adab-15469fa3922b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e27977cba1954c1a89ff3bd774cb6ef9', 'request_id': 'req-cb6dcd7b-0183-422d-adab-15469fa3922b'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:49.616409 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-cb6dcd7b-0183-422d-adab-15469fa3922b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e27977cba1954c1a89ff3bd774cb6ef9', 'request_id': 'req-cb6dcd7b-0183-422d-adab-15469fa3922b'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:49.623735 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-cb6dcd7b-0183-422d-adab-15469fa3922b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e27977cba1954c1a89ff3bd774cb6ef9', 'request_id': 'req-cb6dcd7b-0183-422d-adab-15469fa3922b'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:49.634798 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-cb6dcd7b-0183-422d-adab-15469fa3922b admin admin] The token cache is being invalidate because project e27977cba1954c1a89ff3bd774cb6ef9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:08:49.635119 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-cb6dcd7b-0183-422d-adab-15469fa3922b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:49.635754 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-cb6dcd7b-0183-422d-adab-15469fa3922b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:08:49.637277 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1252/2509] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:08:49 2021] DELETE /identity/v3/projects/e27977cba1954c1a89ff3bd774cb6ef9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:09:43.805747 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58dde5-986e-4804-adb1-23e7f3457f91 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:09:43.807136 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-ce58dde5-986e-4804-adb1-23e7f3457f91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:09:43.861749 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58dde5-986e-4804-adb1-23e7f3457f91 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:09:43.907912 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005d18d-8222-43c9-a844-f925fd26669c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:09:43.908558 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005d18d-8222-43c9-a844-f925fd26669c service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:09:43.908844 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005d18d-8222-43c9-a844-f925fd26669c service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:09:43.909144 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005d18d-8222-43c9-a844-f925fd26669c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:09:43.910924 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-1005d18d-8222-43c9-a844-f925fd26669c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:09:43.988601 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005d18d-8222-43c9-a844-f925fd26669c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:09:43.990071 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005d18d-8222-43c9-a844-f925fd26669c service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:09:44.008455 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1258/2510] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:09:43 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:11:39.208596 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6dcd7b-0183-422d-adab-15469fa3922b admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:39.210050 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-cb6dcd7b-0183-422d-adab-15469fa3922b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:39.264666 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6dcd7b-0183-422d-adab-15469fa3922b admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:39.268217 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632c38b-6616-41ee-9429-5ee5c883eb2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:39.268846 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632c38b-6616-41ee-9429-5ee5c883eb2d service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:39.269126 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632c38b-6616-41ee-9429-5ee5c883eb2d service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:39.269401 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632c38b-6616-41ee-9429-5ee5c883eb2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:39.271144 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-c632c38b-6616-41ee-9429-5ee5c883eb2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:39.354195 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632c38b-6616-41ee-9429-5ee5c883eb2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:39.355629 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632c38b-6616-41ee-9429-5ee5c883eb2d service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:39.375309 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1253/2511] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:11:39 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:11:40.306905 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005d18d-8222-43c9-a844-f925fd26669c service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:40.316444 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005d18d-8222-43c9-a844-f925fd26669c service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:40.320048 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ddea87-6a43-46c4-9df4-79e277aa5197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:40.320687 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddea87-6a43-46c4-9df4-79e277aa5197 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:40.320966 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddea87-6a43-46c4-9df4-79e277aa5197 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:40.321248 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddea87-6a43-46c4-9df4-79e277aa5197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:40.323052 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-76ddea87-6a43-46c4-9df4-79e277aa5197 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:40.386250 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ddea87-6a43-46c4-9df4-79e277aa5197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:40.387777 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ddea87-6a43-46c4-9df4-79e277aa5197 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:40.398901 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1259/2512] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:11:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:11:40.573732 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632c38b-6616-41ee-9429-5ee5c883eb2d service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:40.582073 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632c38b-6616-41ee-9429-5ee5c883eb2d service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:40.585826 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64c4fa-f40a-4b5c-b38f-225efd38eb94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:40.586471 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64c4fa-f40a-4b5c-b38f-225efd38eb94 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:40.586758 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64c4fa-f40a-4b5c-b38f-225efd38eb94 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:40.587574 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64c4fa-f40a-4b5c-b38f-225efd38eb94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:40.589491 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3b64c4fa-f40a-4b5c-b38f-225efd38eb94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:40.602766 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64c4fa-f40a-4b5c-b38f-225efd38eb94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:40.604176 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64c4fa-f40a-4b5c-b38f-225efd38eb94 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:40.615176 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1254/2513] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:11:40 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:11:43.558318 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ddea87-6a43-46c4-9df4-79e277aa5197 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:43.559804 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-76ddea87-6a43-46c4-9df4-79e277aa5197 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:43.573722 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ddea87-6a43-46c4-9df4-79e277aa5197 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:43.577674 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858ba2b-8aac-4c42-b50c-cddd1c1f8448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:43.578582 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858ba2b-8aac-4c42-b50c-cddd1c1f8448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:43.582210 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858ba2b-8aac-4c42-b50c-cddd1c1f8448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:43.582500 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858ba2b-8aac-4c42-b50c-cddd1c1f8448 admin admin] PATH_INFO: `/v3/users/b164b9dd32884e99b0b22eb7c50bdda2` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:43.583763 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858ba2b-8aac-4c42-b50c-cddd1c1f8448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b164b9dd32884e99b0b22eb7c50bdda2)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:43.585732 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858ba2b-8aac-4c42-b50c-cddd1c1f8448 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:43.632846 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-f858ba2b-8aac-4c42-b50c-cddd1c1f8448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b164b9dd32884e99b0b22eb7c50bdda2'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:43.640123 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-f858ba2b-8aac-4c42-b50c-cddd1c1f8448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b164b9dd32884e99b0b22eb7c50bdda2'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:43.646792 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-f858ba2b-8aac-4c42-b50c-cddd1c1f8448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b164b9dd32884e99b0b22eb7c50bdda2'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:43.647446 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-f858ba2b-8aac-4c42-b50c-cddd1c1f8448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b164b9dd32884e99b0b22eb7c50bdda2'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:43.659305 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-f858ba2b-8aac-4c42-b50c-cddd1c1f8448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b164b9dd32884e99b0b22eb7c50bdda2'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:43.665503 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1260/2514] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:11:43 2021] DELETE /identity/v3/users/b164b9dd32884e99b0b22eb7c50bdda2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:11:43.831509 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64c4fa-f40a-4b5c-b38f-225efd38eb94 service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:43.844020 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64c4fa-f40a-4b5c-b38f-225efd38eb94 service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:43.925852 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69414f19-81ca-4499-bc59-0c0a68544fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:43.927628 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69414f19-81ca-4499-bc59-0c0a68544fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:43.928133 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69414f19-81ca-4499-bc59-0c0a68544fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:43.928786 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69414f19-81ca-4499-bc59-0c0a68544fcf admin admin] PATH_INFO: `/v3/projects/52db6551fde546ca893bf07830528d4d` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:43.930448 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69414f19-81ca-4499-bc59-0c0a68544fcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=52db6551fde546ca893bf07830528d4d)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:43.934122 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69414f19-81ca-4499-bc59-0c0a68544fcf admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:43.996943 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-69414f19-81ca-4499-bc59-0c0a68544fcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52db6551fde546ca893bf07830528d4d', 'request_id': 'req-69414f19-81ca-4499-bc59-0c0a68544fcf'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:44.003570 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-69414f19-81ca-4499-bc59-0c0a68544fcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52db6551fde546ca893bf07830528d4d', 'request_id': 'req-69414f19-81ca-4499-bc59-0c0a68544fcf'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:44.015646 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-69414f19-81ca-4499-bc59-0c0a68544fcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52db6551fde546ca893bf07830528d4d', 'request_id': 'req-69414f19-81ca-4499-bc59-0c0a68544fcf'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:44.030470 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-69414f19-81ca-4499-bc59-0c0a68544fcf admin admin] The token cache is being invalidate because project 52db6551fde546ca893bf07830528d4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:11:44.030828 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-69414f19-81ca-4499-bc59-0c0a68544fcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:44.031528 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-69414f19-81ca-4499-bc59-0c0a68544fcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:44.033270 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1255/2515] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:11:43 2021] DELETE /identity/v3/projects/52db6551fde546ca893bf07830528d4d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:11:44.040881 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3711a-ddcf-47b7-97f5-d79bc4550b66 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:44.041248 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3711a-ddcf-47b7-97f5-d79bc4550b66 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:44.041651 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3711a-ddcf-47b7-97f5-d79bc4550b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:44.060736 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-f9c3711a-ddcf-47b7-97f5-d79bc4550b66 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:11:44.062257 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-f9c3711a-ddcf-47b7-97f5-d79bc4550b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:44.121643 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1261/2516] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:11:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:11:44.128985 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886d33b-42a8-4eb4-a3ae-6d1191bf14c6 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:44.129274 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886d33b-42a8-4eb4-a3ae-6d1191bf14c6 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:44.129584 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886d33b-42a8-4eb4-a3ae-6d1191bf14c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:44.148026 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-d886d33b-42a8-4eb4-a3ae-6d1191bf14c6 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:11:44.149282 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-d886d33b-42a8-4eb4-a3ae-6d1191bf14c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:44.157045 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1256/2517] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:11:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:11:44.161257 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3711a-ddcf-47b7-97f5-d79bc4550b66 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:44.170919 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3711a-ddcf-47b7-97f5-d79bc4550b66 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:44.176855 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51f2d1-e2cb-4add-a467-8577245f5636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:44.177848 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51f2d1-e2cb-4add-a467-8577245f5636 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:44.178344 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51f2d1-e2cb-4add-a467-8577245f5636 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:44.178841 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51f2d1-e2cb-4add-a467-8577245f5636 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:44.180184 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51f2d1-e2cb-4add-a467-8577245f5636 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 02:11:44.181261 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51f2d1-e2cb-4add-a467-8577245f5636 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:44.184263 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51f2d1-e2cb-4add-a467-8577245f5636 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:44.198325 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1262/2518] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 02:11:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 02:11:44.202619 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886d33b-42a8-4eb4-a3ae-6d1191bf14c6 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:44.211972 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886d33b-42a8-4eb4-a3ae-6d1191bf14c6 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:44.216695 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06638f05-abd4-43ca-a94a-0bc4ae97a960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:44.217374 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06638f05-abd4-43ca-a94a-0bc4ae97a960 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:44.217697 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06638f05-abd4-43ca-a94a-0bc4ae97a960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:44.217984 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06638f05-abd4-43ca-a94a-0bc4ae97a960 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:44.218697 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06638f05-abd4-43ca-a94a-0bc4ae97a960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:44.220593 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06638f05-abd4-43ca-a94a-0bc4ae97a960 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:44.247887 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1257/2519] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:11:44 2021] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:11:44.251863 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51f2d1-e2cb-4add-a467-8577245f5636 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:44.262461 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51f2d1-e2cb-4add-a467-8577245f5636 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:44.318143 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc80e6e-f7d5-49e8-a6b0-f88fc982b175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:44.318837 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc80e6e-f7d5-49e8-a6b0-f88fc982b175 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:44.319123 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc80e6e-f7d5-49e8-a6b0-f88fc982b175 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:44.319402 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc80e6e-f7d5-49e8-a6b0-f88fc982b175 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:44.320123 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc80e6e-f7d5-49e8-a6b0-f88fc982b175 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:44.322045 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc80e6e-f7d5-49e8-a6b0-f88fc982b175 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:44.342238 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1263/2520] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:11:44 2021] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:11:44.346276 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06638f05-abd4-43ca-a94a-0bc4ae97a960 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:44.356779 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06638f05-abd4-43ca-a94a-0bc4ae97a960 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:44.361716 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16796df3-3382-41fd-98a4-55062b883290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:44.362378 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16796df3-3382-41fd-98a4-55062b883290 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:44.362667 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16796df3-3382-41fd-98a4-55062b883290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:44.362949 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16796df3-3382-41fd-98a4-55062b883290 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:44.363689 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16796df3-3382-41fd-98a4-55062b883290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:44.365303 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16796df3-3382-41fd-98a4-55062b883290 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:44.379171 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1258/2521] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:11:44 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:11:44.380354 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc80e6e-f7d5-49e8-a6b0-f88fc982b175 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:44.390326 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc80e6e-f7d5-49e8-a6b0-f88fc982b175 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:44.395369 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff8a01-98d6-4b8e-afdf-905b222f2678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:44.396028 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff8a01-98d6-4b8e-afdf-905b222f2678 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:44.396316 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff8a01-98d6-4b8e-afdf-905b222f2678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:44.396599 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff8a01-98d6-4b8e-afdf-905b222f2678 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:44.397334 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff8a01-98d6-4b8e-afdf-905b222f2678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:44.398939 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff8a01-98d6-4b8e-afdf-905b222f2678 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:44.408790 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1264/2522] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:11:44 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:11:44.413352 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16796df3-3382-41fd-98a4-55062b883290 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:44.425334 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16796df3-3382-41fd-98a4-55062b883290 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:44.430549 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70748860-5d64-4d27-a2e7-b3c368cf7ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:44.431968 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70748860-5d64-4d27-a2e7-b3c368cf7ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:44.432249 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70748860-5d64-4d27-a2e7-b3c368cf7ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:44.432533 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70748860-5d64-4d27-a2e7-b3c368cf7ab6 admin admin] PATH_INFO: `/v3/projects/ed66e53eb47142858aefa380fd345206/users/4468546a2dff4a47a52b0fa54c6b82c0/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:44.448141 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70748860-5d64-4d27-a2e7-b3c368cf7ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed66e53eb47142858aefa380fd345206, user_id=4468546a2dff4a47a52b0fa54c6b82c0, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:44.450864 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70748860-5d64-4d27-a2e7-b3c368cf7ab6 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:44.463937 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1259/2523] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:11:44 2021] PUT /identity/v3/projects/ed66e53eb47142858aefa380fd345206/users/4468546a2dff4a47a52b0fa54c6b82c0/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:11:44.474275 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06b6b9-34af-4212-a1ed-e4b4b8905de8 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:44.474565 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06b6b9-34af-4212-a1ed-e4b4b8905de8 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:44.474849 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06b6b9-34af-4212-a1ed-e4b4b8905de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:44.503120 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-db06b6b9-34af-4212-a1ed-e4b4b8905de8 None None] MFA Rules not processed for user `4468546a2dff4a47a52b0fa54c6b82c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:11:44.504327 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-db06b6b9-34af-4212-a1ed-e4b4b8905de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:44.568200 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1265/2524] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:11:44 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:11:44.572590 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70748860-5d64-4d27-a2e7-b3c368cf7ab6 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:44.630823 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70748860-5d64-4d27-a2e7-b3c368cf7ab6 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:44.635500 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a0b42-3e57-4590-bf13-b651de12a578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:44.636142 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a0b42-3e57-4590-bf13-b651de12a578 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:44.636429 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a0b42-3e57-4590-bf13-b651de12a578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:44.636708 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a0b42-3e57-4590-bf13-b651de12a578 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:44.637414 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a0b42-3e57-4590-bf13-b651de12a578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:44.639321 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a0b42-3e57-4590-bf13-b651de12a578 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:44.663561 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1260/2525] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:11:44 2021] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:11:44.668109 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06b6b9-34af-4212-a1ed-e4b4b8905de8 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:44.679695 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06b6b9-34af-4212-a1ed-e4b4b8905de8 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:44.732702 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d007aa-546c-40ca-8eb5-6459f95755ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:44.733311 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d007aa-546c-40ca-8eb5-6459f95755ec admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:44.733916 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d007aa-546c-40ca-8eb5-6459f95755ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:44.734200 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d007aa-546c-40ca-8eb5-6459f95755ec admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:44.734915 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d007aa-546c-40ca-8eb5-6459f95755ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:44.736829 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d007aa-546c-40ca-8eb5-6459f95755ec admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:44.761640 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1266/2526] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:11:44 2021] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:11:44.765782 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a0b42-3e57-4590-bf13-b651de12a578 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:44.776608 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a0b42-3e57-4590-bf13-b651de12a578 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:44.781280 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcc82d-21f9-4671-9930-0fa2140c59fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:44.782001 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcc82d-21f9-4671-9930-0fa2140c59fb admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:44.782273 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcc82d-21f9-4671-9930-0fa2140c59fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:44.782545 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcc82d-21f9-4671-9930-0fa2140c59fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:44.783283 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcc82d-21f9-4671-9930-0fa2140c59fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:44.784868 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcc82d-21f9-4671-9930-0fa2140c59fb admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:44.795780 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1261/2527] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:11:44 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:11:44.800153 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d007aa-546c-40ca-8eb5-6459f95755ec admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:44.810213 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d007aa-546c-40ca-8eb5-6459f95755ec admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:44.814853 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f039bc-f3c3-4262-a747-b247588527d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:44.815756 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f039bc-f3c3-4262-a747-b247588527d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:44.816037 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f039bc-f3c3-4262-a747-b247588527d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:44.816315 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f039bc-f3c3-4262-a747-b247588527d0 admin admin] PATH_INFO: `/v3/projects/e1a1d478cfbb495382528aa4d46f59c8/users/e8fe0edad2b54790a57dda1e0151b39f/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:44.830517 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f039bc-f3c3-4262-a747-b247588527d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a1d478cfbb495382528aa4d46f59c8, user_id=e8fe0edad2b54790a57dda1e0151b39f, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:44.833133 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f039bc-f3c3-4262-a747-b247588527d0 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:44.846429 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1267/2528] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:11:44 2021] PUT /identity/v3/projects/e1a1d478cfbb495382528aa4d46f59c8/users/e8fe0edad2b54790a57dda1e0151b39f/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:11:44.850449 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcc82d-21f9-4671-9930-0fa2140c59fb admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:44.860791 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcc82d-21f9-4671-9930-0fa2140c59fb admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:44.911912 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21eff31-3746-472d-9302-e6e900f34105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:44.912493 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21eff31-3746-472d-9302-e6e900f34105 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:44.912774 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21eff31-3746-472d-9302-e6e900f34105 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:44.913052 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21eff31-3746-472d-9302-e6e900f34105 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:44.913811 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21eff31-3746-472d-9302-e6e900f34105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:44.915984 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21eff31-3746-472d-9302-e6e900f34105 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:44.925551 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1262/2529] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:11:44 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:11:44.929656 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f039bc-f3c3-4262-a747-b247588527d0 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:44.940122 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f039bc-f3c3-4262-a747-b247588527d0 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:44.944756 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea54ed-a752-49d6-8337-a0c5d51302c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:44.945652 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea54ed-a752-49d6-8337-a0c5d51302c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:44.945940 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea54ed-a752-49d6-8337-a0c5d51302c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:44.946797 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea54ed-a752-49d6-8337-a0c5d51302c5 admin admin] PATH_INFO: `/v3/projects/e1a1d478cfbb495382528aa4d46f59c8/users/e8fe0edad2b54790a57dda1e0151b39f/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:44.948813 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea54ed-a752-49d6-8337-a0c5d51302c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a1d478cfbb495382528aa4d46f59c8, user_id=e8fe0edad2b54790a57dda1e0151b39f, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:44.951476 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea54ed-a752-49d6-8337-a0c5d51302c5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:44.961527 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1268/2530] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:11:44 2021] PUT /identity/v3/projects/e1a1d478cfbb495382528aa4d46f59c8/users/e8fe0edad2b54790a57dda1e0151b39f/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:11:44.972527 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc85c7-55f0-47ae-bb10-b8d90a8a9d1e None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:44.972847 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc85c7-55f0-47ae-bb10-b8d90a8a9d1e None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:44.973130 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc85c7-55f0-47ae-bb10-b8d90a8a9d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:44.998680 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-b5dc85c7-55f0-47ae-bb10-b8d90a8a9d1e None None] MFA Rules not processed for user `e8fe0edad2b54790a57dda1e0151b39f`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:11:44.999869 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-b5dc85c7-55f0-47ae-bb10-b8d90a8a9d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:45.064864 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1263/2531] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:11:44 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:11:45.075461 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea54ed-a752-49d6-8337-a0c5d51302c5 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:45.077137 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-bcea54ed-a752-49d6-8337-a0c5d51302c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:45.142297 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea54ed-a752-49d6-8337-a0c5d51302c5 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:45.145972 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541625d9-9d9b-489e-8f94-0736e55bd041 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:45.146605 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541625d9-9d9b-489e-8f94-0736e55bd041 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:45.146894 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541625d9-9d9b-489e-8f94-0736e55bd041 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:45.147175 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541625d9-9d9b-489e-8f94-0736e55bd041 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:45.155979 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541625d9-9d9b-489e-8f94-0736e55bd041 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:45.157386 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541625d9-9d9b-489e-8f94-0736e55bd041 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:45.167107 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1269/2532] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:11:45 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:11:45.386330 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc85c7-55f0-47ae-bb10-b8d90a8a9d1e None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:45.387732 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-b5dc85c7-55f0-47ae-bb10-b8d90a8a9d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:45.421229 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541625d9-9d9b-489e-8f94-0736e55bd041 service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:45.445227 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc85c7-55f0-47ae-bb10-b8d90a8a9d1e None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:45.448860 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db5cc5-f156-43c5-8aed-10b8cfbbbeff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:45.449530 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db5cc5-f156-43c5-8aed-10b8cfbbbeff service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:45.449821 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db5cc5-f156-43c5-8aed-10b8cfbbbeff service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:45.450099 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db5cc5-f156-43c5-8aed-10b8cfbbbeff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:45.451860 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-36db5cc5-f156-43c5-8aed-10b8cfbbbeff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:45.482042 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541625d9-9d9b-489e-8f94-0736e55bd041 service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:45.486865 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb209e5-ff99-48ac-864a-180b13b73637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:45.487729 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb209e5-ff99-48ac-864a-180b13b73637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:45.488018 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb209e5-ff99-48ac-864a-180b13b73637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:45.488310 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb209e5-ff99-48ac-864a-180b13b73637 admin admin] PATH_INFO: `/v3/users/4468546a2dff4a47a52b0fa54c6b82c0` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:45.489542 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb209e5-ff99-48ac-864a-180b13b73637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4468546a2dff4a47a52b0fa54c6b82c0)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:45.491463 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb209e5-ff99-48ac-864a-180b13b73637 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:45.512028 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db5cc5-f156-43c5-8aed-10b8cfbbbeff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:45.513457 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db5cc5-f156-43c5-8aed-10b8cfbbbeff service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:45.523617 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1264/2533] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:11:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:11:45.536395 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-fcb209e5-ff99-48ac-864a-180b13b73637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4468546a2dff4a47a52b0fa54c6b82c0'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:45.544934 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-fcb209e5-ff99-48ac-864a-180b13b73637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4468546a2dff4a47a52b0fa54c6b82c0'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:45.552121 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-fcb209e5-ff99-48ac-864a-180b13b73637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4468546a2dff4a47a52b0fa54c6b82c0'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:45.552782 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-fcb209e5-ff99-48ac-864a-180b13b73637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4468546a2dff4a47a52b0fa54c6b82c0'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:45.564526 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-fcb209e5-ff99-48ac-864a-180b13b73637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4468546a2dff4a47a52b0fa54c6b82c0'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:45.570645 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1270/2534] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:11:45 2021] DELETE /identity/v3/users/4468546a2dff4a47a52b0fa54c6b82c0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:11:45.577047 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123189b-c217-44d9-81ec-140737e854b7 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:45.578169 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123189b-c217-44d9-81ec-140737e854b7 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:45.578456 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123189b-c217-44d9-81ec-140737e854b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:45.596978 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-4123189b-c217-44d9-81ec-140737e854b7 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:11:45.598219 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4123189b-c217-44d9-81ec-140737e854b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:45.655127 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1265/2535] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:11:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:11:45.665573 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb209e5-ff99-48ac-864a-180b13b73637 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:45.666994 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-fcb209e5-ff99-48ac-864a-180b13b73637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:45.724871 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb209e5-ff99-48ac-864a-180b13b73637 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:45.731064 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050bf3b-78ea-41e0-ac79-63ff65fe87ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:45.731726 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050bf3b-78ea-41e0-ac79-63ff65fe87ff service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:45.732015 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050bf3b-78ea-41e0-ac79-63ff65fe87ff service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:45.732294 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050bf3b-78ea-41e0-ac79-63ff65fe87ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:45.742456 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050bf3b-78ea-41e0-ac79-63ff65fe87ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:45.744058 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050bf3b-78ea-41e0-ac79-63ff65fe87ff service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:45.754293 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1271/2536] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:11:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:11:46.128614 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123189b-c217-44d9-81ec-140737e854b7 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:46.130600 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4123189b-c217-44d9-81ec-140737e854b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:46.148729 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123189b-c217-44d9-81ec-140737e854b7 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:46.155664 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000189d7-2cfc-4372-8f77-47b9ab053d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:46.156598 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000189d7-2cfc-4372-8f77-47b9ab053d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:46.156887 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000189d7-2cfc-4372-8f77-47b9ab053d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:46.157168 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000189d7-2cfc-4372-8f77-47b9ab053d1f admin admin] PATH_INFO: `/v3/users/896ad3ff1d5a4723900241fdca7c73c2` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:46.158594 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000189d7-2cfc-4372-8f77-47b9ab053d1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=896ad3ff1d5a4723900241fdca7c73c2)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:46.160540 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000189d7-2cfc-4372-8f77-47b9ab053d1f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:46.171111 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050bf3b-78ea-41e0-ac79-63ff65fe87ff service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:46.172641 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-5050bf3b-78ea-41e0-ac79-63ff65fe87ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:46.192299 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050bf3b-78ea-41e0-ac79-63ff65fe87ff service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:46.198331 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7b1af-daec-4139-9c3e-2d054da5ed4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:46.199773 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7b1af-daec-4139-9c3e-2d054da5ed4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:46.199944 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7b1af-daec-4139-9c3e-2d054da5ed4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:46.200303 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7b1af-daec-4139-9c3e-2d054da5ed4b admin admin] PATH_INFO: `/v3/projects/ed66e53eb47142858aefa380fd345206` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:46.201430 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7b1af-daec-4139-9c3e-2d054da5ed4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed66e53eb47142858aefa380fd345206)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:46.204023 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7b1af-daec-4139-9c3e-2d054da5ed4b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:46.221246 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-000189d7-2cfc-4372-8f77-47b9ab053d1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '896ad3ff1d5a4723900241fdca7c73c2'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:46.227972 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-000189d7-2cfc-4372-8f77-47b9ab053d1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '896ad3ff1d5a4723900241fdca7c73c2'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:46.228637 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-000189d7-2cfc-4372-8f77-47b9ab053d1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '896ad3ff1d5a4723900241fdca7c73c2'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:46.240773 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-000189d7-2cfc-4372-8f77-47b9ab053d1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '896ad3ff1d5a4723900241fdca7c73c2'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:46.248436 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-000189d7-2cfc-4372-8f77-47b9ab053d1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '896ad3ff1d5a4723900241fdca7c73c2'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:46.252852 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-e9e7b1af-daec-4139-9c3e-2d054da5ed4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed66e53eb47142858aefa380fd345206', 'request_id': 'req-e9e7b1af-daec-4139-9c3e-2d054da5ed4b'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:46.254232 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1266/2537] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:11:46 2021] DELETE /identity/v3/users/896ad3ff1d5a4723900241fdca7c73c2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:11:46.258293 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-e9e7b1af-daec-4139-9c3e-2d054da5ed4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed66e53eb47142858aefa380fd345206', 'request_id': 'req-e9e7b1af-daec-4139-9c3e-2d054da5ed4b'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:46.267322 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-e9e7b1af-daec-4139-9c3e-2d054da5ed4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed66e53eb47142858aefa380fd345206', 'request_id': 'req-e9e7b1af-daec-4139-9c3e-2d054da5ed4b'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:46.278544 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-e9e7b1af-daec-4139-9c3e-2d054da5ed4b admin admin] The token cache is being invalidate because project ed66e53eb47142858aefa380fd345206 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:11:46.278836 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-e9e7b1af-daec-4139-9c3e-2d054da5ed4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:46.279484 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-e9e7b1af-daec-4139-9c3e-2d054da5ed4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:46.281021 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1272/2538] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:11:46 2021] DELETE /identity/v3/projects/ed66e53eb47142858aefa380fd345206 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:11:46.285325 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000189d7-2cfc-4372-8f77-47b9ab053d1f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:46.286422 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-000189d7-2cfc-4372-8f77-47b9ab053d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:46.349989 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000189d7-2cfc-4372-8f77-47b9ab053d1f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:46.354952 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992ce6c-a82e-4215-ad3c-af78ab9556ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:46.355926 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992ce6c-a82e-4215-ad3c-af78ab9556ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:46.356290 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992ce6c-a82e-4215-ad3c-af78ab9556ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:46.356643 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992ce6c-a82e-4215-ad3c-af78ab9556ff admin admin] PATH_INFO: `/v3/users/e8fe0edad2b54790a57dda1e0151b39f` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:46.358012 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992ce6c-a82e-4215-ad3c-af78ab9556ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8fe0edad2b54790a57dda1e0151b39f)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:46.359981 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992ce6c-a82e-4215-ad3c-af78ab9556ff admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:46.404989 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4992ce6c-a82e-4215-ad3c-af78ab9556ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8fe0edad2b54790a57dda1e0151b39f'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:46.412795 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4992ce6c-a82e-4215-ad3c-af78ab9556ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8fe0edad2b54790a57dda1e0151b39f'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:46.413512 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4992ce6c-a82e-4215-ad3c-af78ab9556ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8fe0edad2b54790a57dda1e0151b39f'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:46.425555 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7b1af-daec-4139-9c3e-2d054da5ed4b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:46.426249 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4992ce6c-a82e-4215-ad3c-af78ab9556ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8fe0edad2b54790a57dda1e0151b39f'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:46.427189 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-e9e7b1af-daec-4139-9c3e-2d054da5ed4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:46.436964 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4992ce6c-a82e-4215-ad3c-af78ab9556ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8fe0edad2b54790a57dda1e0151b39f'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:46.444413 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1267/2539] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:11:46 2021] DELETE /identity/v3/users/e8fe0edad2b54790a57dda1e0151b39f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:11:46.510480 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7b1af-daec-4139-9c3e-2d054da5ed4b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:46.567584 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90a218-dfd7-4f9f-9add-53ee61df0277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:46.568452 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90a218-dfd7-4f9f-9add-53ee61df0277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:46.569035 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90a218-dfd7-4f9f-9add-53ee61df0277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:46.569035 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90a218-dfd7-4f9f-9add-53ee61df0277 admin admin] PATH_INFO: `/v3/projects/6f423b9700e344a68263020698e12494` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:46.570202 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90a218-dfd7-4f9f-9add-53ee61df0277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f423b9700e344a68263020698e12494)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:46.572124 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90a218-dfd7-4f9f-9add-53ee61df0277 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:46.622559 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-3c90a218-dfd7-4f9f-9add-53ee61df0277 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f423b9700e344a68263020698e12494', 'request_id': 'req-3c90a218-dfd7-4f9f-9add-53ee61df0277'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:46.627777 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-3c90a218-dfd7-4f9f-9add-53ee61df0277 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f423b9700e344a68263020698e12494', 'request_id': 'req-3c90a218-dfd7-4f9f-9add-53ee61df0277'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:46.635162 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-3c90a218-dfd7-4f9f-9add-53ee61df0277 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f423b9700e344a68263020698e12494', 'request_id': 'req-3c90a218-dfd7-4f9f-9add-53ee61df0277'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:46.646319 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-3c90a218-dfd7-4f9f-9add-53ee61df0277 admin admin] The token cache is being invalidate because project 6f423b9700e344a68263020698e12494 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:11:46.646613 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-3c90a218-dfd7-4f9f-9add-53ee61df0277 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:46.647260 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-3c90a218-dfd7-4f9f-9add-53ee61df0277 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:46.648787 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1273/2540] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:11:46 2021] DELETE /identity/v3/projects/6f423b9700e344a68263020698e12494 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:11:46.655316 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f1661-b5cd-4d7b-b28e-8592b1409c52 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:46.655613 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f1661-b5cd-4d7b-b28e-8592b1409c52 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:46.655898 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f1661-b5cd-4d7b-b28e-8592b1409c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:46.674637 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-425f1661-b5cd-4d7b-b28e-8592b1409c52 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:11:46.675852 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-425f1661-b5cd-4d7b-b28e-8592b1409c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:46.717665 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90a218-dfd7-4f9f-9add-53ee61df0277 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:46.719256 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-3c90a218-dfd7-4f9f-9add-53ee61df0277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:46.739494 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1268/2541] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:11:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:11:46.747866 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8deb13d-72cf-41d3-91a4-a51536ea9741 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:46.748197 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8deb13d-72cf-41d3-91a4-a51536ea9741 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:46.748489 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8deb13d-72cf-41d3-91a4-a51536ea9741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:46.767162 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-e8deb13d-72cf-41d3-91a4-a51536ea9741 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:11:46.768375 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-e8deb13d-72cf-41d3-91a4-a51536ea9741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:46.776917 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1269/2542] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:11:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:11:46.780981 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8deb13d-72cf-41d3-91a4-a51536ea9741 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:46.790593 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8deb13d-72cf-41d3-91a4-a51536ea9741 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:46.795237 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e6bee-a7b7-493a-a20b-382e128416c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:46.795881 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e6bee-a7b7-493a-a20b-382e128416c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:46.796163 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e6bee-a7b7-493a-a20b-382e128416c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:46.796445 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e6bee-a7b7-493a-a20b-382e128416c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:46.797172 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e6bee-a7b7-493a-a20b-382e128416c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 02:11:46.797497 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e6bee-a7b7-493a-a20b-382e128416c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:46.797760 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90a218-dfd7-4f9f-9add-53ee61df0277 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:46.799098 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e6bee-a7b7-493a-a20b-382e128416c5 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:46.803609 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c5c49-6f2f-41b9-9654-2dd87d660e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:46.804468 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c5c49-6f2f-41b9-9654-2dd87d660e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:46.804754 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c5c49-6f2f-41b9-9654-2dd87d660e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:46.805151 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c5c49-6f2f-41b9-9654-2dd87d660e8a admin admin] PATH_INFO: `/v3/projects/e1a1d478cfbb495382528aa4d46f59c8` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:46.807339 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c5c49-6f2f-41b9-9654-2dd87d660e8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1a1d478cfbb495382528aa4d46f59c8)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:46.809325 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c5c49-6f2f-41b9-9654-2dd87d660e8a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:46.811138 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1270/2543] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 02:11:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 02:11:46.815274 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e6bee-a7b7-493a-a20b-382e128416c5 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:46.824666 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e6bee-a7b7-493a-a20b-382e128416c5 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:46.829361 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccf399-142c-4dca-a566-2cd8cbd1cc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:46.830020 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccf399-142c-4dca-a566-2cd8cbd1cc7a admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:46.830308 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccf399-142c-4dca-a566-2cd8cbd1cc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:46.830584 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccf399-142c-4dca-a566-2cd8cbd1cc7a admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:46.831282 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abccf399-142c-4dca-a566-2cd8cbd1cc7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:46.833157 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abccf399-142c-4dca-a566-2cd8cbd1cc7a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:46.855629 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-200c5c49-6f2f-41b9-9654-2dd87d660e8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1a1d478cfbb495382528aa4d46f59c8', 'request_id': 'req-200c5c49-6f2f-41b9-9654-2dd87d660e8a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:46.861466 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1271/2544] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:11:46 2021] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:11:46.861668 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-200c5c49-6f2f-41b9-9654-2dd87d660e8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1a1d478cfbb495382528aa4d46f59c8', 'request_id': 'req-200c5c49-6f2f-41b9-9654-2dd87d660e8a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:46.862463 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccf399-142c-4dca-a566-2cd8cbd1cc7a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:46.869367 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-200c5c49-6f2f-41b9-9654-2dd87d660e8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1a1d478cfbb495382528aa4d46f59c8', 'request_id': 'req-200c5c49-6f2f-41b9-9654-2dd87d660e8a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:46.880302 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-200c5c49-6f2f-41b9-9654-2dd87d660e8a admin admin] The token cache is being invalidate because project e1a1d478cfbb495382528aa4d46f59c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:11:46.880593 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-200c5c49-6f2f-41b9-9654-2dd87d660e8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:46.881253 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-200c5c49-6f2f-41b9-9654-2dd87d660e8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:46.882832 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1274/2545] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:11:46 2021] DELETE /identity/v3/projects/e1a1d478cfbb495382528aa4d46f59c8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:11:46.888441 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55290e0a-3997-42a9-9e7a-bef02a6778b5 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:46.888812 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55290e0a-3997-42a9-9e7a-bef02a6778b5 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:46.889171 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55290e0a-3997-42a9-9e7a-bef02a6778b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:46.906887 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-55290e0a-3997-42a9-9e7a-bef02a6778b5 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:11:46.908096 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-55290e0a-3997-42a9-9e7a-bef02a6778b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:46.922522 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccf399-142c-4dca-a566-2cd8cbd1cc7a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:46.927826 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12e879-b19b-48a2-92cd-be975acbca56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:46.928516 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12e879-b19b-48a2-92cd-be975acbca56 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:46.928804 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12e879-b19b-48a2-92cd-be975acbca56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:46.929104 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12e879-b19b-48a2-92cd-be975acbca56 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:46.929838 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12e879-b19b-48a2-92cd-be975acbca56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:46.931771 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12e879-b19b-48a2-92cd-be975acbca56 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:46.951337 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1272/2546] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:11:46 2021] POST /identity/v3/users => generated 283 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:11:46.955422 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12e879-b19b-48a2-92cd-be975acbca56 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:46.957079 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-0c12e879-b19b-48a2-92cd-be975acbca56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:46.965769 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1275/2547] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:11:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:11:46.973366 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab0e4a-2c84-41f2-93c0-35e6d40b245d None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:46.973661 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12e879-b19b-48a2-92cd-be975acbca56 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:46.973797 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab0e4a-2c84-41f2-93c0-35e6d40b245d None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:46.973973 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab0e4a-2c84-41f2-93c0-35e6d40b245d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:46.979257 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8f8b1-fa7c-4959-ad5c-7b941dd90cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:46.979915 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8f8b1-fa7c-4959-ad5c-7b941dd90cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:46.980196 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8f8b1-fa7c-4959-ad5c-7b941dd90cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:46.980468 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8f8b1-fa7c-4959-ad5c-7b941dd90cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:46.981201 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8f8b1-fa7c-4959-ad5c-7b941dd90cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:46.982879 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8f8b1-fa7c-4959-ad5c-7b941dd90cc0 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:46.991964 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-75ab0e4a-2c84-41f2-93c0-35e6d40b245d None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:11:46.992820 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1273/2548] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:11:46 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:11:46.993928 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-75ab0e4a-2c84-41f2-93c0-35e6d40b245d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:46.996777 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8f8b1-fa7c-4959-ad5c-7b941dd90cc0 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:47.002647 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1276/2549] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:11:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:11:47.006374 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8f8b1-fa7c-4959-ad5c-7b941dd90cc0 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:47.006596 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab0e4a-2c84-41f2-93c0-35e6d40b245d None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:47.010965 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534b87f-f987-4b28-9c4b-b389ac5cf23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:47.011737 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534b87f-f987-4b28-9c4b-b389ac5cf23a admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:47.012023 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534b87f-f987-4b28-9c4b-b389ac5cf23a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:47.012304 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534b87f-f987-4b28-9c4b-b389ac5cf23a admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:47.013024 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534b87f-f987-4b28-9c4b-b389ac5cf23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:47.014600 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534b87f-f987-4b28-9c4b-b389ac5cf23a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:47.015576 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab0e4a-2c84-41f2-93c0-35e6d40b245d None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:47.020230 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce781b-7287-4e9b-b9aa-725d3a3dd110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:47.020867 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce781b-7287-4e9b-b9aa-725d3a3dd110 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:47.021152 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce781b-7287-4e9b-b9aa-725d3a3dd110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:47.021437 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce781b-7287-4e9b-b9aa-725d3a3dd110 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:47.022204 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce781b-7287-4e9b-b9aa-725d3a3dd110 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 02:11:47.022516 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce781b-7287-4e9b-b9aa-725d3a3dd110 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:47.024080 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce781b-7287-4e9b-b9aa-725d3a3dd110 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:47.026408 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1274/2550] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:11:46 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:11:47.030409 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534b87f-f987-4b28-9c4b-b389ac5cf23a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:47.039492 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1277/2551] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 02:11:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 02:11:47.042114 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534b87f-f987-4b28-9c4b-b389ac5cf23a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:47.044314 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce781b-7287-4e9b-b9aa-725d3a3dd110 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:47.047270 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc85d55-c4e0-48ba-bbcf-cbe9f7fc2662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:47.048165 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc85d55-c4e0-48ba-bbcf-cbe9f7fc2662 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:47.048444 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc85d55-c4e0-48ba-bbcf-cbe9f7fc2662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:47.048719 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc85d55-c4e0-48ba-bbcf-cbe9f7fc2662 admin admin] PATH_INFO: `/v3/projects/f4d8edc762904b8fa731349f25986cdd/users/97391c457d304d48814288ea45db4fed/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:47.054158 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce781b-7287-4e9b-b9aa-725d3a3dd110 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:47.058871 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65329b72-0663-4151-b621-af3ede94d430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:47.059507 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65329b72-0663-4151-b621-af3ede94d430 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:47.059795 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65329b72-0663-4151-b621-af3ede94d430 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:47.060079 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65329b72-0663-4151-b621-af3ede94d430 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:47.060780 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65329b72-0663-4151-b621-af3ede94d430 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:47.062694 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65329b72-0663-4151-b621-af3ede94d430 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:47.063181 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc85d55-c4e0-48ba-bbcf-cbe9f7fc2662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d8edc762904b8fa731349f25986cdd, user_id=97391c457d304d48814288ea45db4fed, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:47.065831 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc85d55-c4e0-48ba-bbcf-cbe9f7fc2662 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:47.078031 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1275/2552] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:11:47 2021] PUT /identity/v3/projects/f4d8edc762904b8fa731349f25986cdd/users/97391c457d304d48814288ea45db4fed/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:11:47.089105 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e219de-78aa-43bd-8a54-d139b7e94889 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:47.092392 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1278/2553] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:11:47 2021] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:11:47.092534 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e219de-78aa-43bd-8a54-d139b7e94889 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:47.092534 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e219de-78aa-43bd-8a54-d139b7e94889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:47.093272 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65329b72-0663-4151-b621-af3ede94d430 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:47.116071 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-47e219de-78aa-43bd-8a54-d139b7e94889 None None] MFA Rules not processed for user `97391c457d304d48814288ea45db4fed`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:11:47.117280 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-47e219de-78aa-43bd-8a54-d139b7e94889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:47.152980 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65329b72-0663-4151-b621-af3ede94d430 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:47.158532 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e2cc1-37d7-4d56-8cd9-7d5aeb1cfd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:47.159177 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e2cc1-37d7-4d56-8cd9-7d5aeb1cfd2d admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:47.159436 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e2cc1-37d7-4d56-8cd9-7d5aeb1cfd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:47.159761 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e2cc1-37d7-4d56-8cd9-7d5aeb1cfd2d admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:47.160477 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e2cc1-37d7-4d56-8cd9-7d5aeb1cfd2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:47.162424 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e2cc1-37d7-4d56-8cd9-7d5aeb1cfd2d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:47.180977 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1276/2554] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:11:47 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:11:47.186017 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1279/2555] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:11:47 2021] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:11:47.186189 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e219de-78aa-43bd-8a54-d139b7e94889 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:47.187009 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e2cc1-37d7-4d56-8cd9-7d5aeb1cfd2d admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:47.195673 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e219de-78aa-43bd-8a54-d139b7e94889 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:47.196434 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e2cc1-37d7-4d56-8cd9-7d5aeb1cfd2d admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:47.200994 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78dd4f-be4d-4823-91c9-28639daf8161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:47.201350 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c70de-1956-4130-b76a-9344626008e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:47.201675 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78dd4f-be4d-4823-91c9-28639daf8161 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:47.201997 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78dd4f-be4d-4823-91c9-28639daf8161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:47.202149 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c70de-1956-4130-b76a-9344626008e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:47.202261 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78dd4f-be4d-4823-91c9-28639daf8161 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:47.202362 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c70de-1956-4130-b76a-9344626008e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:47.202556 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c70de-1956-4130-b76a-9344626008e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:47.202967 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78dd4f-be4d-4823-91c9-28639daf8161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:47.203282 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c70de-1956-4130-b76a-9344626008e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:47.204838 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c70de-1956-4130-b76a-9344626008e4 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:47.204959 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78dd4f-be4d-4823-91c9-28639daf8161 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:47.215096 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1280/2556] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:11:47 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:11:47.218960 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c70de-1956-4130-b76a-9344626008e4 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:47.228802 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c70de-1956-4130-b76a-9344626008e4 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:47.230773 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1277/2557] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:11:47 2021] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:11:47.234513 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78dd4f-be4d-4823-91c9-28639daf8161 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:47.282373 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4e5a9-6a5e-44b3-985b-8f237bfacf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:47.283029 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4e5a9-6a5e-44b3-985b-8f237bfacf10 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:47.283313 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4e5a9-6a5e-44b3-985b-8f237bfacf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:47.283599 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4e5a9-6a5e-44b3-985b-8f237bfacf10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:47.284319 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4e5a9-6a5e-44b3-985b-8f237bfacf10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:47.285954 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4e5a9-6a5e-44b3-985b-8f237bfacf10 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:47.292279 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78dd4f-be4d-4823-91c9-28639daf8161 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:47.296096 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1281/2558] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:11:47 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:11:47.297032 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abe440-3b2e-4269-a539-e78be2707df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:47.297723 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abe440-3b2e-4269-a539-e78be2707df9 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:47.298010 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abe440-3b2e-4269-a539-e78be2707df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:47.298294 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abe440-3b2e-4269-a539-e78be2707df9 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:47.298992 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abe440-3b2e-4269-a539-e78be2707df9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:47.300513 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4e5a9-6a5e-44b3-985b-8f237bfacf10 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:47.301158 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abe440-3b2e-4269-a539-e78be2707df9 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:47.310072 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4e5a9-6a5e-44b3-985b-8f237bfacf10 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:47.315442 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda9950-a359-4221-9027-b53ea1f096e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:47.316307 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda9950-a359-4221-9027-b53ea1f096e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:47.316666 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda9950-a359-4221-9027-b53ea1f096e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:47.316937 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda9950-a359-4221-9027-b53ea1f096e1 admin admin] PATH_INFO: `/v3/projects/c77a0b0224374ad783775c49774041e1/users/65059766b593478aa54e009ba16d73e8/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:47.325827 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1278/2559] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:11:47 2021] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:11:47.327216 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abe440-3b2e-4269-a539-e78be2707df9 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:47.334411 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda9950-a359-4221-9027-b53ea1f096e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c77a0b0224374ad783775c49774041e1, user_id=65059766b593478aa54e009ba16d73e8, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:47.337445 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abe440-3b2e-4269-a539-e78be2707df9 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:47.337722 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda9950-a359-4221-9027-b53ea1f096e1 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:47.343843 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fa7c7-ff65-43fc-a5eb-b7190410d9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:47.344548 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fa7c7-ff65-43fc-a5eb-b7190410d9ac admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:47.344832 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fa7c7-ff65-43fc-a5eb-b7190410d9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:47.345114 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fa7c7-ff65-43fc-a5eb-b7190410d9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:47.345893 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567fa7c7-ff65-43fc-a5eb-b7190410d9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:47.347471 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567fa7c7-ff65-43fc-a5eb-b7190410d9ac admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:47.350664 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1282/2560] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:11:47 2021] PUT /identity/v3/projects/c77a0b0224374ad783775c49774041e1/users/65059766b593478aa54e009ba16d73e8/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:11:47.360494 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1279/2561] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:11:47 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:11:47.361668 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda9950-a359-4221-9027-b53ea1f096e1 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:47.362568 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cc02c-5557-4973-8119-2cb2f2700eba None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:47.362863 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cc02c-5557-4973-8119-2cb2f2700eba None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:47.363147 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cc02c-5557-4973-8119-2cb2f2700eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:47.388839 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-ae3cc02c-5557-4973-8119-2cb2f2700eba None None] MFA Rules not processed for user `65059766b593478aa54e009ba16d73e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:11:47.390150 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-ae3cc02c-5557-4973-8119-2cb2f2700eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:47.420106 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda9950-a359-4221-9027-b53ea1f096e1 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:47.425113 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae228d6a-70b7-4dd2-a1f7-bb40efdc7000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:47.426018 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae228d6a-70b7-4dd2-a1f7-bb40efdc7000 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:47.426302 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae228d6a-70b7-4dd2-a1f7-bb40efdc7000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:47.426575 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae228d6a-70b7-4dd2-a1f7-bb40efdc7000 admin admin] PATH_INFO: `/v3/projects/3287351a8297461d948543c5fa2d667e/users/dcd571089fde4bf38a3f3156d7404a7c/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:47.440156 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae228d6a-70b7-4dd2-a1f7-bb40efdc7000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3287351a8297461d948543c5fa2d667e, user_id=dcd571089fde4bf38a3f3156d7404a7c, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:47.442800 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae228d6a-70b7-4dd2-a1f7-bb40efdc7000 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:47.452313 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1280/2562] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:11:47 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:11:47.458358 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1283/2563] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:11:47 2021] PUT /identity/v3/projects/3287351a8297461d948543c5fa2d667e/users/dcd571089fde4bf38a3f3156d7404a7c/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:11:47.458520 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cc02c-5557-4973-8119-2cb2f2700eba None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:47.459296 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae228d6a-70b7-4dd2-a1f7-bb40efdc7000 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:47.467755 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cc02c-5557-4973-8119-2cb2f2700eba None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:47.518488 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae228d6a-70b7-4dd2-a1f7-bb40efdc7000 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:47.520705 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c52415-b471-43c4-828c-7cf8eea6d08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:47.521367 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c52415-b471-43c4-828c-7cf8eea6d08f admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:47.521689 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c52415-b471-43c4-828c-7cf8eea6d08f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:47.522107 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c52415-b471-43c4-828c-7cf8eea6d08f admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:47.522826 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c52415-b471-43c4-828c-7cf8eea6d08f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:47.523016 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192ab7e-0eca-4660-ba2b-c25760789797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:47.523807 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192ab7e-0eca-4660-ba2b-c25760789797 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:47.524092 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192ab7e-0eca-4660-ba2b-c25760789797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:47.524926 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192ab7e-0eca-4660-ba2b-c25760789797 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:47.525387 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c52415-b471-43c4-828c-7cf8eea6d08f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:47.525687 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192ab7e-0eca-4660-ba2b-c25760789797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:47.527237 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192ab7e-0eca-4660-ba2b-c25760789797 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:47.537033 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1284/2564] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:11:47 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:11:47.541090 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192ab7e-0eca-4660-ba2b-c25760789797 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:47.551452 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192ab7e-0eca-4660-ba2b-c25760789797 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:47.555525 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1281/2565] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:11:47 2021] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:11:47.556475 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c52415-b471-43c4-828c-7cf8eea6d08f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:47.606757 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22faec47-96dc-4f6b-b74d-ffe1825c7b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:47.607660 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22faec47-96dc-4f6b-b74d-ffe1825c7b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:47.607940 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22faec47-96dc-4f6b-b74d-ffe1825c7b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:47.608253 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22faec47-96dc-4f6b-b74d-ffe1825c7b03 admin admin] PATH_INFO: `/v3/projects/3287351a8297461d948543c5fa2d667e/users/dcd571089fde4bf38a3f3156d7404a7c/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:47.610310 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22faec47-96dc-4f6b-b74d-ffe1825c7b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3287351a8297461d948543c5fa2d667e, user_id=dcd571089fde4bf38a3f3156d7404a7c, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:47.612960 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22faec47-96dc-4f6b-b74d-ffe1825c7b03 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:47.614743 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c52415-b471-43c4-828c-7cf8eea6d08f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:47.619526 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce0463-5e40-45e2-80f5-f00735cbb675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:47.620180 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce0463-5e40-45e2-80f5-f00735cbb675 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:47.620468 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce0463-5e40-45e2-80f5-f00735cbb675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:47.620754 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce0463-5e40-45e2-80f5-f00735cbb675 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:47.621456 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce0463-5e40-45e2-80f5-f00735cbb675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:47.623213 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1285/2566] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:11:47 2021] PUT /identity/v3/projects/3287351a8297461d948543c5fa2d667e/users/dcd571089fde4bf38a3f3156d7404a7c/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:11:47.631614 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce0463-5e40-45e2-80f5-f00735cbb675 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:47.634083 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a75f5-9454-471b-ad0a-efbe20096300 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:47.634550 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a75f5-9454-471b-ad0a-efbe20096300 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:47.634910 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a75f5-9454-471b-ad0a-efbe20096300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:47.647610 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1282/2567] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:11:47 2021] POST /identity/v3/users => generated 300 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:11:47.648581 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce0463-5e40-45e2-80f5-f00735cbb675 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:47.658494 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce0463-5e40-45e2-80f5-f00735cbb675 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:47.661932 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-340a75f5-9454-471b-ad0a-efbe20096300 None None] MFA Rules not processed for user `dcd571089fde4bf38a3f3156d7404a7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:11:47.663122 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-340a75f5-9454-471b-ad0a-efbe20096300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:47.712911 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2227c-2e86-41de-8e6c-9d12e51762aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:47.713604 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2227c-2e86-41de-8e6c-9d12e51762aa admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:47.713897 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2227c-2e86-41de-8e6c-9d12e51762aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:47.714183 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2227c-2e86-41de-8e6c-9d12e51762aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:47.714928 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2227c-2e86-41de-8e6c-9d12e51762aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:47.716509 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2227c-2e86-41de-8e6c-9d12e51762aa admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:47.726022 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1283/2568] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:11:47 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:11:47.728098 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1286/2569] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:11:47 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:11:47.729946 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2227c-2e86-41de-8e6c-9d12e51762aa admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:47.737990 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a75f5-9454-471b-ad0a-efbe20096300 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:47.739374 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-340a75f5-9454-471b-ad0a-efbe20096300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:47.739664 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2227c-2e86-41de-8e6c-9d12e51762aa admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:47.744951 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff810170-4491-49a3-87b8-2e22fd4364e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:47.745852 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff810170-4491-49a3-87b8-2e22fd4364e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:47.746149 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff810170-4491-49a3-87b8-2e22fd4364e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:47.746431 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff810170-4491-49a3-87b8-2e22fd4364e6 admin admin] PATH_INFO: `/v3/projects/318d2befbb444058b859d1c249bcd455/users/87a5212290324034ab07239e0c9d5bd3/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:47.761193 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff810170-4491-49a3-87b8-2e22fd4364e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=318d2befbb444058b859d1c249bcd455, user_id=87a5212290324034ab07239e0c9d5bd3, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:47.763852 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff810170-4491-49a3-87b8-2e22fd4364e6 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:47.777926 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1284/2570] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:11:47 2021] PUT /identity/v3/projects/318d2befbb444058b859d1c249bcd455/users/87a5212290324034ab07239e0c9d5bd3/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:11:47.781774 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff810170-4491-49a3-87b8-2e22fd4364e6 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:47.798844 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a75f5-9454-471b-ad0a-efbe20096300 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:47.849210 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff810170-4491-49a3-87b8-2e22fd4364e6 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:47.851336 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa371ca-298f-436f-9724-19a19aff3c5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:47.852308 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa371ca-298f-436f-9724-19a19aff3c5b service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:47.852619 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa371ca-298f-436f-9724-19a19aff3c5b service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:47.852981 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa371ca-298f-436f-9724-19a19aff3c5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:47.854225 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a05730-1cde-4ebe-b0b6-73de46688243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:47.854897 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a05730-1cde-4ebe-b0b6-73de46688243 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:47.855223 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a05730-1cde-4ebe-b0b6-73de46688243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:47.855468 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a05730-1cde-4ebe-b0b6-73de46688243 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:47.856206 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a05730-1cde-4ebe-b0b6-73de46688243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:47.857875 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a05730-1cde-4ebe-b0b6-73de46688243 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:47.869194 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1285/2571] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:11:47 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:11:47.873365 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a05730-1cde-4ebe-b0b6-73de46688243 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:47.883432 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a05730-1cde-4ebe-b0b6-73de46688243 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:47.889458 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4e1ba-f3fd-481e-9324-6e5256aaabe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:47.890382 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4e1ba-f3fd-481e-9324-6e5256aaabe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:47.890673 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4e1ba-f3fd-481e-9324-6e5256aaabe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:47.890953 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4e1ba-f3fd-481e-9324-6e5256aaabe7 admin admin] PATH_INFO: `/v3/projects/318d2befbb444058b859d1c249bcd455/users/87a5212290324034ab07239e0c9d5bd3/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:47.892991 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4e1ba-f3fd-481e-9324-6e5256aaabe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=318d2befbb444058b859d1c249bcd455, user_id=87a5212290324034ab07239e0c9d5bd3, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:47.895727 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4e1ba-f3fd-481e-9324-6e5256aaabe7 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:47.907008 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1286/2572] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:11:47 2021] PUT /identity/v3/projects/318d2befbb444058b859d1c249bcd455/users/87a5212290324034ab07239e0c9d5bd3/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:11:47.917455 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97c2f7-f627-4cef-8025-1cefac88ebbf None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:47.917788 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97c2f7-f627-4cef-8025-1cefac88ebbf None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:47.918113 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97c2f7-f627-4cef-8025-1cefac88ebbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:47.922299 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa371ca-298f-436f-9724-19a19aff3c5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:47.924661 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa371ca-298f-436f-9724-19a19aff3c5b service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:47.935561 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1287/2573] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:11:47 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 02:11:47.947979 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-9c97c2f7-f627-4cef-8025-1cefac88ebbf None None] MFA Rules not processed for user `87a5212290324034ab07239e0c9d5bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:11:47.949198 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-9c97c2f7-f627-4cef-8025-1cefac88ebbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:48.008645 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa371ca-298f-436f-9724-19a19aff3c5b service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:48.017711 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa371ca-298f-436f-9724-19a19aff3c5b service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:48.017883 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1287/2574] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:11:47 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:11:48.028072 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97c2f7-f627-4cef-8025-1cefac88ebbf None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:48.029407 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-9c97c2f7-f627-4cef-8025-1cefac88ebbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:48.067997 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a463f2-930f-4a90-9d60-d115c375802a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:48.068643 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a463f2-930f-4a90-9d60-d115c375802a service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:48.068925 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a463f2-930f-4a90-9d60-d115c375802a service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:48.069225 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a463f2-930f-4a90-9d60-d115c375802a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:48.084757 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97c2f7-f627-4cef-8025-1cefac88ebbf None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:48.089124 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625afad4-3cd4-40ab-aa7b-aad7dd261c4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:48.089872 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625afad4-3cd4-40ab-aa7b-aad7dd261c4f service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:48.090155 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625afad4-3cd4-40ab-aa7b-aad7dd261c4f service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:48.090430 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625afad4-3cd4-40ab-aa7b-aad7dd261c4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:48.099304 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625afad4-3cd4-40ab-aa7b-aad7dd261c4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:48.100714 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625afad4-3cd4-40ab-aa7b-aad7dd261c4f service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:48.110346 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1288/2575] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:11:48 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 02:11:48.130367 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a463f2-930f-4a90-9d60-d115c375802a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:48.132128 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a463f2-930f-4a90-9d60-d115c375802a service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:48.141797 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1288/2576] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:11:48 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 02:11:48.175168 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625afad4-3cd4-40ab-aa7b-aad7dd261c4f service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:48.239078 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625afad4-3cd4-40ab-aa7b-aad7dd261c4f service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:48.245798 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2abee4-b51c-406c-bfd8-8dd96d6f1a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:48.246743 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2abee4-b51c-406c-bfd8-8dd96d6f1a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:48.247102 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2abee4-b51c-406c-bfd8-8dd96d6f1a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:48.247458 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2abee4-b51c-406c-bfd8-8dd96d6f1a54 admin admin] PATH_INFO: `/v3/users/65059766b593478aa54e009ba16d73e8` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:48.248903 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2abee4-b51c-406c-bfd8-8dd96d6f1a54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65059766b593478aa54e009ba16d73e8)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:48.251076 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2abee4-b51c-406c-bfd8-8dd96d6f1a54 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:48.301124 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-ec2abee4-b51c-406c-bfd8-8dd96d6f1a54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65059766b593478aa54e009ba16d73e8'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:48.308713 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-ec2abee4-b51c-406c-bfd8-8dd96d6f1a54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65059766b593478aa54e009ba16d73e8'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:48.309401 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-ec2abee4-b51c-406c-bfd8-8dd96d6f1a54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65059766b593478aa54e009ba16d73e8'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:48.321207 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-ec2abee4-b51c-406c-bfd8-8dd96d6f1a54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65059766b593478aa54e009ba16d73e8'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:48.328500 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-ec2abee4-b51c-406c-bfd8-8dd96d6f1a54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65059766b593478aa54e009ba16d73e8'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:48.334381 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1289/2577] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:11:48 2021] DELETE /identity/v3/users/65059766b593478aa54e009ba16d73e8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:11:48.338940 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961270a-0be1-4803-a879-90f5bad89419 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:48.339356 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961270a-0be1-4803-a879-90f5bad89419 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:48.339661 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961270a-0be1-4803-a879-90f5bad89419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:48.357072 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-0961270a-0be1-4803-a879-90f5bad89419 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:11:48.358292 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-0961270a-0be1-4803-a879-90f5bad89419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:48.412989 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1289/2578] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:11:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:11:48.423385 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2abee4-b51c-406c-bfd8-8dd96d6f1a54 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:48.425014 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-ec2abee4-b51c-406c-bfd8-8dd96d6f1a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:48.478746 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2abee4-b51c-406c-bfd8-8dd96d6f1a54 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:48.482598 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cca37-d4b3-45dd-8d41-2bb7b4300f87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:48.483244 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cca37-d4b3-45dd-8d41-2bb7b4300f87 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:48.483533 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cca37-d4b3-45dd-8d41-2bb7b4300f87 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:48.483815 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cca37-d4b3-45dd-8d41-2bb7b4300f87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:48.492990 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cca37-d4b3-45dd-8d41-2bb7b4300f87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:48.494474 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cca37-d4b3-45dd-8d41-2bb7b4300f87 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:48.503840 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1290/2579] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:11:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:11:48.756955 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961270a-0be1-4803-a879-90f5bad89419 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:48.758450 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-0961270a-0be1-4803-a879-90f5bad89419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:48.770451 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961270a-0be1-4803-a879-90f5bad89419 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:48.775543 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0463ab-f4ca-426d-bb57-fa4fcbd3b4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:48.776404 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0463ab-f4ca-426d-bb57-fa4fcbd3b4c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:48.776687 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0463ab-f4ca-426d-bb57-fa4fcbd3b4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:48.776964 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0463ab-f4ca-426d-bb57-fa4fcbd3b4c5 admin admin] PATH_INFO: `/v3/projects/c77a0b0224374ad783775c49774041e1` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:48.778183 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0463ab-f4ca-426d-bb57-fa4fcbd3b4c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c77a0b0224374ad783775c49774041e1)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:48.780308 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0463ab-f4ca-426d-bb57-fa4fcbd3b4c5 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:48.826951 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-bb0463ab-f4ca-426d-bb57-fa4fcbd3b4c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c77a0b0224374ad783775c49774041e1', 'request_id': 'req-bb0463ab-f4ca-426d-bb57-fa4fcbd3b4c5'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:48.832240 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-bb0463ab-f4ca-426d-bb57-fa4fcbd3b4c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c77a0b0224374ad783775c49774041e1', 'request_id': 'req-bb0463ab-f4ca-426d-bb57-fa4fcbd3b4c5'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:48.840397 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-bb0463ab-f4ca-426d-bb57-fa4fcbd3b4c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c77a0b0224374ad783775c49774041e1', 'request_id': 'req-bb0463ab-f4ca-426d-bb57-fa4fcbd3b4c5'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:48.851236 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-bb0463ab-f4ca-426d-bb57-fa4fcbd3b4c5 admin admin] The token cache is being invalidate because project c77a0b0224374ad783775c49774041e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:11:48.851582 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-bb0463ab-f4ca-426d-bb57-fa4fcbd3b4c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:48.852255 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-bb0463ab-f4ca-426d-bb57-fa4fcbd3b4c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:48.853840 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1290/2580] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:11:48 2021] DELETE /identity/v3/projects/c77a0b0224374ad783775c49774041e1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:11:48.857818 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cca37-d4b3-45dd-8d41-2bb7b4300f87 service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:48.867116 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cca37-d4b3-45dd-8d41-2bb7b4300f87 service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:48.919841 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557fa99-3ddb-433b-93bb-1bfa0a8a3d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:48.920717 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557fa99-3ddb-433b-93bb-1bfa0a8a3d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:48.920976 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557fa99-3ddb-433b-93bb-1bfa0a8a3d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:48.921248 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557fa99-3ddb-433b-93bb-1bfa0a8a3d40 admin admin] PATH_INFO: `/v3/users/87a5212290324034ab07239e0c9d5bd3` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:48.922467 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557fa99-3ddb-433b-93bb-1bfa0a8a3d40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87a5212290324034ab07239e0c9d5bd3)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:48.924617 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557fa99-3ddb-433b-93bb-1bfa0a8a3d40 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:48.970816 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-2557fa99-3ddb-433b-93bb-1bfa0a8a3d40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87a5212290324034ab07239e0c9d5bd3'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:48.977362 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-2557fa99-3ddb-433b-93bb-1bfa0a8a3d40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87a5212290324034ab07239e0c9d5bd3'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:48.978109 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-2557fa99-3ddb-433b-93bb-1bfa0a8a3d40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87a5212290324034ab07239e0c9d5bd3'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:48.989358 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-2557fa99-3ddb-433b-93bb-1bfa0a8a3d40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87a5212290324034ab07239e0c9d5bd3'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:48.995803 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-2557fa99-3ddb-433b-93bb-1bfa0a8a3d40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87a5212290324034ab07239e0c9d5bd3'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:49.001700 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1291/2581] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:11:48 2021] DELETE /identity/v3/users/87a5212290324034ab07239e0c9d5bd3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:11:49.274843 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0463ab-f4ca-426d-bb57-fa4fcbd3b4c5 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:49.276394 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-bb0463ab-f4ca-426d-bb57-fa4fcbd3b4c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:49.290244 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0463ab-f4ca-426d-bb57-fa4fcbd3b4c5 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:49.348414 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27281245-590b-45f0-a412-06ca86879b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:49.349218 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27281245-590b-45f0-a412-06ca86879b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:49.349540 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27281245-590b-45f0-a412-06ca86879b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:49.349826 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27281245-590b-45f0-a412-06ca86879b96 admin admin] PATH_INFO: `/v3/projects/318d2befbb444058b859d1c249bcd455` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:49.351022 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27281245-590b-45f0-a412-06ca86879b96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=318d2befbb444058b859d1c249bcd455)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:49.352973 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27281245-590b-45f0-a412-06ca86879b96 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:49.398898 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-27281245-590b-45f0-a412-06ca86879b96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '318d2befbb444058b859d1c249bcd455', 'request_id': 'req-27281245-590b-45f0-a412-06ca86879b96'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:49.404041 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-27281245-590b-45f0-a412-06ca86879b96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '318d2befbb444058b859d1c249bcd455', 'request_id': 'req-27281245-590b-45f0-a412-06ca86879b96'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:49.411607 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-27281245-590b-45f0-a412-06ca86879b96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '318d2befbb444058b859d1c249bcd455', 'request_id': 'req-27281245-590b-45f0-a412-06ca86879b96'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:49.422647 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-27281245-590b-45f0-a412-06ca86879b96 admin admin] The token cache is being invalidate because project 318d2befbb444058b859d1c249bcd455 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:11:49.422938 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-27281245-590b-45f0-a412-06ca86879b96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:49.423592 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-27281245-590b-45f0-a412-06ca86879b96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:49.425385 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1291/2582] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:11:49 2021] DELETE /identity/v3/projects/318d2befbb444058b859d1c249bcd455 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:11:49.432379 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f29981-f56f-4f74-8b61-325cb645b8b5 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:49.432896 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f29981-f56f-4f74-8b61-325cb645b8b5 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:49.433022 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f29981-f56f-4f74-8b61-325cb645b8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:49.455269 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-24f29981-f56f-4f74-8b61-325cb645b8b5 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:11:49.455912 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-24f29981-f56f-4f74-8b61-325cb645b8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:49.519164 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1292/2583] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:11:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:11:49.527877 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f34dd-c04c-4057-8ac5-a9680fa612f8 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:49.528293 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f34dd-c04c-4057-8ac5-a9680fa612f8 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:49.528673 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f34dd-c04c-4057-8ac5-a9680fa612f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:49.547625 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-a01f34dd-c04c-4057-8ac5-a9680fa612f8 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:11:49.548936 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-a01f34dd-c04c-4057-8ac5-a9680fa612f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:49.561886 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1292/2584] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:11:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:11:49.563851 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f29981-f56f-4f74-8b61-325cb645b8b5 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:49.574142 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f29981-f56f-4f74-8b61-325cb645b8b5 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:49.587687 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b4832-8ef5-429c-84e3-ed5207f6e462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:49.587687 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b4832-8ef5-429c-84e3-ed5207f6e462 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:49.587687 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b4832-8ef5-429c-84e3-ed5207f6e462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:49.587687 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b4832-8ef5-429c-84e3-ed5207f6e462 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:49.588099 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b4832-8ef5-429c-84e3-ed5207f6e462 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 02:11:49.588099 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b4832-8ef5-429c-84e3-ed5207f6e462 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:49.588099 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b4832-8ef5-429c-84e3-ed5207f6e462 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:49.600884 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1293/2585] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 02:11:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 02:11:49.602012 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f34dd-c04c-4057-8ac5-a9680fa612f8 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:49.613221 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f34dd-c04c-4057-8ac5-a9680fa612f8 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:49.618917 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb792f7-ba8c-4ee1-8e76-bfeddeaeaa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:49.619687 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb792f7-ba8c-4ee1-8e76-bfeddeaeaa63 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:49.620073 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb792f7-ba8c-4ee1-8e76-bfeddeaeaa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:49.620453 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb792f7-ba8c-4ee1-8e76-bfeddeaeaa63 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:49.621240 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb792f7-ba8c-4ee1-8e76-bfeddeaeaa63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:49.623228 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb792f7-ba8c-4ee1-8e76-bfeddeaeaa63 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:49.651241 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1293/2586] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:11:49 2021] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:11:49.655367 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b4832-8ef5-429c-84e3-ed5207f6e462 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:49.666293 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b4832-8ef5-429c-84e3-ed5207f6e462 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:49.720738 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd6a6b-0d32-4f14-8ed6-66bef792b505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:49.721396 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd6a6b-0d32-4f14-8ed6-66bef792b505 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:49.721712 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd6a6b-0d32-4f14-8ed6-66bef792b505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:49.721991 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd6a6b-0d32-4f14-8ed6-66bef792b505 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:49.722700 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd6a6b-0d32-4f14-8ed6-66bef792b505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:49.724625 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd6a6b-0d32-4f14-8ed6-66bef792b505 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:49.745888 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1294/2587] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:11:49 2021] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:11:49.749987 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb792f7-ba8c-4ee1-8e76-bfeddeaeaa63 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:49.760321 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb792f7-ba8c-4ee1-8e76-bfeddeaeaa63 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:49.764904 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f80ff-2727-4a48-90be-2b2f3d9a0734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:49.765591 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f80ff-2727-4a48-90be-2b2f3d9a0734 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:49.765875 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f80ff-2727-4a48-90be-2b2f3d9a0734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:49.766151 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f80ff-2727-4a48-90be-2b2f3d9a0734 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:49.766884 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f80ff-2727-4a48-90be-2b2f3d9a0734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:49.768447 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f80ff-2727-4a48-90be-2b2f3d9a0734 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:49.778499 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1294/2588] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:11:49 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:11:49.782222 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd6a6b-0d32-4f14-8ed6-66bef792b505 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:49.792168 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd6a6b-0d32-4f14-8ed6-66bef792b505 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:49.796762 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a0320-bb33-4e98-afce-f1d3adc0ce22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:49.797399 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a0320-bb33-4e98-afce-f1d3adc0ce22 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:49.797709 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a0320-bb33-4e98-afce-f1d3adc0ce22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:49.797985 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a0320-bb33-4e98-afce-f1d3adc0ce22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:49.798712 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a0320-bb33-4e98-afce-f1d3adc0ce22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:49.800535 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a0320-bb33-4e98-afce-f1d3adc0ce22 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:49.810740 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1295/2589] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:11:49 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:11:49.814429 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f80ff-2727-4a48-90be-2b2f3d9a0734 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:49.823963 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f80ff-2727-4a48-90be-2b2f3d9a0734 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:49.828526 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366495a4-3c53-4782-abe3-76b3f046e4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:49.829379 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366495a4-3c53-4782-abe3-76b3f046e4f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:49.829688 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366495a4-3c53-4782-abe3-76b3f046e4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:49.829966 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366495a4-3c53-4782-abe3-76b3f046e4f1 admin admin] PATH_INFO: `/v3/projects/d6f8e181d87740ca8d40b99c7a033376/users/5c053609327742308ad846bdecc5ed2c/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:49.843631 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366495a4-3c53-4782-abe3-76b3f046e4f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6f8e181d87740ca8d40b99c7a033376, user_id=5c053609327742308ad846bdecc5ed2c, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:49.846259 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366495a4-3c53-4782-abe3-76b3f046e4f1 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:49.858970 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1295/2590] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:11:49 2021] PUT /identity/v3/projects/d6f8e181d87740ca8d40b99c7a033376/users/5c053609327742308ad846bdecc5ed2c/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:11:49.870523 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa180bd0-9c5f-47fa-ada7-d3277ece629b None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:49.870819 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa180bd0-9c5f-47fa-ada7-d3277ece629b None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:49.871101 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa180bd0-9c5f-47fa-ada7-d3277ece629b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:49.897316 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-aa180bd0-9c5f-47fa-ada7-d3277ece629b None None] MFA Rules not processed for user `5c053609327742308ad846bdecc5ed2c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:11:49.898619 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-aa180bd0-9c5f-47fa-ada7-d3277ece629b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:49.964715 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1296/2591] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:11:49 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:11:49.969101 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366495a4-3c53-4782-abe3-76b3f046e4f1 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:50.027740 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366495a4-3c53-4782-abe3-76b3f046e4f1 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:50.032399 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642c657-4810-4eca-a7bd-269bb97d5525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:50.033046 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642c657-4810-4eca-a7bd-269bb97d5525 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:50.033335 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642c657-4810-4eca-a7bd-269bb97d5525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:50.033648 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642c657-4810-4eca-a7bd-269bb97d5525 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:50.034382 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642c657-4810-4eca-a7bd-269bb97d5525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:50.036265 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642c657-4810-4eca-a7bd-269bb97d5525 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:50.060500 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1296/2592] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:11:49 2021] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:11:50.064500 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa180bd0-9c5f-47fa-ada7-d3277ece629b None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:50.074898 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa180bd0-9c5f-47fa-ada7-d3277ece629b None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:50.127926 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2f028-e5c6-4217-8161-02640cb4c61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:50.128581 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2f028-e5c6-4217-8161-02640cb4c61b admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:50.128865 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2f028-e5c6-4217-8161-02640cb4c61b admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:50.129158 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2f028-e5c6-4217-8161-02640cb4c61b admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:50.129869 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2f028-e5c6-4217-8161-02640cb4c61b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:50.131757 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2f028-e5c6-4217-8161-02640cb4c61b admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:50.150519 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1297/2593] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:11:50 2021] POST /identity/v3/users => generated 292 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:11:50.155013 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642c657-4810-4eca-a7bd-269bb97d5525 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:50.165036 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642c657-4810-4eca-a7bd-269bb97d5525 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:50.170331 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aee610-f790-4cc6-ad4b-7e0f953ff313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:50.170980 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aee610-f790-4cc6-ad4b-7e0f953ff313 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:50.171266 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aee610-f790-4cc6-ad4b-7e0f953ff313 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:50.171546 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aee610-f790-4cc6-ad4b-7e0f953ff313 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:50.172285 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aee610-f790-4cc6-ad4b-7e0f953ff313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:50.173901 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aee610-f790-4cc6-ad4b-7e0f953ff313 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:50.184401 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1297/2594] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:11:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:11:50.188135 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2f028-e5c6-4217-8161-02640cb4c61b admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:50.197879 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2f028-e5c6-4217-8161-02640cb4c61b admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:50.202641 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02efd7-c7f5-40c4-8e8d-b408c6f27b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:50.203290 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02efd7-c7f5-40c4-8e8d-b408c6f27b51 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:50.203578 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02efd7-c7f5-40c4-8e8d-b408c6f27b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:50.203860 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02efd7-c7f5-40c4-8e8d-b408c6f27b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:50.204628 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02efd7-c7f5-40c4-8e8d-b408c6f27b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:50.206354 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02efd7-c7f5-40c4-8e8d-b408c6f27b51 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:50.216458 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1298/2595] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:11:50 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:11:50.220282 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aee610-f790-4cc6-ad4b-7e0f953ff313 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:50.230627 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aee610-f790-4cc6-ad4b-7e0f953ff313 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:50.235188 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd97271-9ada-4888-a9cb-50ed3561a426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:50.236049 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd97271-9ada-4888-a9cb-50ed3561a426 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:50.236332 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd97271-9ada-4888-a9cb-50ed3561a426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:50.236611 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd97271-9ada-4888-a9cb-50ed3561a426 admin admin] PATH_INFO: `/v3/projects/411529664f7a4300a7979c1b4c95e403/users/378a16cedd5a4161b0d5bde77f86fb69/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:50.250345 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd97271-9ada-4888-a9cb-50ed3561a426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=411529664f7a4300a7979c1b4c95e403, user_id=378a16cedd5a4161b0d5bde77f86fb69, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:50.252930 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd97271-9ada-4888-a9cb-50ed3561a426 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:50.265900 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1298/2596] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:11:50 2021] PUT /identity/v3/projects/411529664f7a4300a7979c1b4c95e403/users/378a16cedd5a4161b0d5bde77f86fb69/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:11:50.276334 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e21f4-6ceb-4833-8454-0451065a1bf2 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:50.276625 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e21f4-6ceb-4833-8454-0451065a1bf2 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:50.276903 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e21f4-6ceb-4833-8454-0451065a1bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:50.302314 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-ba5e21f4-6ceb-4833-8454-0451065a1bf2 None None] MFA Rules not processed for user `378a16cedd5a4161b0d5bde77f86fb69`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:11:50.303489 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-ba5e21f4-6ceb-4833-8454-0451065a1bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:50.363545 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1299/2597] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:11:50 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:11:50.367869 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd97271-9ada-4888-a9cb-50ed3561a426 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:50.426046 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd97271-9ada-4888-a9cb-50ed3561a426 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:50.430575 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8a9a4-ec33-4b32-879f-d96b65e8f5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:50.431217 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8a9a4-ec33-4b32-879f-d96b65e8f5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:50.431502 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8a9a4-ec33-4b32-879f-d96b65e8f5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:50.431780 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8a9a4-ec33-4b32-879f-d96b65e8f5f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:50.432486 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8a9a4-ec33-4b32-879f-d96b65e8f5f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:50.434403 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8a9a4-ec33-4b32-879f-d96b65e8f5f4 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:50.458115 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1299/2598] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:11:50 2021] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:11:50.462113 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e21f4-6ceb-4833-8454-0451065a1bf2 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:50.473069 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e21f4-6ceb-4833-8454-0451065a1bf2 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:50.525355 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcbcdd-4ec0-49b9-9b9d-a089891a1f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:50.526663 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcbcdd-4ec0-49b9-9b9d-a089891a1f6a admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:50.526949 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcbcdd-4ec0-49b9-9b9d-a089891a1f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:50.527222 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcbcdd-4ec0-49b9-9b9d-a089891a1f6a admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:50.527918 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfcbcdd-4ec0-49b9-9b9d-a089891a1f6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:50.529843 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfcbcdd-4ec0-49b9-9b9d-a089891a1f6a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:50.548649 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1300/2599] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:11:50 2021] POST /identity/v3/users => generated 298 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:11:50.552963 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8a9a4-ec33-4b32-879f-d96b65e8f5f4 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:50.563030 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8a9a4-ec33-4b32-879f-d96b65e8f5f4 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:50.567676 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30938d4b-c886-4601-9e28-e5c7547dc489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:50.568333 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30938d4b-c886-4601-9e28-e5c7547dc489 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:50.568625 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30938d4b-c886-4601-9e28-e5c7547dc489 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:50.568909 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30938d4b-c886-4601-9e28-e5c7547dc489 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:50.569698 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30938d4b-c886-4601-9e28-e5c7547dc489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:50.571274 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30938d4b-c886-4601-9e28-e5c7547dc489 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:50.582025 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1300/2600] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:11:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:11:50.585879 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcbcdd-4ec0-49b9-9b9d-a089891a1f6a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:50.596184 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcbcdd-4ec0-49b9-9b9d-a089891a1f6a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:50.600748 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d187053-fa5c-4181-926a-3e2279ad4940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:50.601651 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d187053-fa5c-4181-926a-3e2279ad4940 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:50.601937 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d187053-fa5c-4181-926a-3e2279ad4940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:50.602214 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d187053-fa5c-4181-926a-3e2279ad4940 admin admin] PATH_INFO: `/v3/projects/d0c4c5d7e3fc4547805c698e4de627ca/users/a90a1c2d671345bb914c12418987f8d8/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:50.617080 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d187053-fa5c-4181-926a-3e2279ad4940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c4c5d7e3fc4547805c698e4de627ca, user_id=a90a1c2d671345bb914c12418987f8d8, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:50.620559 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d187053-fa5c-4181-926a-3e2279ad4940 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:50.633562 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1301/2601] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:11:50 2021] PUT /identity/v3/projects/d0c4c5d7e3fc4547805c698e4de627ca/users/a90a1c2d671345bb914c12418987f8d8/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:11:50.638141 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30938d4b-c886-4601-9e28-e5c7547dc489 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:50.648103 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30938d4b-c886-4601-9e28-e5c7547dc489 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:50.704067 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de478b-ba17-44b8-ab86-b30bef31193d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:50.704743 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de478b-ba17-44b8-ab86-b30bef31193d admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:50.705029 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de478b-ba17-44b8-ab86-b30bef31193d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:50.705310 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de478b-ba17-44b8-ab86-b30bef31193d admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:50.706093 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de478b-ba17-44b8-ab86-b30bef31193d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:50.707661 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de478b-ba17-44b8-ab86-b30bef31193d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:50.720415 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1301/2602] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:11:50 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:11:50.724100 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d187053-fa5c-4181-926a-3e2279ad4940 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:50.734547 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d187053-fa5c-4181-926a-3e2279ad4940 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:50.739220 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3aac51-be5c-45c0-8dda-087efb4ce45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:50.740150 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3aac51-be5c-45c0-8dda-087efb4ce45b admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:50.740440 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3aac51-be5c-45c0-8dda-087efb4ce45b admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:50.740719 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3aac51-be5c-45c0-8dda-087efb4ce45b admin admin] PATH_INFO: `/v3/projects/d0c4c5d7e3fc4547805c698e4de627ca/users/a90a1c2d671345bb914c12418987f8d8/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:50.742695 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3aac51-be5c-45c0-8dda-087efb4ce45b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c4c5d7e3fc4547805c698e4de627ca, user_id=a90a1c2d671345bb914c12418987f8d8, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:50.745878 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3aac51-be5c-45c0-8dda-087efb4ce45b admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:50.756528 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1302/2603] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:11:50 2021] PUT /identity/v3/projects/d0c4c5d7e3fc4547805c698e4de627ca/users/a90a1c2d671345bb914c12418987f8d8/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:11:50.767599 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49a526-597e-4003-b840-4b7056d706b1 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:50.768116 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49a526-597e-4003-b840-4b7056d706b1 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:50.768224 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49a526-597e-4003-b840-4b7056d706b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:50.797361 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-bb49a526-597e-4003-b840-4b7056d706b1 None None] MFA Rules not processed for user `a90a1c2d671345bb914c12418987f8d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:11:50.798658 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-bb49a526-597e-4003-b840-4b7056d706b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:50.867798 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1302/2604] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:11:50 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:11:50.878361 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3aac51-be5c-45c0-8dda-087efb4ce45b admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:50.880459 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-cb3aac51-be5c-45c0-8dda-087efb4ce45b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:50.937288 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3aac51-be5c-45c0-8dda-087efb4ce45b admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:50.940990 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772c146-51f6-4c20-bf2d-bcae3807b3cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:50.941675 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772c146-51f6-4c20-bf2d-bcae3807b3cf service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:50.941965 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772c146-51f6-4c20-bf2d-bcae3807b3cf service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:50.942244 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772c146-51f6-4c20-bf2d-bcae3807b3cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:50.952444 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772c146-51f6-4c20-bf2d-bcae3807b3cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:50.954250 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772c146-51f6-4c20-bf2d-bcae3807b3cf service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:50.964191 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1303/2605] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:11:50 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:11:51.427413 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49a526-597e-4003-b840-4b7056d706b1 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:51.436632 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49a526-597e-4003-b840-4b7056d706b1 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:51.440179 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682df7a-e3da-4d29-8c98-1021b1628ae4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:51.440838 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682df7a-e3da-4d29-8c98-1021b1628ae4 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:51.441121 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682df7a-e3da-4d29-8c98-1021b1628ae4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:51.441399 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682df7a-e3da-4d29-8c98-1021b1628ae4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:51.494795 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682df7a-e3da-4d29-8c98-1021b1628ae4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:51.496142 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682df7a-e3da-4d29-8c98-1021b1628ae4 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:51.504783 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1303/2606] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:11:51 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:11:58.197709 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772c146-51f6-4c20-bf2d-bcae3807b3cf service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:58.199116 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-5772c146-51f6-4c20-bf2d-bcae3807b3cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:58.260747 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772c146-51f6-4c20-bf2d-bcae3807b3cf service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:58.265358 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abeba28-fca0-44b4-a30c-2d595e198860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:58.266243 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abeba28-fca0-44b4-a30c-2d595e198860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:58.266532 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abeba28-fca0-44b4-a30c-2d595e198860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:58.266812 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abeba28-fca0-44b4-a30c-2d595e198860 admin admin] PATH_INFO: `/v3/users/97391c457d304d48814288ea45db4fed` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:58.268006 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abeba28-fca0-44b4-a30c-2d595e198860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97391c457d304d48814288ea45db4fed)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:58.269949 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abeba28-fca0-44b4-a30c-2d595e198860 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:58.314188 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-9abeba28-fca0-44b4-a30c-2d595e198860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97391c457d304d48814288ea45db4fed'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:58.320810 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-9abeba28-fca0-44b4-a30c-2d595e198860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97391c457d304d48814288ea45db4fed'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:58.321497 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-9abeba28-fca0-44b4-a30c-2d595e198860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97391c457d304d48814288ea45db4fed'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:58.332824 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-9abeba28-fca0-44b4-a30c-2d595e198860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97391c457d304d48814288ea45db4fed'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:58.341131 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-9abeba28-fca0-44b4-a30c-2d595e198860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97391c457d304d48814288ea45db4fed'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:58.346995 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1304/2607] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:11:58 2021] DELETE /identity/v3/users/97391c457d304d48814288ea45db4fed => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:11:58.351480 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7e3e8-411b-42b1-af95-c98f77e8754b None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:58.352018 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7e3e8-411b-42b1-af95-c98f77e8754b None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:58.352157 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7e3e8-411b-42b1-af95-c98f77e8754b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:58.369686 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-74d7e3e8-411b-42b1-af95-c98f77e8754b None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:11:58.370810 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-74d7e3e8-411b-42b1-af95-c98f77e8754b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:58.429103 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1304/2608] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:11:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:11:58.439020 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abeba28-fca0-44b4-a30c-2d595e198860 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:58.440435 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-9abeba28-fca0-44b4-a30c-2d595e198860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:58.499129 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abeba28-fca0-44b4-a30c-2d595e198860 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:58.502810 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c99121-321c-4bb6-af7d-5d1c2d542b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:58.503458 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c99121-321c-4bb6-af7d-5d1c2d542b47 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:58.503749 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c99121-321c-4bb6-af7d-5d1c2d542b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:58.504041 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c99121-321c-4bb6-af7d-5d1c2d542b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:58.513878 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c99121-321c-4bb6-af7d-5d1c2d542b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:58.515304 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c99121-321c-4bb6-af7d-5d1c2d542b47 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:58.524837 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1305/2609] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:11:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:11:58.556160 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7e3e8-411b-42b1-af95-c98f77e8754b None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:58.557698 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-74d7e3e8-411b-42b1-af95-c98f77e8754b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:58.615024 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7e3e8-411b-42b1-af95-c98f77e8754b None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:58.618767 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3a0a1-93aa-4075-9612-b09d77d5037e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:58.619489 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3a0a1-93aa-4075-9612-b09d77d5037e service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:58.619932 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3a0a1-93aa-4075-9612-b09d77d5037e service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:58.620342 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3a0a1-93aa-4075-9612-b09d77d5037e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:58.622273 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-efa3a0a1-93aa-4075-9612-b09d77d5037e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:58.680550 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3a0a1-93aa-4075-9612-b09d77d5037e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:58.682015 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3a0a1-93aa-4075-9612-b09d77d5037e service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:58.690844 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1305/2610] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:11:58 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:11:58.810258 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c99121-321c-4bb6-af7d-5d1c2d542b47 service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:58.811727 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-d4c99121-321c-4bb6-af7d-5d1c2d542b47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:58.832241 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c99121-321c-4bb6-af7d-5d1c2d542b47 service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:58.836947 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad07869-701d-49e2-9d44-0f9c7d4e9211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:58.837865 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad07869-701d-49e2-9d44-0f9c7d4e9211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:58.838147 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad07869-701d-49e2-9d44-0f9c7d4e9211 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:58.838421 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad07869-701d-49e2-9d44-0f9c7d4e9211 admin admin] PATH_INFO: `/v3/projects/f4d8edc762904b8fa731349f25986cdd` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:58.840259 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad07869-701d-49e2-9d44-0f9c7d4e9211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4d8edc762904b8fa731349f25986cdd)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:58.842260 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad07869-701d-49e2-9d44-0f9c7d4e9211 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:58.891008 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4ad07869-701d-49e2-9d44-0f9c7d4e9211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4d8edc762904b8fa731349f25986cdd', 'request_id': 'req-4ad07869-701d-49e2-9d44-0f9c7d4e9211'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:58.896210 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4ad07869-701d-49e2-9d44-0f9c7d4e9211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4d8edc762904b8fa731349f25986cdd', 'request_id': 'req-4ad07869-701d-49e2-9d44-0f9c7d4e9211'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:58.903302 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4ad07869-701d-49e2-9d44-0f9c7d4e9211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4d8edc762904b8fa731349f25986cdd', 'request_id': 'req-4ad07869-701d-49e2-9d44-0f9c7d4e9211'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:58.914368 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4ad07869-701d-49e2-9d44-0f9c7d4e9211 admin admin] The token cache is being invalidate because project f4d8edc762904b8fa731349f25986cdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:11:58.914623 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4ad07869-701d-49e2-9d44-0f9c7d4e9211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:58.915259 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-4ad07869-701d-49e2-9d44-0f9c7d4e9211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:58.917026 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1306/2611] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:11:58 2021] DELETE /identity/v3/projects/f4d8edc762904b8fa731349f25986cdd => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:11:58.921069 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3a0a1-93aa-4075-9612-b09d77d5037e service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:58.932989 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3a0a1-93aa-4075-9612-b09d77d5037e service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:58.990343 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb655042-ac54-4556-a853-0418f6f1731e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:58.991477 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb655042-ac54-4556-a853-0418f6f1731e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:58.991785 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb655042-ac54-4556-a853-0418f6f1731e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:58.992119 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb655042-ac54-4556-a853-0418f6f1731e admin admin] PATH_INFO: `/v3/users/dcd571089fde4bf38a3f3156d7404a7c` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:58.993391 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb655042-ac54-4556-a853-0418f6f1731e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd571089fde4bf38a3f3156d7404a7c)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:58.995834 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb655042-ac54-4556-a853-0418f6f1731e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:59.044734 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-bb655042-ac54-4556-a853-0418f6f1731e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd571089fde4bf38a3f3156d7404a7c'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:59.053196 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-bb655042-ac54-4556-a853-0418f6f1731e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd571089fde4bf38a3f3156d7404a7c'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:59.060567 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-bb655042-ac54-4556-a853-0418f6f1731e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd571089fde4bf38a3f3156d7404a7c'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:59.061243 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-bb655042-ac54-4556-a853-0418f6f1731e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd571089fde4bf38a3f3156d7404a7c'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:59.073928 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-bb655042-ac54-4556-a853-0418f6f1731e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd571089fde4bf38a3f3156d7404a7c'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:59.085146 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1306/2612] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:11:58 2021] DELETE /identity/v3/users/dcd571089fde4bf38a3f3156d7404a7c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:11:59.361162 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad07869-701d-49e2-9d44-0f9c7d4e9211 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:59.362718 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4ad07869-701d-49e2-9d44-0f9c7d4e9211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:59.376211 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad07869-701d-49e2-9d44-0f9c7d4e9211 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:59.432128 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad5605-c729-4ac3-b193-59a35e91a9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:59.433661 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad5605-c729-4ac3-b193-59a35e91a9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:59.433952 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad5605-c729-4ac3-b193-59a35e91a9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:59.434236 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad5605-c729-4ac3-b193-59a35e91a9d0 admin admin] PATH_INFO: `/v3/projects/3287351a8297461d948543c5fa2d667e` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:59.435495 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad5605-c729-4ac3-b193-59a35e91a9d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3287351a8297461d948543c5fa2d667e)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:59.437389 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad5605-c729-4ac3-b193-59a35e91a9d0 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:59.482836 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b7ad5605-c729-4ac3-b193-59a35e91a9d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3287351a8297461d948543c5fa2d667e', 'request_id': 'req-b7ad5605-c729-4ac3-b193-59a35e91a9d0'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:59.488803 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b7ad5605-c729-4ac3-b193-59a35e91a9d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3287351a8297461d948543c5fa2d667e', 'request_id': 'req-b7ad5605-c729-4ac3-b193-59a35e91a9d0'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:59.496066 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b7ad5605-c729-4ac3-b193-59a35e91a9d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3287351a8297461d948543c5fa2d667e', 'request_id': 'req-b7ad5605-c729-4ac3-b193-59a35e91a9d0'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:59.507619 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b7ad5605-c729-4ac3-b193-59a35e91a9d0 admin admin] The token cache is being invalidate because project 3287351a8297461d948543c5fa2d667e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:11:59.507932 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b7ad5605-c729-4ac3-b193-59a35e91a9d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:59.508648 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b7ad5605-c729-4ac3-b193-59a35e91a9d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:11:59.510348 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1307/2613] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:11:59 2021] DELETE /identity/v3/projects/3287351a8297461d948543c5fa2d667e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:11:59.516631 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037a82e-8e9f-451a-a8ae-f3e78a3d0b09 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:59.517186 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037a82e-8e9f-451a-a8ae-f3e78a3d0b09 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:59.517315 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037a82e-8e9f-451a-a8ae-f3e78a3d0b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:59.534825 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-2037a82e-8e9f-451a-a8ae-f3e78a3d0b09 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:11:59.536105 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-2037a82e-8e9f-451a-a8ae-f3e78a3d0b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:59.596792 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1307/2614] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:11:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:11:59.606402 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34cfc1-76fa-48f1-b69a-1237cd5cab39 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:59.606693 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34cfc1-76fa-48f1-b69a-1237cd5cab39 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:59.606975 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34cfc1-76fa-48f1-b69a-1237cd5cab39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:59.624748 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-fd34cfc1-76fa-48f1-b69a-1237cd5cab39 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:11:59.625964 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-fd34cfc1-76fa-48f1-b69a-1237cd5cab39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:11:59.633669 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1308/2615] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:11:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:11:59.637833 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037a82e-8e9f-451a-a8ae-f3e78a3d0b09 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:59.647237 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037a82e-8e9f-451a-a8ae-f3e78a3d0b09 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:59.652506 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173c2d0-811f-4aff-9bf1-6fa27bae8fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:59.653164 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173c2d0-811f-4aff-9bf1-6fa27bae8fbf admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:59.653455 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173c2d0-811f-4aff-9bf1-6fa27bae8fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:59.653828 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173c2d0-811f-4aff-9bf1-6fa27bae8fbf admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:59.654596 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173c2d0-811f-4aff-9bf1-6fa27bae8fbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 02:11:59.654914 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173c2d0-811f-4aff-9bf1-6fa27bae8fbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:59.656496 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173c2d0-811f-4aff-9bf1-6fa27bae8fbf admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:59.668380 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1308/2616] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 02:11:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 02:11:59.672600 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34cfc1-76fa-48f1-b69a-1237cd5cab39 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:59.681749 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34cfc1-76fa-48f1-b69a-1237cd5cab39 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:59.686456 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4964d-84fb-48b6-ad90-5e892d52bb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:59.687098 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4964d-84fb-48b6-ad90-5e892d52bb55 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:59.687385 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4964d-84fb-48b6-ad90-5e892d52bb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:59.687666 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4964d-84fb-48b6-ad90-5e892d52bb55 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:59.688371 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4964d-84fb-48b6-ad90-5e892d52bb55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:59.690287 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4964d-84fb-48b6-ad90-5e892d52bb55 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:59.714997 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1309/2617] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:11:59 2021] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:11:59.719047 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173c2d0-811f-4aff-9bf1-6fa27bae8fbf admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:59.728757 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173c2d0-811f-4aff-9bf1-6fa27bae8fbf admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:59.783304 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add423f-d209-45aa-a03b-39b548d52f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:59.783961 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add423f-d209-45aa-a03b-39b548d52f57 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:59.784247 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add423f-d209-45aa-a03b-39b548d52f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:59.784527 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add423f-d209-45aa-a03b-39b548d52f57 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:59.785250 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add423f-d209-45aa-a03b-39b548d52f57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:59.787206 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add423f-d209-45aa-a03b-39b548d52f57 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:59.808534 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1309/2618] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:11:59 2021] POST /identity/v3/users => generated 291 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:11:59.811529 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4964d-84fb-48b6-ad90-5e892d52bb55 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:59.822198 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4964d-84fb-48b6-ad90-5e892d52bb55 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:59.826959 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20363b10-9cc2-43c0-998c-9cc2d7168ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:59.827626 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20363b10-9cc2-43c0-998c-9cc2d7168ebd admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:59.827910 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20363b10-9cc2-43c0-998c-9cc2d7168ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:59.828189 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20363b10-9cc2-43c0-998c-9cc2d7168ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:59.828928 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20363b10-9cc2-43c0-998c-9cc2d7168ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:59.830547 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20363b10-9cc2-43c0-998c-9cc2d7168ebd admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:59.841495 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1310/2619] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:11:59 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:11:59.845544 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add423f-d209-45aa-a03b-39b548d52f57 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:59.856252 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add423f-d209-45aa-a03b-39b548d52f57 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:59.860948 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120f2c9-b17a-4192-8edd-c802106ad08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:59.861675 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120f2c9-b17a-4192-8edd-c802106ad08d admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:59.861963 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120f2c9-b17a-4192-8edd-c802106ad08d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:59.862245 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120f2c9-b17a-4192-8edd-c802106ad08d admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:59.862976 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120f2c9-b17a-4192-8edd-c802106ad08d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:59.864552 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120f2c9-b17a-4192-8edd-c802106ad08d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:59.874389 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1310/2620] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:11:59 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:11:59.878484 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20363b10-9cc2-43c0-998c-9cc2d7168ebd admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:11:59.888347 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20363b10-9cc2-43c0-998c-9cc2d7168ebd admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:11:59.893040 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9ec1c-b136-4254-967f-a23355bd546a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:11:59.893944 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9ec1c-b136-4254-967f-a23355bd546a admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:59.894227 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9ec1c-b136-4254-967f-a23355bd546a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:59.894508 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9ec1c-b136-4254-967f-a23355bd546a admin admin] PATH_INFO: `/v3/projects/09b1da4277de4313afb80136ea2d1d62/users/4506b45fa74443e5adb59dbbe8bff26c/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:59.908864 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9ec1c-b136-4254-967f-a23355bd546a admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b1da4277de4313afb80136ea2d1d62, user_id=4506b45fa74443e5adb59dbbe8bff26c, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:11:59.911424 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9ec1c-b136-4254-967f-a23355bd546a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:11:59.924123 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1311/2621] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:11:59 2021] PUT /identity/v3/projects/09b1da4277de4313afb80136ea2d1d62/users/4506b45fa74443e5adb59dbbe8bff26c/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:11:59.934347 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8b4a8-bdd1-49a8-afa3-817eb0455a5c None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:11:59.934643 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8b4a8-bdd1-49a8-afa3-817eb0455a5c None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:11:59.934923 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8b4a8-bdd1-49a8-afa3-817eb0455a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:11:59.960849 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-05d8b4a8-bdd1-49a8-afa3-817eb0455a5c None None] MFA Rules not processed for user `4506b45fa74443e5adb59dbbe8bff26c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:11:59.962089 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-05d8b4a8-bdd1-49a8-afa3-817eb0455a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:00.026825 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1311/2622] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:11:59 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:12:00.031337 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9ec1c-b136-4254-967f-a23355bd546a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:00.090593 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9ec1c-b136-4254-967f-a23355bd546a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:00.095307 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a7040-618c-4be0-aead-1eb94b3333fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:00.095964 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a7040-618c-4be0-aead-1eb94b3333fa admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:00.096253 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a7040-618c-4be0-aead-1eb94b3333fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:00.096538 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a7040-618c-4be0-aead-1eb94b3333fa admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:00.097229 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a7040-618c-4be0-aead-1eb94b3333fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:00.099143 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a7040-618c-4be0-aead-1eb94b3333fa admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:00.122597 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1312/2623] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:12:00 2021] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:12:00.126737 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8b4a8-bdd1-49a8-afa3-817eb0455a5c None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:00.137683 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8b4a8-bdd1-49a8-afa3-817eb0455a5c None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:00.192346 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682428c-e2c5-4f1d-8575-72768c460b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:00.192941 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682428c-e2c5-4f1d-8575-72768c460b52 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:00.193231 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682428c-e2c5-4f1d-8575-72768c460b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:00.193543 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682428c-e2c5-4f1d-8575-72768c460b52 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:00.194258 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682428c-e2c5-4f1d-8575-72768c460b52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:00.196147 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682428c-e2c5-4f1d-8575-72768c460b52 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:00.215962 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1312/2624] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:12:00 2021] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:12:00.219886 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a7040-618c-4be0-aead-1eb94b3333fa admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:00.230031 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a7040-618c-4be0-aead-1eb94b3333fa admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:00.234672 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f58b6f-d427-408c-bc03-f9fef961acab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:00.235318 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f58b6f-d427-408c-bc03-f9fef961acab admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:00.235622 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f58b6f-d427-408c-bc03-f9fef961acab admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:00.235878 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f58b6f-d427-408c-bc03-f9fef961acab admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:00.236607 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f58b6f-d427-408c-bc03-f9fef961acab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:00.238241 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f58b6f-d427-408c-bc03-f9fef961acab admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:00.248457 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1313/2625] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:00 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:12:00.252486 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682428c-e2c5-4f1d-8575-72768c460b52 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:00.262847 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682428c-e2c5-4f1d-8575-72768c460b52 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:00.267436 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cf5b0-c181-48b3-b632-e24e9b52c8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:00.268306 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cf5b0-c181-48b3-b632-e24e9b52c8b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:00.268590 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cf5b0-c181-48b3-b632-e24e9b52c8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:00.268869 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cf5b0-c181-48b3-b632-e24e9b52c8b6 admin admin] PATH_INFO: `/v3/projects/ddf7b881146f46c381bb452ab088b431/users/2fb9357b04ce4315add0e33487dc3878/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:00.283449 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cf5b0-c181-48b3-b632-e24e9b52c8b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf7b881146f46c381bb452ab088b431, user_id=2fb9357b04ce4315add0e33487dc3878, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:00.286086 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cf5b0-c181-48b3-b632-e24e9b52c8b6 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:00.298307 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1313/2626] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:12:00 2021] PUT /identity/v3/projects/ddf7b881146f46c381bb452ab088b431/users/2fb9357b04ce4315add0e33487dc3878/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:12:00.302398 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f58b6f-d427-408c-bc03-f9fef961acab admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:00.311970 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f58b6f-d427-408c-bc03-f9fef961acab admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:00.367317 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d168d-1d9c-4e32-a812-a990493397e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:00.367984 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d168d-1d9c-4e32-a812-a990493397e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:00.368267 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d168d-1d9c-4e32-a812-a990493397e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:00.368545 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d168d-1d9c-4e32-a812-a990493397e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:00.369301 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d168d-1d9c-4e32-a812-a990493397e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:00.371382 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d168d-1d9c-4e32-a812-a990493397e8 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:00.381218 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1314/2627] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:00 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:12:00.385407 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cf5b0-c181-48b3-b632-e24e9b52c8b6 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:00.396350 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cf5b0-c181-48b3-b632-e24e9b52c8b6 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:00.401405 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e5d37-c8b6-4d36-90ef-f1d7c397f6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:00.402496 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e5d37-c8b6-4d36-90ef-f1d7c397f6fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:00.402861 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e5d37-c8b6-4d36-90ef-f1d7c397f6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:00.403210 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e5d37-c8b6-4d36-90ef-f1d7c397f6fc admin admin] PATH_INFO: `/v3/projects/ddf7b881146f46c381bb452ab088b431/users/2fb9357b04ce4315add0e33487dc3878/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:00.406286 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e5d37-c8b6-4d36-90ef-f1d7c397f6fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf7b881146f46c381bb452ab088b431, user_id=2fb9357b04ce4315add0e33487dc3878, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:00.408942 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e5d37-c8b6-4d36-90ef-f1d7c397f6fc admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:00.419400 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1314/2628] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:12:00 2021] PUT /identity/v3/projects/ddf7b881146f46c381bb452ab088b431/users/2fb9357b04ce4315add0e33487dc3878/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:12:00.429809 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6814b-9633-4570-974c-a8de87fd6927 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:00.430125 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6814b-9633-4570-974c-a8de87fd6927 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:00.430405 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6814b-9633-4570-974c-a8de87fd6927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:00.457761 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-6bf6814b-9633-4570-974c-a8de87fd6927 None None] MFA Rules not processed for user `2fb9357b04ce4315add0e33487dc3878`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:00.458936 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-6bf6814b-9633-4570-974c-a8de87fd6927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:00.527592 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1315/2629] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:00 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:12:00.689674 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e5d37-c8b6-4d36-90ef-f1d7c397f6fc admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:00.691232 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6814b-9633-4570-974c-a8de87fd6927 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:00.691533 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-aa8e5d37-c8b6-4d36-90ef-f1d7c397f6fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:00.692704 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-6bf6814b-9633-4570-974c-a8de87fd6927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:00.746812 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e5d37-c8b6-4d36-90ef-f1d7c397f6fc admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:00.750615 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66148159-958c-4681-b819-860eb9a76796 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:00.751254 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66148159-958c-4681-b819-860eb9a76796 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:00.751565 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66148159-958c-4681-b819-860eb9a76796 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:00.751844 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66148159-958c-4681-b819-860eb9a76796 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:00.754651 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6814b-9633-4570-974c-a8de87fd6927 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:00.759326 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c48ed-1ff9-4284-ac85-13253839861a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:00.760236 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c48ed-1ff9-4284-ac85-13253839861a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:00.760568 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c48ed-1ff9-4284-ac85-13253839861a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:00.760852 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c48ed-1ff9-4284-ac85-13253839861a admin admin] PATH_INFO: `/v3/users/5c053609327742308ad846bdecc5ed2c` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:00.761384 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66148159-958c-4681-b819-860eb9a76796 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:00.762095 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c48ed-1ff9-4284-ac85-13253839861a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c053609327742308ad846bdecc5ed2c)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:00.762856 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66148159-958c-4681-b819-860eb9a76796 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:00.764004 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c48ed-1ff9-4284-ac85-13253839861a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:00.772312 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1315/2630] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:12:00 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:12:00.810575 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-8e4c48ed-1ff9-4284-ac85-13253839861a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c053609327742308ad846bdecc5ed2c'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:00.817448 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-8e4c48ed-1ff9-4284-ac85-13253839861a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c053609327742308ad846bdecc5ed2c'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:00.818155 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-8e4c48ed-1ff9-4284-ac85-13253839861a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c053609327742308ad846bdecc5ed2c'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:00.830048 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-8e4c48ed-1ff9-4284-ac85-13253839861a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c053609327742308ad846bdecc5ed2c'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:00.838897 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-8e4c48ed-1ff9-4284-ac85-13253839861a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c053609327742308ad846bdecc5ed2c'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:00.845181 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1316/2631] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:12:00 2021] DELETE /identity/v3/users/5c053609327742308ad846bdecc5ed2c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:12:00.849851 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0282d3-0771-45ee-bec9-3f83d21565f6 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:00.850019 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0282d3-0771-45ee-bec9-3f83d21565f6 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:00.850356 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0282d3-0771-45ee-bec9-3f83d21565f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:00.868658 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-2f0282d3-0771-45ee-bec9-3f83d21565f6 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:00.870461 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-2f0282d3-0771-45ee-bec9-3f83d21565f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:00.929923 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1316/2632] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:12:00.940270 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c48ed-1ff9-4284-ac85-13253839861a admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:00.941680 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-8e4c48ed-1ff9-4284-ac85-13253839861a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:01.000871 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c48ed-1ff9-4284-ac85-13253839861a admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:01.004808 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6671e31-f8d6-4157-99d8-bf7350d18a23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:01.005444 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6671e31-f8d6-4157-99d8-bf7350d18a23 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:01.005755 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6671e31-f8d6-4157-99d8-bf7350d18a23 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:01.006030 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6671e31-f8d6-4157-99d8-bf7350d18a23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:01.015407 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6671e31-f8d6-4157-99d8-bf7350d18a23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:01.017288 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6671e31-f8d6-4157-99d8-bf7350d18a23 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:01.027080 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1317/2633] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:12:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:12:01.077288 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0282d3-0771-45ee-bec9-3f83d21565f6 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:01.078869 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-2f0282d3-0771-45ee-bec9-3f83d21565f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:01.144277 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0282d3-0771-45ee-bec9-3f83d21565f6 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:01.154660 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833f6b6-0450-4770-a37d-5fd12d76743c tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fb9357b04ce4315add0e33487dc3878', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddf7b881146f46c381bb452ab088b431', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:01.155371 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833f6b6-0450-4770-a37d-5fd12d76743c tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:01.155662 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833f6b6-0450-4770-a37d-5fd12d76743c tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:01.155949 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833f6b6-0450-4770-a37d-5fd12d76743c tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:01.156707 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833f6b6-0450-4770-a37d-5fd12d76743c tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 02:12:01.157024 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833f6b6-0450-4770-a37d-5fd12d76743c tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:01.158869 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833f6b6-0450-4770-a37d-5fd12d76743c tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:01.173658 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1317/2634] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 02:12:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 02:12:01.177456 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6671e31-f8d6-4157-99d8-bf7350d18a23 service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:01.191642 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6671e31-f8d6-4157-99d8-bf7350d18a23 service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:01.197880 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519c29a-59e2-4ae1-8ab9-58ebe7912fbe tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fb9357b04ce4315add0e33487dc3878', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddf7b881146f46c381bb452ab088b431', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:01.198619 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519c29a-59e2-4ae1-8ab9-58ebe7912fbe tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:01.198997 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519c29a-59e2-4ae1-8ab9-58ebe7912fbe tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:01.199350 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519c29a-59e2-4ae1-8ab9-58ebe7912fbe tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:01.200164 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519c29a-59e2-4ae1-8ab9-58ebe7912fbe tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:01.202165 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519c29a-59e2-4ae1-8ab9-58ebe7912fbe tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:01.231936 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1318/2635] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:12:01 2021] POST /identity/v3/projects => generated 354 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:12:01.233205 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833f6b6-0450-4770-a37d-5fd12d76743c tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:01.243310 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833f6b6-0450-4770-a37d-5fd12d76743c tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:01.295789 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519c29a-59e2-4ae1-8ab9-58ebe7912fbe tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:01.297688 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-5519c29a-59e2-4ae1-8ab9-58ebe7912fbe tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:01.301948 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06fcb3-312c-4508-b8f9-483a1c05ac8c tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fb9357b04ce4315add0e33487dc3878', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddf7b881146f46c381bb452ab088b431', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:01.306236 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06fcb3-312c-4508-b8f9-483a1c05ac8c tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:01.306380 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06fcb3-312c-4508-b8f9-483a1c05ac8c tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:01.306671 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06fcb3-312c-4508-b8f9-483a1c05ac8c tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:01.307458 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06fcb3-312c-4508-b8f9-483a1c05ac8c tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 02:12:01.307779 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06fcb3-312c-4508-b8f9-483a1c05ac8c tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:01.309419 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06fcb3-312c-4508-b8f9-483a1c05ac8c tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:01.328140 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1318/2636] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 02:12:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 02:12:01.359344 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06fcb3-312c-4508-b8f9-483a1c05ac8c tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:01.365799 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519c29a-59e2-4ae1-8ab9-58ebe7912fbe tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:01.369533 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06fcb3-312c-4508-b8f9-483a1c05ac8c tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:01.370637 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba76c4-8a39-4bb2-b3fd-4341db1f24dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:01.371525 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba76c4-8a39-4bb2-b3fd-4341db1f24dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:01.371808 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba76c4-8a39-4bb2-b3fd-4341db1f24dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:01.372087 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba76c4-8a39-4bb2-b3fd-4341db1f24dd admin admin] PATH_INFO: `/v3/projects/d6f8e181d87740ca8d40b99c7a033376` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:01.373299 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba76c4-8a39-4bb2-b3fd-4341db1f24dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6f8e181d87740ca8d40b99c7a033376)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:01.374298 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec4e46-63cb-4c5a-af12-99ca50cd5801 tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fb9357b04ce4315add0e33487dc3878', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddf7b881146f46c381bb452ab088b431', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:01.375193 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec4e46-63cb-4c5a-af12-99ca50cd5801 tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:01.375323 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba76c4-8a39-4bb2-b3fd-4341db1f24dd admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:01.375516 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec4e46-63cb-4c5a-af12-99ca50cd5801 tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:01.375927 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec4e46-63cb-4c5a-af12-99ca50cd5801 tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] PATH_INFO: `/v3/projects/ee24a6cec24e403ea599bbca7acef944` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:01.377128 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec4e46-63cb-4c5a-af12-99ca50cd5801 tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ee24a6cec24e403ea599bbca7acef944)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:01.379070 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec4e46-63cb-4c5a-af12-99ca50cd5801 tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:01.421040 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-89ba76c4-8a39-4bb2-b3fd-4341db1f24dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6f8e181d87740ca8d40b99c7a033376', 'request_id': 'req-89ba76c4-8a39-4bb2-b3fd-4341db1f24dd'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:01.423537 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-0fec4e46-63cb-4c5a-af12-99ca50cd5801 tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee24a6cec24e403ea599bbca7acef944', 'request_id': 'req-0fec4e46-63cb-4c5a-af12-99ca50cd5801'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:01.426566 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-89ba76c4-8a39-4bb2-b3fd-4341db1f24dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6f8e181d87740ca8d40b99c7a033376', 'request_id': 'req-89ba76c4-8a39-4bb2-b3fd-4341db1f24dd'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:01.429095 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-0fec4e46-63cb-4c5a-af12-99ca50cd5801 tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee24a6cec24e403ea599bbca7acef944', 'request_id': 'req-0fec4e46-63cb-4c5a-af12-99ca50cd5801'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:01.433914 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-89ba76c4-8a39-4bb2-b3fd-4341db1f24dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6f8e181d87740ca8d40b99c7a033376', 'request_id': 'req-89ba76c4-8a39-4bb2-b3fd-4341db1f24dd'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:01.436628 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-0fec4e46-63cb-4c5a-af12-99ca50cd5801 tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee24a6cec24e403ea599bbca7acef944', 'request_id': 'req-0fec4e46-63cb-4c5a-af12-99ca50cd5801'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:01.445589 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-89ba76c4-8a39-4bb2-b3fd-4341db1f24dd admin admin] The token cache is being invalidate because project d6f8e181d87740ca8d40b99c7a033376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:12:01.445882 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-89ba76c4-8a39-4bb2-b3fd-4341db1f24dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:01.446530 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-89ba76c4-8a39-4bb2-b3fd-4341db1f24dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:01.448177 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-0fec4e46-63cb-4c5a-af12-99ca50cd5801 tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] The token cache is being invalidate because project ee24a6cec24e403ea599bbca7acef944 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:12:01.448471 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-0fec4e46-63cb-4c5a-af12-99ca50cd5801 tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:01.449320 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1319/2637] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:12:01 2021] DELETE /identity/v3/projects/d6f8e181d87740ca8d40b99c7a033376 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:01.449454 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-0fec4e46-63cb-4c5a-af12-99ca50cd5801 tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:01.452918 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba76c4-8a39-4bb2-b3fd-4341db1f24dd admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:01.454343 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-89ba76c4-8a39-4bb2-b3fd-4341db1f24dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:01.458921 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1319/2638] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:12:01 2021] DELETE /identity/v3/projects/ee24a6cec24e403ea599bbca7acef944 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:01.528713 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba76c4-8a39-4bb2-b3fd-4341db1f24dd admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:01.589727 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4029d-85c5-4820-99f2-c2f6ff7a2d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:01.590872 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4029d-85c5-4820-99f2-c2f6ff7a2d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:01.591159 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4029d-85c5-4820-99f2-c2f6ff7a2d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:01.591436 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4029d-85c5-4820-99f2-c2f6ff7a2d5d admin admin] PATH_INFO: `/v3/users/378a16cedd5a4161b0d5bde77f86fb69` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:01.592683 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4029d-85c5-4820-99f2-c2f6ff7a2d5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=378a16cedd5a4161b0d5bde77f86fb69)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:01.594615 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4029d-85c5-4820-99f2-c2f6ff7a2d5d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:01.640316 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec4e46-63cb-4c5a-af12-99ca50cd5801 tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:01.641709 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-0fec4e46-63cb-4c5a-af12-99ca50cd5801 tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:01.642353 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-7cd4029d-85c5-4820-99f2-c2f6ff7a2d5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '378a16cedd5a4161b0d5bde77f86fb69'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:01.649117 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-7cd4029d-85c5-4820-99f2-c2f6ff7a2d5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '378a16cedd5a4161b0d5bde77f86fb69'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:01.649820 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-7cd4029d-85c5-4820-99f2-c2f6ff7a2d5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '378a16cedd5a4161b0d5bde77f86fb69'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:01.656233 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec4e46-63cb-4c5a-af12-99ca50cd5801 tempest-VolumeQuotaClassesTest-1247527020 tempest-VolumeQuotaClassesTest-1247527020-project-admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:01.660934 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee73e5-215f-4401-969d-4b76b399803a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:01.661931 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee73e5-215f-4401-969d-4b76b399803a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:01.662217 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee73e5-215f-4401-969d-4b76b399803a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:01.662500 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee73e5-215f-4401-969d-4b76b399803a admin admin] PATH_INFO: `/v3/users/4506b45fa74443e5adb59dbbe8bff26c` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:01.662635 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-7cd4029d-85c5-4820-99f2-c2f6ff7a2d5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '378a16cedd5a4161b0d5bde77f86fb69'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:01.663715 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee73e5-215f-4401-969d-4b76b399803a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4506b45fa74443e5adb59dbbe8bff26c)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:01.665777 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee73e5-215f-4401-969d-4b76b399803a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:01.669739 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-7cd4029d-85c5-4820-99f2-c2f6ff7a2d5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '378a16cedd5a4161b0d5bde77f86fb69'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:01.676264 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1320/2639] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:12:01 2021] DELETE /identity/v3/users/378a16cedd5a4161b0d5bde77f86fb69 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:01.712692 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-30ee73e5-215f-4401-969d-4b76b399803a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4506b45fa74443e5adb59dbbe8bff26c'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:01.721536 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-30ee73e5-215f-4401-969d-4b76b399803a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4506b45fa74443e5adb59dbbe8bff26c'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:01.729134 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-30ee73e5-215f-4401-969d-4b76b399803a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4506b45fa74443e5adb59dbbe8bff26c'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:01.729902 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-30ee73e5-215f-4401-969d-4b76b399803a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4506b45fa74443e5adb59dbbe8bff26c'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:01.742790 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-30ee73e5-215f-4401-969d-4b76b399803a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4506b45fa74443e5adb59dbbe8bff26c'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:01.749029 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1320/2640] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:12:01 2021] DELETE /identity/v3/users/4506b45fa74443e5adb59dbbe8bff26c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:01.753570 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5ff7e-bdd5-43b8-9fe2-62f0c1126ed7 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:01.753867 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5ff7e-bdd5-43b8-9fe2-62f0c1126ed7 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:01.754156 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5ff7e-bdd5-43b8-9fe2-62f0c1126ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:01.772225 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-3de5ff7e-bdd5-43b8-9fe2-62f0c1126ed7 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:01.773450 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3de5ff7e-bdd5-43b8-9fe2-62f0c1126ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:01.836574 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1321/2641] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:12:01.846929 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee73e5-215f-4401-969d-4b76b399803a admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:01.848401 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-30ee73e5-215f-4401-969d-4b76b399803a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:01.905185 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee73e5-215f-4401-969d-4b76b399803a admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:01.908870 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1fbfc-774e-421f-97ee-22318f15f873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:01.909539 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1fbfc-774e-421f-97ee-22318f15f873 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:01.909834 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1fbfc-774e-421f-97ee-22318f15f873 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:01.910114 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1fbfc-774e-421f-97ee-22318f15f873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:01.919352 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1fbfc-774e-421f-97ee-22318f15f873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:01.920774 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1fbfc-774e-421f-97ee-22318f15f873 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:01.930433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1321/2642] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:12:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:12:01.950876 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5ff7e-bdd5-43b8-9fe2-62f0c1126ed7 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:01.952430 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3de5ff7e-bdd5-43b8-9fe2-62f0c1126ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:01.971825 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5ff7e-bdd5-43b8-9fe2-62f0c1126ed7 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:01.979183 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dc41b-1236-418a-a577-817d78d42593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:01.980237 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dc41b-1236-418a-a577-817d78d42593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:01.980526 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dc41b-1236-418a-a577-817d78d42593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:01.980802 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dc41b-1236-418a-a577-817d78d42593 admin admin] PATH_INFO: `/v3/projects/411529664f7a4300a7979c1b4c95e403` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:01.982301 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5dc41b-1236-418a-a577-817d78d42593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=411529664f7a4300a7979c1b4c95e403)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:01.983981 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5dc41b-1236-418a-a577-817d78d42593 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:02.032052 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-1b5dc41b-1236-418a-a577-817d78d42593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '411529664f7a4300a7979c1b4c95e403', 'request_id': 'req-1b5dc41b-1236-418a-a577-817d78d42593'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.038032 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-1b5dc41b-1236-418a-a577-817d78d42593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '411529664f7a4300a7979c1b4c95e403', 'request_id': 'req-1b5dc41b-1236-418a-a577-817d78d42593'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.046272 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-1b5dc41b-1236-418a-a577-817d78d42593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '411529664f7a4300a7979c1b4c95e403', 'request_id': 'req-1b5dc41b-1236-418a-a577-817d78d42593'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.058204 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-1b5dc41b-1236-418a-a577-817d78d42593 admin admin] The token cache is being invalidate because project 411529664f7a4300a7979c1b4c95e403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:12:02.058570 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-1b5dc41b-1236-418a-a577-817d78d42593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.059229 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-1b5dc41b-1236-418a-a577-817d78d42593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.060772 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1322/2643] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:12:01 2021] DELETE /identity/v3/projects/411529664f7a4300a7979c1b4c95e403 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:12:02.064706 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1fbfc-774e-421f-97ee-22318f15f873 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:02.074756 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1fbfc-774e-421f-97ee-22318f15f873 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:02.129977 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ce0ce-6d4b-458d-b7b6-9dcb2432887f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:02.131095 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ce0ce-6d4b-458d-b7b6-9dcb2432887f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:02.131486 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ce0ce-6d4b-458d-b7b6-9dcb2432887f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:02.131872 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ce0ce-6d4b-458d-b7b6-9dcb2432887f admin admin] PATH_INFO: `/v3/users/a90a1c2d671345bb914c12418987f8d8` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:02.133218 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ce0ce-6d4b-458d-b7b6-9dcb2432887f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a90a1c2d671345bb914c12418987f8d8)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:02.135162 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ce0ce-6d4b-458d-b7b6-9dcb2432887f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:02.181495 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-1a0ce0ce-6d4b-458d-b7b6-9dcb2432887f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a90a1c2d671345bb914c12418987f8d8'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.192085 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-1a0ce0ce-6d4b-458d-b7b6-9dcb2432887f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a90a1c2d671345bb914c12418987f8d8'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.199824 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-1a0ce0ce-6d4b-458d-b7b6-9dcb2432887f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a90a1c2d671345bb914c12418987f8d8'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.200589 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-1a0ce0ce-6d4b-458d-b7b6-9dcb2432887f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a90a1c2d671345bb914c12418987f8d8'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.209936 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dc41b-1236-418a-a577-817d78d42593 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:02.211372 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-1b5dc41b-1236-418a-a577-817d78d42593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:02.214623 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-1a0ce0ce-6d4b-458d-b7b6-9dcb2432887f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a90a1c2d671345bb914c12418987f8d8'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.221293 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1322/2644] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:12:02 2021] DELETE /identity/v3/users/a90a1c2d671345bb914c12418987f8d8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:02.231858 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dc41b-1236-418a-a577-817d78d42593 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:02.299613 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b269b6-72ef-4784-bcc6-66ecde4fe7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:02.300488 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b269b6-72ef-4784-bcc6-66ecde4fe7d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:02.300757 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b269b6-72ef-4784-bcc6-66ecde4fe7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:02.301031 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b269b6-72ef-4784-bcc6-66ecde4fe7d7 admin admin] PATH_INFO: `/v3/projects/09b1da4277de4313afb80136ea2d1d62` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:02.302245 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b269b6-72ef-4784-bcc6-66ecde4fe7d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09b1da4277de4313afb80136ea2d1d62)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:02.304128 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b269b6-72ef-4784-bcc6-66ecde4fe7d7 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:02.349711 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d3b269b6-72ef-4784-bcc6-66ecde4fe7d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09b1da4277de4313afb80136ea2d1d62', 'request_id': 'req-d3b269b6-72ef-4784-bcc6-66ecde4fe7d7'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.355651 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d3b269b6-72ef-4784-bcc6-66ecde4fe7d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09b1da4277de4313afb80136ea2d1d62', 'request_id': 'req-d3b269b6-72ef-4784-bcc6-66ecde4fe7d7'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.364642 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d3b269b6-72ef-4784-bcc6-66ecde4fe7d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09b1da4277de4313afb80136ea2d1d62', 'request_id': 'req-d3b269b6-72ef-4784-bcc6-66ecde4fe7d7'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.377282 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d3b269b6-72ef-4784-bcc6-66ecde4fe7d7 admin admin] The token cache is being invalidate because project 09b1da4277de4313afb80136ea2d1d62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:12:02.377926 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d3b269b6-72ef-4784-bcc6-66ecde4fe7d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.378363 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d3b269b6-72ef-4784-bcc6-66ecde4fe7d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.380287 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1323/2645] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:12:02 2021] DELETE /identity/v3/projects/09b1da4277de4313afb80136ea2d1d62 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:02.384133 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ce0ce-6d4b-458d-b7b6-9dcb2432887f admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:02.386093 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-1a0ce0ce-6d4b-458d-b7b6-9dcb2432887f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:02.398727 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ce0ce-6d4b-458d-b7b6-9dcb2432887f admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:02.453880 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0c8b2-6559-461d-8dbf-507c4efd3a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:02.454763 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0c8b2-6559-461d-8dbf-507c4efd3a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:02.455047 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0c8b2-6559-461d-8dbf-507c4efd3a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:02.455325 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0c8b2-6559-461d-8dbf-507c4efd3a54 admin admin] PATH_INFO: `/v3/users/2fb9357b04ce4315add0e33487dc3878` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:02.456541 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0c8b2-6559-461d-8dbf-507c4efd3a54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fb9357b04ce4315add0e33487dc3878)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:02.458619 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0c8b2-6559-461d-8dbf-507c4efd3a54 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:02.489695 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b269b6-72ef-4784-bcc6-66ecde4fe7d7 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:02.491420 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-d3b269b6-72ef-4784-bcc6-66ecde4fe7d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:02.504301 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b269b6-72ef-4784-bcc6-66ecde4fe7d7 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:02.512443 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-48d0c8b2-6559-461d-8dbf-507c4efd3a54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fb9357b04ce4315add0e33487dc3878'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.520953 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d085e-0755-49cb-81b4-1ec1584c1fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:02.521658 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-48d0c8b2-6559-461d-8dbf-507c4efd3a54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fb9357b04ce4315add0e33487dc3878'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.521892 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d085e-0755-49cb-81b4-1ec1584c1fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:02.522224 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d085e-0755-49cb-81b4-1ec1584c1fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:02.522653 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d085e-0755-49cb-81b4-1ec1584c1fde admin admin] PATH_INFO: `/v3/projects/d0c4c5d7e3fc4547805c698e4de627ca` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:02.523978 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d085e-0755-49cb-81b4-1ec1584c1fde admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0c4c5d7e3fc4547805c698e4de627ca)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:02.526674 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d085e-0755-49cb-81b4-1ec1584c1fde admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:02.530002 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-48d0c8b2-6559-461d-8dbf-507c4efd3a54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fb9357b04ce4315add0e33487dc3878'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.530895 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-48d0c8b2-6559-461d-8dbf-507c4efd3a54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fb9357b04ce4315add0e33487dc3878'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.542379 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-48d0c8b2-6559-461d-8dbf-507c4efd3a54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fb9357b04ce4315add0e33487dc3878'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.548517 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1323/2646] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:12:02 2021] DELETE /identity/v3/users/2fb9357b04ce4315add0e33487dc3878 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:12:02.574582 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d04d085e-0755-49cb-81b4-1ec1584c1fde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0c4c5d7e3fc4547805c698e4de627ca', 'request_id': 'req-d04d085e-0755-49cb-81b4-1ec1584c1fde'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.580136 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d04d085e-0755-49cb-81b4-1ec1584c1fde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0c4c5d7e3fc4547805c698e4de627ca', 'request_id': 'req-d04d085e-0755-49cb-81b4-1ec1584c1fde'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.588211 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d04d085e-0755-49cb-81b4-1ec1584c1fde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0c4c5d7e3fc4547805c698e4de627ca', 'request_id': 'req-d04d085e-0755-49cb-81b4-1ec1584c1fde'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.600211 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d04d085e-0755-49cb-81b4-1ec1584c1fde admin admin] The token cache is being invalidate because project d0c4c5d7e3fc4547805c698e4de627ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:12:02.600421 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d04d085e-0755-49cb-81b4-1ec1584c1fde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.601225 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d04d085e-0755-49cb-81b4-1ec1584c1fde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.602803 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1324/2647] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:12:02 2021] DELETE /identity/v3/projects/d0c4c5d7e3fc4547805c698e4de627ca => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:12:02.609568 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a8c59-e88e-45bb-b4c7-d893323a3e1f None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:02.609987 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a8c59-e88e-45bb-b4c7-d893323a3e1f None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:02.610231 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a8c59-e88e-45bb-b4c7-d893323a3e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:02.628954 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-388a8c59-e88e-45bb-b4c7-d893323a3e1f None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:02.630322 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-388a8c59-e88e-45bb-b4c7-d893323a3e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:02.693695 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1324/2648] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:12:02.702530 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0047ed0-7989-4a61-98e6-9faf376b9076 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:02.702825 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0047ed0-7989-4a61-98e6-9faf376b9076 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:02.761641 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0047ed0-7989-4a61-98e6-9faf376b9076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:02.761641 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-a0047ed0-7989-4a61-98e6-9faf376b9076 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:02.761641 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-a0047ed0-7989-4a61-98e6-9faf376b9076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:02.761641 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1325/2649] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:12:02.762072 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a8c59-e88e-45bb-b4c7-d893323a3e1f None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:02.762072 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a8c59-e88e-45bb-b4c7-d893323a3e1f None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:02.765919 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40311e23-9544-4b3a-a06c-26c747459123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:02.766604 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40311e23-9544-4b3a-a06c-26c747459123 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:02.766919 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40311e23-9544-4b3a-a06c-26c747459123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:02.767197 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40311e23-9544-4b3a-a06c-26c747459123 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:02.767958 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40311e23-9544-4b3a-a06c-26c747459123 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 02:12:02.768265 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40311e23-9544-4b3a-a06c-26c747459123 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:02.769909 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40311e23-9544-4b3a-a06c-26c747459123 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:02.783634 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1325/2650] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 02:12:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 02:12:02.786161 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0047ed0-7989-4a61-98e6-9faf376b9076 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:02.795349 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0047ed0-7989-4a61-98e6-9faf376b9076 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:02.800433 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c49cd-b782-4848-9ce5-9859234670b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:02.801085 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c49cd-b782-4848-9ce5-9859234670b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:02.801363 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c49cd-b782-4848-9ce5-9859234670b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:02.801670 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c49cd-b782-4848-9ce5-9859234670b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:02.802384 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c49cd-b782-4848-9ce5-9859234670b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:02.804298 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c49cd-b782-4848-9ce5-9859234670b1 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:02.829392 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40311e23-9544-4b3a-a06c-26c747459123 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:02.831337 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-40311e23-9544-4b3a-a06c-26c747459123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:02.835484 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1326/2651] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:12:02 2021] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:12:02.836405 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c49cd-b782-4848-9ce5-9859234670b1 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:02.844287 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40311e23-9544-4b3a-a06c-26c747459123 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:02.900746 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c49cd-b782-4848-9ce5-9859234670b1 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:02.900920 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13103a85-ef91-44f9-8118-fb3a08b392fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:02.901751 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13103a85-ef91-44f9-8118-fb3a08b392fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:02.902039 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13103a85-ef91-44f9-8118-fb3a08b392fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:02.902317 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13103a85-ef91-44f9-8118-fb3a08b392fd admin admin] PATH_INFO: `/v3/projects/ddf7b881146f46c381bb452ab088b431` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:02.903508 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13103a85-ef91-44f9-8118-fb3a08b392fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddf7b881146f46c381bb452ab088b431)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:02.905402 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13103a85-ef91-44f9-8118-fb3a08b392fd admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:02.905512 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6694f-1e13-46e6-89db-654fa7f6c404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:02.906108 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6694f-1e13-46e6-89db-654fa7f6c404 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:02.906394 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6694f-1e13-46e6-89db-654fa7f6c404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:02.906673 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6694f-1e13-46e6-89db-654fa7f6c404 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:02.907373 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6694f-1e13-46e6-89db-654fa7f6c404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:02.909252 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6694f-1e13-46e6-89db-654fa7f6c404 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:02.930052 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1327/2652] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:12:02 2021] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:12:02.934739 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6694f-1e13-46e6-89db-654fa7f6c404 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:02.944502 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6694f-1e13-46e6-89db-654fa7f6c404 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:02.954471 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-13103a85-ef91-44f9-8118-fb3a08b392fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddf7b881146f46c381bb452ab088b431', 'request_id': 'req-13103a85-ef91-44f9-8118-fb3a08b392fd'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.960382 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-13103a85-ef91-44f9-8118-fb3a08b392fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddf7b881146f46c381bb452ab088b431', 'request_id': 'req-13103a85-ef91-44f9-8118-fb3a08b392fd'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.970928 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-13103a85-ef91-44f9-8118-fb3a08b392fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddf7b881146f46c381bb452ab088b431', 'request_id': 'req-13103a85-ef91-44f9-8118-fb3a08b392fd'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.982833 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-13103a85-ef91-44f9-8118-fb3a08b392fd admin admin] The token cache is being invalidate because project ddf7b881146f46c381bb452ab088b431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:12:02.983124 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-13103a85-ef91-44f9-8118-fb3a08b392fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.983860 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-13103a85-ef91-44f9-8118-fb3a08b392fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:02.985415 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1326/2653] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:12:02 2021] DELETE /identity/v3/projects/ddf7b881146f46c381bb452ab088b431 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:12:02.991310 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cb041-54c2-49d5-8cd9-fd458ce3ee34 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:02.991599 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cb041-54c2-49d5-8cd9-fd458ce3ee34 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:02.991875 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cb041-54c2-49d5-8cd9-fd458ce3ee34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:03.003701 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86e304-f402-4b83-b395-50a97b2ae937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:03.004367 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86e304-f402-4b83-b395-50a97b2ae937 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:03.004651 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86e304-f402-4b83-b395-50a97b2ae937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:03.004931 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86e304-f402-4b83-b395-50a97b2ae937 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:03.005854 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86e304-f402-4b83-b395-50a97b2ae937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:03.007453 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86e304-f402-4b83-b395-50a97b2ae937 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:03.010229 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-250cb041-54c2-49d5-8cd9-fd458ce3ee34 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:03.011452 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-250cb041-54c2-49d5-8cd9-fd458ce3ee34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:03.020193 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1328/2654] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:02 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:12:03.020314 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1327/2655] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:12:03.021181 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86e304-f402-4b83-b395-50a97b2ae937 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:03.022783 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3c86e304-f402-4b83-b395-50a97b2ae937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:03.027886 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8591c3-063a-4f11-aabc-c7af69cc1ce5 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:03.028175 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8591c3-063a-4f11-aabc-c7af69cc1ce5 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:03.028460 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8591c3-063a-4f11-aabc-c7af69cc1ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:03.035004 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86e304-f402-4b83-b395-50a97b2ae937 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:03.039786 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead478c9-2bbf-4673-9c88-bb93d8780a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:03.040464 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead478c9-2bbf-4673-9c88-bb93d8780a87 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:03.040749 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead478c9-2bbf-4673-9c88-bb93d8780a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:03.041028 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead478c9-2bbf-4673-9c88-bb93d8780a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:03.042333 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead478c9-2bbf-4673-9c88-bb93d8780a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:03.043932 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead478c9-2bbf-4673-9c88-bb93d8780a87 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:03.046694 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-dd8591c3-063a-4f11-aabc-c7af69cc1ce5 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:03.047865 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-dd8591c3-063a-4f11-aabc-c7af69cc1ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:03.057183 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1329/2656] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:03 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:12:03.057879 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1328/2657] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:12:03.058975 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead478c9-2bbf-4673-9c88-bb93d8780a87 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:03.060510 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8591c3-063a-4f11-aabc-c7af69cc1ce5 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:03.068735 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead478c9-2bbf-4673-9c88-bb93d8780a87 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:03.069830 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8591c3-063a-4f11-aabc-c7af69cc1ce5 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:03.073580 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06532f-f4c8-4a58-b079-12a6a9332d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:03.074495 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06532f-f4c8-4a58-b079-12a6a9332d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:03.074779 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06532f-f4c8-4a58-b079-12a6a9332d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:03.074860 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2548bf6c-73c0-40b2-bf4e-ede417cade35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:03.075640 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548bf6c-73c0-40b2-bf4e-ede417cade35 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:03.075729 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06532f-f4c8-4a58-b079-12a6a9332d67 admin admin] PATH_INFO: `/v3/projects/b82d5a22b574474ea44c7f1a2b876c33/users/f63ac4adcc604fc483bc9a6dcac71857/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:03.076046 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548bf6c-73c0-40b2-bf4e-ede417cade35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:03.076387 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548bf6c-73c0-40b2-bf4e-ede417cade35 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:03.077202 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2548bf6c-73c0-40b2-bf4e-ede417cade35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 02:12:03.077634 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2548bf6c-73c0-40b2-bf4e-ede417cade35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:03.079283 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2548bf6c-73c0-40b2-bf4e-ede417cade35 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:03.091229 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1329/2658] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 02:12:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 02:12:03.092777 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06532f-f4c8-4a58-b079-12a6a9332d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b82d5a22b574474ea44c7f1a2b876c33, user_id=f63ac4adcc604fc483bc9a6dcac71857, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:03.095435 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06532f-f4c8-4a58-b079-12a6a9332d67 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:03.095529 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2548bf6c-73c0-40b2-bf4e-ede417cade35 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:03.106129 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2548bf6c-73c0-40b2-bf4e-ede417cade35 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:03.109228 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1330/2659] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:12:03 2021] PUT /identity/v3/projects/b82d5a22b574474ea44c7f1a2b876c33/users/f63ac4adcc604fc483bc9a6dcac71857/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:03.120842 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c99e1e-9f6d-44ef-bcd9-8293018be22c None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:03.121126 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c99e1e-9f6d-44ef-bcd9-8293018be22c None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:03.121402 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c99e1e-9f6d-44ef-bcd9-8293018be22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:03.146591 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-d9c99e1e-9f6d-44ef-bcd9-8293018be22c None None] MFA Rules not processed for user `f63ac4adcc604fc483bc9a6dcac71857`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:03.147979 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-d9c99e1e-9f6d-44ef-bcd9-8293018be22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:03.161733 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7c202-d703-4893-ab52-be7b238e8b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:03.162393 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7c202-d703-4893-ab52-be7b238e8b54 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:03.162681 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7c202-d703-4893-ab52-be7b238e8b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:03.162963 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7c202-d703-4893-ab52-be7b238e8b54 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:03.163669 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7c202-d703-4893-ab52-be7b238e8b54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:03.165661 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7c202-d703-4893-ab52-be7b238e8b54 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:03.197787 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1330/2660] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:12:03 2021] POST /identity/v3/projects => generated 399 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:12:03.202300 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7c202-d703-4893-ab52-be7b238e8b54 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:03.217796 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1331/2661] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:03 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:12:03.222233 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c99e1e-9f6d-44ef-bcd9-8293018be22c None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:03.232729 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c99e1e-9f6d-44ef-bcd9-8293018be22c None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:03.261395 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7c202-d703-4893-ab52-be7b238e8b54 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:03.266201 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253911b7-2057-47af-af5f-e73a198b929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:03.266864 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253911b7-2057-47af-af5f-e73a198b929e admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:03.267154 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253911b7-2057-47af-af5f-e73a198b929e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:03.267512 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253911b7-2057-47af-af5f-e73a198b929e admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:03.268330 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253911b7-2057-47af-af5f-e73a198b929e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:03.270440 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253911b7-2057-47af-af5f-e73a198b929e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:03.286946 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b052bf-3964-44ce-801c-6a0a2e9f67f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:03.287631 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b052bf-3964-44ce-801c-6a0a2e9f67f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:03.287918 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b052bf-3964-44ce-801c-6a0a2e9f67f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:03.288199 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b052bf-3964-44ce-801c-6a0a2e9f67f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:03.289019 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b052bf-3964-44ce-801c-6a0a2e9f67f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:03.292994 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1331/2662] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:12:03 2021] POST /identity/v3/users => generated 300 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:12:03.293105 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b052bf-3964-44ce-801c-6a0a2e9f67f0 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:03.293999 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253911b7-2057-47af-af5f-e73a198b929e admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:03.303767 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253911b7-2057-47af-af5f-e73a198b929e admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:03.309052 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534ba5f-5140-4b1d-bcb0-1d8491c52646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:03.309721 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534ba5f-5140-4b1d-bcb0-1d8491c52646 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:03.310030 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534ba5f-5140-4b1d-bcb0-1d8491c52646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:03.310285 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534ba5f-5140-4b1d-bcb0-1d8491c52646 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:03.311049 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534ba5f-5140-4b1d-bcb0-1d8491c52646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:03.312613 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534ba5f-5140-4b1d-bcb0-1d8491c52646 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:03.317643 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1332/2663] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:12:03 2021] POST /identity/v3/projects => generated 391 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:12:03.321309 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b052bf-3964-44ce-801c-6a0a2e9f67f0 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:03.323217 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1332/2664] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:03 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:12:03.326742 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534ba5f-5140-4b1d-bcb0-1d8491c52646 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:03.336175 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534ba5f-5140-4b1d-bcb0-1d8491c52646 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:03.383245 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b052bf-3964-44ce-801c-6a0a2e9f67f0 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:03.388066 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4a1c4-af85-4f52-b814-8a8483b0b345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:03.388730 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4a1c4-af85-4f52-b814-8a8483b0b345 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:03.389021 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4a1c4-af85-4f52-b814-8a8483b0b345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:03.389306 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4a1c4-af85-4f52-b814-8a8483b0b345 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:03.390185 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4a1c4-af85-4f52-b814-8a8483b0b345 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:03.390283 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0ede2-615d-4bb1-b431-2d1bd03a8d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:03.390886 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0ede2-615d-4bb1-b431-2d1bd03a8d9e admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:03.391173 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0ede2-615d-4bb1-b431-2d1bd03a8d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:03.391455 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0ede2-615d-4bb1-b431-2d1bd03a8d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:03.392098 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4a1c4-af85-4f52-b814-8a8483b0b345 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:03.392192 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0ede2-615d-4bb1-b431-2d1bd03a8d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:03.393792 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0ede2-615d-4bb1-b431-2d1bd03a8d9e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:03.404588 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1333/2665] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:03 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:12:03.408928 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0ede2-615d-4bb1-b431-2d1bd03a8d9e admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:03.412617 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1333/2666] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:12:03 2021] POST /identity/v3/users => generated 302 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:12:03.416164 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4a1c4-af85-4f52-b814-8a8483b0b345 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:03.419180 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0ede2-615d-4bb1-b431-2d1bd03a8d9e admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:03.423800 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d21035-9b12-4689-8dce-b6da7df33a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:03.424928 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d21035-9b12-4689-8dce-b6da7df33a70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:03.425244 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d21035-9b12-4689-8dce-b6da7df33a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:03.425554 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d21035-9b12-4689-8dce-b6da7df33a70 admin admin] PATH_INFO: `/v3/projects/e99ea38dff21494abd14142ddff86b91/users/63c7b676a0c84f479374df314034a752/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:03.426136 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4a1c4-af85-4f52-b814-8a8483b0b345 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:03.430933 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ae3d1-2c07-4293-8114-0da00680dd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:03.431578 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ae3d1-2c07-4293-8114-0da00680dd26 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:03.431845 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ae3d1-2c07-4293-8114-0da00680dd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:03.432135 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ae3d1-2c07-4293-8114-0da00680dd26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:03.432891 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ae3d1-2c07-4293-8114-0da00680dd26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:03.434504 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ae3d1-2c07-4293-8114-0da00680dd26 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:03.441076 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d21035-9b12-4689-8dce-b6da7df33a70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e99ea38dff21494abd14142ddff86b91, user_id=63c7b676a0c84f479374df314034a752, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:03.443722 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d21035-9b12-4689-8dce-b6da7df33a70 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:03.444209 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1334/2667] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:03 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:12:03.448585 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ae3d1-2c07-4293-8114-0da00680dd26 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:03.457126 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1334/2668] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:12:03 2021] PUT /identity/v3/projects/e99ea38dff21494abd14142ddff86b91/users/63c7b676a0c84f479374df314034a752/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:03.464110 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ae3d1-2c07-4293-8114-0da00680dd26 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:03.467269 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e955991-b68c-455d-88d0-22f298349d52 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:03.467563 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e955991-b68c-455d-88d0-22f298349d52 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:03.467890 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e955991-b68c-455d-88d0-22f298349d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:03.493297 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-4e955991-b68c-455d-88d0-22f298349d52 None None] MFA Rules not processed for user `63c7b676a0c84f479374df314034a752`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:03.494650 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-4e955991-b68c-455d-88d0-22f298349d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:03.518361 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2c719-99c4-44b1-9a92-ed9028e3881d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:03.519343 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2c719-99c4-44b1-9a92-ed9028e3881d admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:03.519696 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2c719-99c4-44b1-9a92-ed9028e3881d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:03.519976 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2c719-99c4-44b1-9a92-ed9028e3881d admin admin] PATH_INFO: `/v3/projects/5d7d6ab186de485e978d31dc85160ee4/users/71376ff97ee04ddd98d97049cbfe3d36/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:03.534422 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2c719-99c4-44b1-9a92-ed9028e3881d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d7d6ab186de485e978d31dc85160ee4, user_id=71376ff97ee04ddd98d97049cbfe3d36, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:03.537045 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2c719-99c4-44b1-9a92-ed9028e3881d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:03.550440 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1335/2669] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:12:03 2021] PUT /identity/v3/projects/5d7d6ab186de485e978d31dc85160ee4/users/71376ff97ee04ddd98d97049cbfe3d36/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:03.554393 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2c719-99c4-44b1-9a92-ed9028e3881d admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:03.557384 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1335/2670] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:03 2021] POST /identity/v3/auth/tokens => generated 3419 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:12:03.561528 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e955991-b68c-455d-88d0-22f298349d52 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:03.571551 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e955991-b68c-455d-88d0-22f298349d52 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:03.613267 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2c719-99c4-44b1-9a92-ed9028e3881d admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:03.618335 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909c17f-f36d-40eb-a520-1f03250da845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:03.618993 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909c17f-f36d-40eb-a520-1f03250da845 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:03.619286 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909c17f-f36d-40eb-a520-1f03250da845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:03.619568 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909c17f-f36d-40eb-a520-1f03250da845 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:03.620307 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909c17f-f36d-40eb-a520-1f03250da845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:03.621923 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909c17f-f36d-40eb-a520-1f03250da845 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:03.625063 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb5390-a5f7-4042-9cca-30a0350544b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:03.625767 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb5390-a5f7-4042-9cca-30a0350544b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:03.626053 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb5390-a5f7-4042-9cca-30a0350544b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:03.626333 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb5390-a5f7-4042-9cca-30a0350544b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:03.627037 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb5390-a5f7-4042-9cca-30a0350544b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:03.628902 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb5390-a5f7-4042-9cca-30a0350544b9 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:03.631684 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1336/2671] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:03 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:12:03.635476 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909c17f-f36d-40eb-a520-1f03250da845 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:03.644960 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909c17f-f36d-40eb-a520-1f03250da845 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:03.650191 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa230b6e-ba07-4c73-8062-98508e4efd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:03.651582 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa230b6e-ba07-4c73-8062-98508e4efd20 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:03.651869 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa230b6e-ba07-4c73-8062-98508e4efd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:03.652150 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa230b6e-ba07-4c73-8062-98508e4efd20 admin admin] PATH_INFO: `/v3/projects/5d7d6ab186de485e978d31dc85160ee4/users/71376ff97ee04ddd98d97049cbfe3d36/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:03.654221 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa230b6e-ba07-4c73-8062-98508e4efd20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d7d6ab186de485e978d31dc85160ee4, user_id=71376ff97ee04ddd98d97049cbfe3d36, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:03.657786 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1336/2672] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:12:03 2021] POST /identity/v3/projects => generated 401 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:12:03.657919 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa230b6e-ba07-4c73-8062-98508e4efd20 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:03.658856 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb5390-a5f7-4042-9cca-30a0350544b9 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:03.668003 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1337/2673] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:12:03 2021] PUT /identity/v3/projects/5d7d6ab186de485e978d31dc85160ee4/users/71376ff97ee04ddd98d97049cbfe3d36/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:03.721654 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb5390-a5f7-4042-9cca-30a0350544b9 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:03.722918 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5228ae9-be9f-45b8-9d59-324fe6ddcfb0 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:03.723214 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5228ae9-be9f-45b8-9d59-324fe6ddcfb0 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:03.723635 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5228ae9-be9f-45b8-9d59-324fe6ddcfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:03.750211 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-f5228ae9-be9f-45b8-9d59-324fe6ddcfb0 None None] MFA Rules not processed for user `71376ff97ee04ddd98d97049cbfe3d36`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:03.751419 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-f5228ae9-be9f-45b8-9d59-324fe6ddcfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:03.777960 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d92741-ed4b-4215-ade2-1912a4d8d573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:03.778628 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d92741-ed4b-4215-ade2-1912a4d8d573 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:03.778909 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d92741-ed4b-4215-ade2-1912a4d8d573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:03.779182 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d92741-ed4b-4215-ade2-1912a4d8d573 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:03.779871 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d92741-ed4b-4215-ade2-1912a4d8d573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:03.781821 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d92741-ed4b-4215-ade2-1912a4d8d573 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:03.801494 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1337/2674] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:12:03 2021] POST /identity/v3/users => generated 307 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:12:03.805252 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d92741-ed4b-4215-ade2-1912a4d8d573 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:03.814890 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d92741-ed4b-4215-ade2-1912a4d8d573 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:03.819695 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa577fc8-6cc2-453a-b3a2-d050a5f820fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:03.820007 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1338/2675] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:03 2021] POST /identity/v3/auth/tokens => generated 3478 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:12:03.820338 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa577fc8-6cc2-453a-b3a2-d050a5f820fe admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:03.820623 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa577fc8-6cc2-453a-b3a2-d050a5f820fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:03.820911 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa577fc8-6cc2-453a-b3a2-d050a5f820fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:03.821684 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa577fc8-6cc2-453a-b3a2-d050a5f820fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:03.823813 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa577fc8-6cc2-453a-b3a2-d050a5f820fe admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:03.830695 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5228ae9-be9f-45b8-9d59-324fe6ddcfb0 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:03.832053 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-f5228ae9-be9f-45b8-9d59-324fe6ddcfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:03.836911 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1338/2676] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:03 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:12:03.837711 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa577fc8-6cc2-453a-b3a2-d050a5f820fe admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:03.847354 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa577fc8-6cc2-453a-b3a2-d050a5f820fe admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:03.851877 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3b496-c08a-4eeb-980b-6f6f88a34c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:03.852724 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3b496-c08a-4eeb-980b-6f6f88a34c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:03.853005 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3b496-c08a-4eeb-980b-6f6f88a34c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:03.853280 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3b496-c08a-4eeb-980b-6f6f88a34c4f admin admin] PATH_INFO: `/v3/projects/0d07f51ad0664851aca2dd1a5b5ac67a/users/ff70a22a4c304fedb2e5fd378d81dd3a/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:03.867628 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3b496-c08a-4eeb-980b-6f6f88a34c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d07f51ad0664851aca2dd1a5b5ac67a, user_id=ff70a22a4c304fedb2e5fd378d81dd3a, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:03.870377 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3b496-c08a-4eeb-980b-6f6f88a34c4f admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:03.883262 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1339/2677] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:12:03 2021] PUT /identity/v3/projects/0d07f51ad0664851aca2dd1a5b5ac67a/users/ff70a22a4c304fedb2e5fd378d81dd3a/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:03.887529 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3b496-c08a-4eeb-980b-6f6f88a34c4f admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:03.890583 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5228ae9-be9f-45b8-9d59-324fe6ddcfb0 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:03.936828 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddba66-12e3-4c63-ab81-1f34f41e0833 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:03.937477 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddba66-12e3-4c63-ab81-1f34f41e0833 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:03.937798 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddba66-12e3-4c63-ab81-1f34f41e0833 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:03.938106 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddba66-12e3-4c63-ab81-1f34f41e0833 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:03.945277 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3b496-c08a-4eeb-980b-6f6f88a34c4f admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:03.950542 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690868e-1e41-4295-a09b-322ece4e70e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:03.951271 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690868e-1e41-4295-a09b-322ece4e70e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:03.951481 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690868e-1e41-4295-a09b-322ece4e70e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:03.951760 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690868e-1e41-4295-a09b-322ece4e70e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:03.952493 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690868e-1e41-4295-a09b-322ece4e70e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:03.954333 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690868e-1e41-4295-a09b-322ece4e70e3 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:03.965308 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1340/2678] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:03 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:12:03.969143 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690868e-1e41-4295-a09b-322ece4e70e3 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:03.980190 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690868e-1e41-4295-a09b-322ece4e70e3 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:03.984939 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de0a4d-eafa-43d3-ba71-d046f6e04389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:03.985849 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de0a4d-eafa-43d3-ba71-d046f6e04389 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:03.986138 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de0a4d-eafa-43d3-ba71-d046f6e04389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:03.986413 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de0a4d-eafa-43d3-ba71-d046f6e04389 admin admin] PATH_INFO: `/v3/projects/0d07f51ad0664851aca2dd1a5b5ac67a/users/ff70a22a4c304fedb2e5fd378d81dd3a/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:03.989045 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de0a4d-eafa-43d3-ba71-d046f6e04389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d07f51ad0664851aca2dd1a5b5ac67a, user_id=ff70a22a4c304fedb2e5fd378d81dd3a, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:03.991694 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de0a4d-eafa-43d3-ba71-d046f6e04389 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:03.999682 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ddba66-12e3-4c63-ab81-1f34f41e0833 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:04.001324 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ddba66-12e3-4c63-ab81-1f34f41e0833 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:04.001844 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1341/2679] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:12:03 2021] PUT /identity/v3/projects/0d07f51ad0664851aca2dd1a5b5ac67a/users/ff70a22a4c304fedb2e5fd378d81dd3a/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:04.011569 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1339/2680] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:12:03 2021] GET /identity/v3/auth/tokens => generated 3478 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 02:12:04.012408 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5d8de-ff67-4e94-8536-d6b3d8fc21b0 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:04.012706 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5d8de-ff67-4e94-8536-d6b3d8fc21b0 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:04.012994 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5d8de-ff67-4e94-8536-d6b3d8fc21b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:04.039258 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-93d5d8de-ff67-4e94-8536-d6b3d8fc21b0 None None] MFA Rules not processed for user `ff70a22a4c304fedb2e5fd378d81dd3a`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:04.040470 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-93d5d8de-ff67-4e94-8536-d6b3d8fc21b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:04.054540 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddba66-12e3-4c63-ab81-1f34f41e0833 service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:04.055954 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-78ddba66-12e3-4c63-ab81-1f34f41e0833 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:04.066968 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddba66-12e3-4c63-ab81-1f34f41e0833 service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:04.108137 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1342/2681] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:04 2021] POST /identity/v3/auth/tokens => generated 3488 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:12:04.117075 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c24701-259b-40c1-a93d-2bb5ccc0ba0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:04.117756 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c24701-259b-40c1-a93d-2bb5ccc0ba0f service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:04.118128 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c24701-259b-40c1-a93d-2bb5ccc0ba0f service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:04.118415 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c24701-259b-40c1-a93d-2bb5ccc0ba0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:04.119103 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5d8de-ff67-4e94-8536-d6b3d8fc21b0 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:04.128657 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5d8de-ff67-4e94-8536-d6b3d8fc21b0 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:04.132382 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b293ce0-5072-47ac-865d-39f6d42982f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:04.133024 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b293ce0-5072-47ac-865d-39f6d42982f2 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:04.133314 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b293ce0-5072-47ac-865d-39f6d42982f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:04.133638 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b293ce0-5072-47ac-865d-39f6d42982f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:04.143356 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b293ce0-5072-47ac-865d-39f6d42982f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:04.144777 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b293ce0-5072-47ac-865d-39f6d42982f2 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:04.154248 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1343/2682] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:12:04 2021] GET /identity/v3/auth/tokens => generated 3488 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 02:12:04.175399 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c24701-259b-40c1-a93d-2bb5ccc0ba0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:04.176838 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c24701-259b-40c1-a93d-2bb5ccc0ba0f service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:04.186378 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1340/2683] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:12:04 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:12:04.227599 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b293ce0-5072-47ac-865d-39f6d42982f2 service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:04.236018 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b293ce0-5072-47ac-865d-39f6d42982f2 service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:04.239650 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec7665-7165-43c5-9e12-69cb389f0895 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:04.240285 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec7665-7165-43c5-9e12-69cb389f0895 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:04.240576 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec7665-7165-43c5-9e12-69cb389f0895 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:04.240857 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec7665-7165-43c5-9e12-69cb389f0895 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:04.297146 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec7665-7165-43c5-9e12-69cb389f0895 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:04.298626 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec7665-7165-43c5-9e12-69cb389f0895 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:04.308689 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1344/2684] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:12:04 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:12:07.380249 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c24701-259b-40c1-a93d-2bb5ccc0ba0f service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:07.440499 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c24701-259b-40c1-a93d-2bb5ccc0ba0f service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:07.445119 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43fb19-39c4-48d3-aecc-cb8db6bd8126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:07.446012 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43fb19-39c4-48d3-aecc-cb8db6bd8126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:07.446297 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43fb19-39c4-48d3-aecc-cb8db6bd8126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:07.446577 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43fb19-39c4-48d3-aecc-cb8db6bd8126 admin admin] PATH_INFO: `/v3/users/f63ac4adcc604fc483bc9a6dcac71857` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:07.447765 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43fb19-39c4-48d3-aecc-cb8db6bd8126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f63ac4adcc604fc483bc9a6dcac71857)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:07.449711 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43fb19-39c4-48d3-aecc-cb8db6bd8126 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:07.492690 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-9f43fb19-39c4-48d3-aecc-cb8db6bd8126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f63ac4adcc604fc483bc9a6dcac71857'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:07.499445 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-9f43fb19-39c4-48d3-aecc-cb8db6bd8126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f63ac4adcc604fc483bc9a6dcac71857'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:07.500113 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-9f43fb19-39c4-48d3-aecc-cb8db6bd8126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f63ac4adcc604fc483bc9a6dcac71857'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:07.511723 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-9f43fb19-39c4-48d3-aecc-cb8db6bd8126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f63ac4adcc604fc483bc9a6dcac71857'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:07.518553 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-9f43fb19-39c4-48d3-aecc-cb8db6bd8126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f63ac4adcc604fc483bc9a6dcac71857'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:07.524339 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1341/2685] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:12:07 2021] DELETE /identity/v3/users/f63ac4adcc604fc483bc9a6dcac71857 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:12:07.529372 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549d8eb-2180-45e6-85a7-8570894ccfb8 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:07.529863 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549d8eb-2180-45e6-85a7-8570894ccfb8 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:07.529948 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549d8eb-2180-45e6-85a7-8570894ccfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:07.546527 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-5549d8eb-2180-45e6-85a7-8570894ccfb8 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:07.547761 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-5549d8eb-2180-45e6-85a7-8570894ccfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:07.603838 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1345/2686] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:12:07.614062 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43fb19-39c4-48d3-aecc-cb8db6bd8126 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:07.615471 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-9f43fb19-39c4-48d3-aecc-cb8db6bd8126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:07.670681 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43fb19-39c4-48d3-aecc-cb8db6bd8126 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:07.674817 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bf213-0a19-4a3c-8753-0ef73081748c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:07.675455 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bf213-0a19-4a3c-8753-0ef73081748c service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:07.675740 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bf213-0a19-4a3c-8753-0ef73081748c service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:07.676011 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bf213-0a19-4a3c-8753-0ef73081748c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:07.684979 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18bf213-0a19-4a3c-8753-0ef73081748c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:07.686521 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18bf213-0a19-4a3c-8753-0ef73081748c service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:07.695788 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1342/2687] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:12:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:12:08.177887 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549d8eb-2180-45e6-85a7-8570894ccfb8 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:08.179313 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-5549d8eb-2180-45e6-85a7-8570894ccfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:08.192480 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549d8eb-2180-45e6-85a7-8570894ccfb8 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:08.199291 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f494c-ff48-4f12-833d-a0c80e199a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:08.200561 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f494c-ff48-4f12-833d-a0c80e199a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:08.200844 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f494c-ff48-4f12-833d-a0c80e199a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:08.201131 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f494c-ff48-4f12-833d-a0c80e199a11 admin admin] PATH_INFO: `/v3/projects/b82d5a22b574474ea44c7f1a2b876c33` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:08.202891 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f494c-ff48-4f12-833d-a0c80e199a11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b82d5a22b574474ea44c7f1a2b876c33)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:08.205341 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f494c-ff48-4f12-833d-a0c80e199a11 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:08.258954 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-e80f494c-ff48-4f12-833d-a0c80e199a11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b82d5a22b574474ea44c7f1a2b876c33', 'request_id': 'req-e80f494c-ff48-4f12-833d-a0c80e199a11'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:08.265105 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-e80f494c-ff48-4f12-833d-a0c80e199a11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b82d5a22b574474ea44c7f1a2b876c33', 'request_id': 'req-e80f494c-ff48-4f12-833d-a0c80e199a11'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:08.273650 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-e80f494c-ff48-4f12-833d-a0c80e199a11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b82d5a22b574474ea44c7f1a2b876c33', 'request_id': 'req-e80f494c-ff48-4f12-833d-a0c80e199a11'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:08.285869 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-e80f494c-ff48-4f12-833d-a0c80e199a11 admin admin] The token cache is being invalidate because project b82d5a22b574474ea44c7f1a2b876c33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:12:08.286151 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-e80f494c-ff48-4f12-833d-a0c80e199a11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:08.286797 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-e80f494c-ff48-4f12-833d-a0c80e199a11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:08.289923 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1346/2688] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:12:08 2021] DELETE /identity/v3/projects/b82d5a22b574474ea44c7f1a2b876c33 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:08.297147 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bf213-0a19-4a3c-8753-0ef73081748c service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:08.297855 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f494c-ff48-4f12-833d-a0c80e199a11 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:08.299497 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-e80f494c-ff48-4f12-833d-a0c80e199a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:08.307979 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bf213-0a19-4a3c-8753-0ef73081748c service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:08.364939 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd933e-20f0-4250-a1ae-8a0973bbeb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:08.365155 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f494c-ff48-4f12-833d-a0c80e199a11 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:08.365986 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd933e-20f0-4250-a1ae-8a0973bbeb77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:08.366424 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd933e-20f0-4250-a1ae-8a0973bbeb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:08.366709 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd933e-20f0-4250-a1ae-8a0973bbeb77 admin admin] PATH_INFO: `/v3/users/71376ff97ee04ddd98d97049cbfe3d36` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:08.367927 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd933e-20f0-4250-a1ae-8a0973bbeb77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71376ff97ee04ddd98d97049cbfe3d36)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:08.370581 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd933e-20f0-4250-a1ae-8a0973bbeb77 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:08.370689 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1449e-4e81-4cc5-8561-8645c6c7b3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:08.371402 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1449e-4e81-4cc5-8561-8645c6c7b3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:08.371683 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1449e-4e81-4cc5-8561-8645c6c7b3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:08.371986 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1449e-4e81-4cc5-8561-8645c6c7b3b4 admin admin] PATH_INFO: `/v3/users/63c7b676a0c84f479374df314034a752` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:08.373199 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1449e-4e81-4cc5-8561-8645c6c7b3b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63c7b676a0c84f479374df314034a752)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:08.375106 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1449e-4e81-4cc5-8561-8645c6c7b3b4 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:08.418472 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-5bdd933e-20f0-4250-a1ae-8a0973bbeb77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71376ff97ee04ddd98d97049cbfe3d36'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:08.425622 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-5bdd933e-20f0-4250-a1ae-8a0973bbeb77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71376ff97ee04ddd98d97049cbfe3d36'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:08.426179 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-92c1449e-4e81-4cc5-8561-8645c6c7b3b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63c7b676a0c84f479374df314034a752'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:08.426538 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-5bdd933e-20f0-4250-a1ae-8a0973bbeb77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71376ff97ee04ddd98d97049cbfe3d36'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:08.434182 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-92c1449e-4e81-4cc5-8561-8645c6c7b3b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63c7b676a0c84f479374df314034a752'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:08.439772 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-5bdd933e-20f0-4250-a1ae-8a0973bbeb77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71376ff97ee04ddd98d97049cbfe3d36'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:08.441047 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-92c1449e-4e81-4cc5-8561-8645c6c7b3b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63c7b676a0c84f479374df314034a752'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:08.441734 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-92c1449e-4e81-4cc5-8561-8645c6c7b3b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63c7b676a0c84f479374df314034a752'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:08.449825 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-5bdd933e-20f0-4250-a1ae-8a0973bbeb77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71376ff97ee04ddd98d97049cbfe3d36'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:08.455242 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-92c1449e-4e81-4cc5-8561-8645c6c7b3b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63c7b676a0c84f479374df314034a752'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:08.456325 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1343/2689] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:12:08 2021] DELETE /identity/v3/users/71376ff97ee04ddd98d97049cbfe3d36 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:12:08.461772 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1347/2690] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:12:08 2021] DELETE /identity/v3/users/63c7b676a0c84f479374df314034a752 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:08.466428 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf43534-b910-44ea-b049-adadebc27bf0 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:08.466912 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf43534-b910-44ea-b049-adadebc27bf0 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:08.467326 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf43534-b910-44ea-b049-adadebc27bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:08.485198 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-fcf43534-b910-44ea-b049-adadebc27bf0 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:08.486554 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-fcf43534-b910-44ea-b049-adadebc27bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:08.546073 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1344/2691] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:12:08.556627 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1449e-4e81-4cc5-8561-8645c6c7b3b4 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:08.558774 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-92c1449e-4e81-4cc5-8561-8645c6c7b3b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:08.617347 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1449e-4e81-4cc5-8561-8645c6c7b3b4 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:08.621341 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7380fa-7340-4c5b-ba45-9c175c5d4855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:08.622002 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7380fa-7340-4c5b-ba45-9c175c5d4855 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:08.622288 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7380fa-7340-4c5b-ba45-9c175c5d4855 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:08.622567 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7380fa-7340-4c5b-ba45-9c175c5d4855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:08.631759 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7380fa-7340-4c5b-ba45-9c175c5d4855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:08.633179 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7380fa-7340-4c5b-ba45-9c175c5d4855 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:08.642803 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1348/2692] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:12:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:12:08.776494 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf43534-b910-44ea-b049-adadebc27bf0 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:08.778808 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-fcf43534-b910-44ea-b049-adadebc27bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:08.790647 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf43534-b910-44ea-b049-adadebc27bf0 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:08.807129 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a9aaf-3a2c-4b0d-bc4e-e7f825a27d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:08.808157 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a9aaf-3a2c-4b0d-bc4e-e7f825a27d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:08.808471 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a9aaf-3a2c-4b0d-bc4e-e7f825a27d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:08.808830 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a9aaf-3a2c-4b0d-bc4e-e7f825a27d98 admin admin] PATH_INFO: `/v3/projects/5d7d6ab186de485e978d31dc85160ee4` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:08.810140 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a9aaf-3a2c-4b0d-bc4e-e7f825a27d98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d7d6ab186de485e978d31dc85160ee4)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:08.812057 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a9aaf-3a2c-4b0d-bc4e-e7f825a27d98 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:08.861240 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-ef3a9aaf-3a2c-4b0d-bc4e-e7f825a27d98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d7d6ab186de485e978d31dc85160ee4', 'request_id': 'req-ef3a9aaf-3a2c-4b0d-bc4e-e7f825a27d98'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:08.868757 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-ef3a9aaf-3a2c-4b0d-bc4e-e7f825a27d98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d7d6ab186de485e978d31dc85160ee4', 'request_id': 'req-ef3a9aaf-3a2c-4b0d-bc4e-e7f825a27d98'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:08.877674 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-ef3a9aaf-3a2c-4b0d-bc4e-e7f825a27d98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d7d6ab186de485e978d31dc85160ee4', 'request_id': 'req-ef3a9aaf-3a2c-4b0d-bc4e-e7f825a27d98'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:08.888693 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-ef3a9aaf-3a2c-4b0d-bc4e-e7f825a27d98 admin admin] The token cache is being invalidate because project 5d7d6ab186de485e978d31dc85160ee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:12:08.888984 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-ef3a9aaf-3a2c-4b0d-bc4e-e7f825a27d98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:08.889666 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-ef3a9aaf-3a2c-4b0d-bc4e-e7f825a27d98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:08.891258 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1345/2693] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:12:08 2021] DELETE /identity/v3/projects/5d7d6ab186de485e978d31dc85160ee4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:12:08.897548 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7aa8c-5bac-4121-b4fd-d943a174b1b0 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:08.897915 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7aa8c-5bac-4121-b4fd-d943a174b1b0 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:08.898224 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7aa8c-5bac-4121-b4fd-d943a174b1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:08.916150 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-82f7aa8c-5bac-4121-b4fd-d943a174b1b0 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:08.917981 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-82f7aa8c-5bac-4121-b4fd-d943a174b1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:08.979904 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1349/2694] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:12:08.983616 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a9aaf-3a2c-4b0d-bc4e-e7f825a27d98 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:08.985077 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-ef3a9aaf-3a2c-4b0d-bc4e-e7f825a27d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:08.987798 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91bc57-2c9a-425b-b544-a49b6ec92333 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:08.988094 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91bc57-2c9a-425b-b544-a49b6ec92333 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:08.988376 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91bc57-2c9a-425b-b544-a49b6ec92333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:09.003666 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a9aaf-3a2c-4b0d-bc4e-e7f825a27d98 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:09.006761 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-4a91bc57-2c9a-425b-b544-a49b6ec92333 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:09.008103 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-4a91bc57-2c9a-425b-b544-a49b6ec92333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:09.009228 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c599e6f-79ff-4ea5-8228-e7e9e7644a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:09.010667 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c599e6f-79ff-4ea5-8228-e7e9e7644a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:09.010957 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c599e6f-79ff-4ea5-8228-e7e9e7644a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:09.011260 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c599e6f-79ff-4ea5-8228-e7e9e7644a23 admin admin] PATH_INFO: `/v3/projects/e99ea38dff21494abd14142ddff86b91` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:09.012453 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c599e6f-79ff-4ea5-8228-e7e9e7644a23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e99ea38dff21494abd14142ddff86b91)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:09.014410 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c599e6f-79ff-4ea5-8228-e7e9e7644a23 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:09.017120 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1350/2695] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:12:09.021143 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91bc57-2c9a-425b-b544-a49b6ec92333 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:09.030757 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91bc57-2c9a-425b-b544-a49b6ec92333 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:09.036385 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe7737-1092-4b73-8d0e-a1bb31b65894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:09.037300 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe7737-1092-4b73-8d0e-a1bb31b65894 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:09.037625 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe7737-1092-4b73-8d0e-a1bb31b65894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:09.037902 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe7737-1092-4b73-8d0e-a1bb31b65894 admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:09.038662 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe7737-1092-4b73-8d0e-a1bb31b65894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 02:12:09.038972 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe7737-1092-4b73-8d0e-a1bb31b65894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:09.040556 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe7737-1092-4b73-8d0e-a1bb31b65894 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:09.053834 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1351/2696] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 02:12:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 02:12:09.058749 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe7737-1092-4b73-8d0e-a1bb31b65894 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:09.066336 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-2c599e6f-79ff-4ea5-8228-e7e9e7644a23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e99ea38dff21494abd14142ddff86b91', 'request_id': 'req-2c599e6f-79ff-4ea5-8228-e7e9e7644a23'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:09.068711 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe7737-1092-4b73-8d0e-a1bb31b65894 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:09.071855 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-2c599e6f-79ff-4ea5-8228-e7e9e7644a23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e99ea38dff21494abd14142ddff86b91', 'request_id': 'req-2c599e6f-79ff-4ea5-8228-e7e9e7644a23'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:09.079223 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-2c599e6f-79ff-4ea5-8228-e7e9e7644a23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e99ea38dff21494abd14142ddff86b91', 'request_id': 'req-2c599e6f-79ff-4ea5-8228-e7e9e7644a23'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:09.090027 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-2c599e6f-79ff-4ea5-8228-e7e9e7644a23 admin admin] The token cache is being invalidate because project e99ea38dff21494abd14142ddff86b91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:12:09.090318 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-2c599e6f-79ff-4ea5-8228-e7e9e7644a23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:09.090964 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-2c599e6f-79ff-4ea5-8228-e7e9e7644a23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:09.092530 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1346/2697] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:12:08 2021] DELETE /identity/v3/projects/e99ea38dff21494abd14142ddff86b91 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:12:09.096407 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c599e6f-79ff-4ea5-8228-e7e9e7644a23 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:09.097809 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-2c599e6f-79ff-4ea5-8228-e7e9e7644a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:09.124557 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cff7b6-3de4-42b1-8086-768a4ed56235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:09.125217 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cff7b6-3de4-42b1-8086-768a4ed56235 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:09.125529 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cff7b6-3de4-42b1-8086-768a4ed56235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:09.125825 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cff7b6-3de4-42b1-8086-768a4ed56235 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:09.126523 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cff7b6-3de4-42b1-8086-768a4ed56235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:09.128464 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cff7b6-3de4-42b1-8086-768a4ed56235 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:09.153180 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1352/2698] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:12:09 2021] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:12:09.157157 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cff7b6-3de4-42b1-8086-768a4ed56235 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:09.158754 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-82cff7b6-3de4-42b1-8086-768a4ed56235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:09.158917 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c599e6f-79ff-4ea5-8228-e7e9e7644a23 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:09.213112 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178a56c-61e6-49ab-a274-a43ba1010356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:09.214025 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178a56c-61e6-49ab-a274-a43ba1010356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:09.214350 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178a56c-61e6-49ab-a274-a43ba1010356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:09.214636 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178a56c-61e6-49ab-a274-a43ba1010356 admin admin] PATH_INFO: `/v3/users/ff70a22a4c304fedb2e5fd378d81dd3a` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:09.215838 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178a56c-61e6-49ab-a274-a43ba1010356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff70a22a4c304fedb2e5fd378d81dd3a)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:09.217811 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178a56c-61e6-49ab-a274-a43ba1010356 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:09.219017 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cff7b6-3de4-42b1-8086-768a4ed56235 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:09.223767 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5be476-9a84-4c16-8cd0-2ef562d773ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:09.224431 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5be476-9a84-4c16-8cd0-2ef562d773ef admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:09.224717 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5be476-9a84-4c16-8cd0-2ef562d773ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:09.225000 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5be476-9a84-4c16-8cd0-2ef562d773ef admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:09.225753 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5be476-9a84-4c16-8cd0-2ef562d773ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:09.227645 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5be476-9a84-4c16-8cd0-2ef562d773ef admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:09.249221 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1353/2699] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:12:09 2021] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:12:09.253437 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5be476-9a84-4c16-8cd0-2ef562d773ef admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:09.263151 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5be476-9a84-4c16-8cd0-2ef562d773ef admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:09.263907 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b178a56c-61e6-49ab-a274-a43ba1010356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff70a22a4c304fedb2e5fd378d81dd3a'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:09.267904 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa9a13-9fbb-474f-a5d6-8f86904ec3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:09.268599 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa9a13-9fbb-474f-a5d6-8f86904ec3fd admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:09.268891 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa9a13-9fbb-474f-a5d6-8f86904ec3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:09.269173 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa9a13-9fbb-474f-a5d6-8f86904ec3fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:09.269934 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa9a13-9fbb-474f-a5d6-8f86904ec3fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:09.270831 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b178a56c-61e6-49ab-a274-a43ba1010356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff70a22a4c304fedb2e5fd378d81dd3a'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:09.271510 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b178a56c-61e6-49ab-a274-a43ba1010356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff70a22a4c304fedb2e5fd378d81dd3a'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:09.271650 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa9a13-9fbb-474f-a5d6-8f86904ec3fd admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:09.284636 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1354/2700] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:09 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:12:09.285778 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa9a13-9fbb-474f-a5d6-8f86904ec3fd admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:09.286042 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b178a56c-61e6-49ab-a274-a43ba1010356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff70a22a4c304fedb2e5fd378d81dd3a'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:09.287419 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-02aa9a13-9fbb-474f-a5d6-8f86904ec3fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:09.294101 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-b178a56c-61e6-49ab-a274-a43ba1010356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff70a22a4c304fedb2e5fd378d81dd3a'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:09.300254 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1347/2701] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:12:09 2021] DELETE /identity/v3/users/ff70a22a4c304fedb2e5fd378d81dd3a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:09.302228 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa9a13-9fbb-474f-a5d6-8f86904ec3fd admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:09.359108 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b22c72-a370-45fe-bf8a-c13ca2bcabcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:09.360138 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b22c72-a370-45fe-bf8a-c13ca2bcabcc admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:09.360554 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b22c72-a370-45fe-bf8a-c13ca2bcabcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:09.361043 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b22c72-a370-45fe-bf8a-c13ca2bcabcc admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:09.362415 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b22c72-a370-45fe-bf8a-c13ca2bcabcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:09.364596 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b22c72-a370-45fe-bf8a-c13ca2bcabcc admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:09.377132 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1355/2702] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:09 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:12:09.381418 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178a56c-61e6-49ab-a274-a43ba1010356 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:09.392211 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178a56c-61e6-49ab-a274-a43ba1010356 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:09.396888 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9965e17-c8f0-4198-b4d1-55e9b0034670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:09.397804 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9965e17-c8f0-4198-b4d1-55e9b0034670 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:09.398086 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9965e17-c8f0-4198-b4d1-55e9b0034670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:09.398363 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9965e17-c8f0-4198-b4d1-55e9b0034670 admin admin] PATH_INFO: `/v3/projects/b5e97494829b405789c06401f828de21/users/1482627426674b5eb43cdeaf94e09bcc/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:09.414779 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9965e17-c8f0-4198-b4d1-55e9b0034670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5e97494829b405789c06401f828de21, user_id=1482627426674b5eb43cdeaf94e09bcc, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:09.418108 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9965e17-c8f0-4198-b4d1-55e9b0034670 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:09.433875 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1348/2703] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:12:09 2021] PUT /identity/v3/projects/b5e97494829b405789c06401f828de21/users/1482627426674b5eb43cdeaf94e09bcc/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:12:09.444136 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121934c-a2cf-4b59-9a52-074930843ad0 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:09.444433 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121934c-a2cf-4b59-9a52-074930843ad0 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:09.444719 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121934c-a2cf-4b59-9a52-074930843ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:09.475977 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-8121934c-a2cf-4b59-9a52-074930843ad0 None None] MFA Rules not processed for user `1482627426674b5eb43cdeaf94e09bcc`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:09.477217 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-8121934c-a2cf-4b59-9a52-074930843ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:09.540477 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1356/2704] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:09 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:12:09.545700 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9965e17-c8f0-4198-b4d1-55e9b0034670 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:09.577218 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121934c-a2cf-4b59-9a52-074930843ad0 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:09.578799 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-8121934c-a2cf-4b59-9a52-074930843ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:09.610700 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9965e17-c8f0-4198-b4d1-55e9b0034670 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:09.615503 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f358b46-7a3e-4b45-8244-405e16dae7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:09.616161 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f358b46-7a3e-4b45-8244-405e16dae7ab admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:09.616455 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f358b46-7a3e-4b45-8244-405e16dae7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:09.616738 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f358b46-7a3e-4b45-8244-405e16dae7ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:09.617443 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f358b46-7a3e-4b45-8244-405e16dae7ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:09.619360 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f358b46-7a3e-4b45-8244-405e16dae7ab admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:09.644322 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1349/2705] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:12:09 2021] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:12:09.648113 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f358b46-7a3e-4b45-8244-405e16dae7ab admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:09.648588 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121934c-a2cf-4b59-9a52-074930843ad0 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:09.703100 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211c4fb-848d-4eef-b52c-b15ae39a5eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:09.703957 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211c4fb-848d-4eef-b52c-b15ae39a5eb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:09.704239 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211c4fb-848d-4eef-b52c-b15ae39a5eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:09.704515 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211c4fb-848d-4eef-b52c-b15ae39a5eb0 admin admin] PATH_INFO: `/v3/projects/0d07f51ad0664851aca2dd1a5b5ac67a` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:09.705730 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211c4fb-848d-4eef-b52c-b15ae39a5eb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d07f51ad0664851aca2dd1a5b5ac67a)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:09.707646 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211c4fb-848d-4eef-b52c-b15ae39a5eb0 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:09.709333 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f358b46-7a3e-4b45-8244-405e16dae7ab admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:09.714835 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70995250-382c-4f69-b9e3-38a3d27f6350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:09.715494 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70995250-382c-4f69-b9e3-38a3d27f6350 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:09.715782 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70995250-382c-4f69-b9e3-38a3d27f6350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:09.716065 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70995250-382c-4f69-b9e3-38a3d27f6350 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:09.716766 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70995250-382c-4f69-b9e3-38a3d27f6350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:09.718728 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70995250-382c-4f69-b9e3-38a3d27f6350 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:09.739913 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1350/2706] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:12:09 2021] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:12:09.743683 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70995250-382c-4f69-b9e3-38a3d27f6350 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:09.752869 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-7211c4fb-848d-4eef-b52c-b15ae39a5eb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d07f51ad0664851aca2dd1a5b5ac67a', 'request_id': 'req-7211c4fb-848d-4eef-b52c-b15ae39a5eb0'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:09.753059 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70995250-382c-4f69-b9e3-38a3d27f6350 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:09.758243 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-7211c4fb-848d-4eef-b52c-b15ae39a5eb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d07f51ad0664851aca2dd1a5b5ac67a', 'request_id': 'req-7211c4fb-848d-4eef-b52c-b15ae39a5eb0'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:09.766482 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-7211c4fb-848d-4eef-b52c-b15ae39a5eb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d07f51ad0664851aca2dd1a5b5ac67a', 'request_id': 'req-7211c4fb-848d-4eef-b52c-b15ae39a5eb0'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:09.778155 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-7211c4fb-848d-4eef-b52c-b15ae39a5eb0 admin admin] The token cache is being invalidate because project 0d07f51ad0664851aca2dd1a5b5ac67a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:12:09.778445 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-7211c4fb-848d-4eef-b52c-b15ae39a5eb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:09.779122 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-7211c4fb-848d-4eef-b52c-b15ae39a5eb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:09.780872 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1357/2707] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:12:09 2021] DELETE /identity/v3/projects/0d07f51ad0664851aca2dd1a5b5ac67a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:12:09.786023 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c94f9a-beea-45d1-8db9-90461b6d2b54 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:09.786312 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c94f9a-beea-45d1-8db9-90461b6d2b54 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:09.786600 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c94f9a-beea-45d1-8db9-90461b6d2b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:09.804538 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-80c94f9a-beea-45d1-8db9-90461b6d2b54 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:09.805814 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-80c94f9a-beea-45d1-8db9-90461b6d2b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:09.808736 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff02c0-c3a6-41b5-a70e-df276d6b78fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:09.809402 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff02c0-c3a6-41b5-a70e-df276d6b78fe admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:09.809722 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff02c0-c3a6-41b5-a70e-df276d6b78fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:09.810001 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff02c0-c3a6-41b5-a70e-df276d6b78fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:09.810861 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff02c0-c3a6-41b5-a70e-df276d6b78fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:09.812439 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff02c0-c3a6-41b5-a70e-df276d6b78fe admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:09.813665 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1358/2708] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:12:09.822367 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1351/2709] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:09 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:12:09.827279 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c94f9a-beea-45d1-8db9-90461b6d2b54 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:09.828800 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-80c94f9a-beea-45d1-8db9-90461b6d2b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:09.841907 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c94f9a-beea-45d1-8db9-90461b6d2b54 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:09.847029 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ae650-74d0-4691-b844-b7d9db6d43cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:09.847951 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ae650-74d0-4691-b844-b7d9db6d43cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:09.848330 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ae650-74d0-4691-b844-b7d9db6d43cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:09.848610 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ae650-74d0-4691-b844-b7d9db6d43cc admin admin] PATH_INFO: `/v3/projects/bd59db1469bf4ef080e4928972f4fe42/users/37dd3e6697d448ad8c00b915e097a1e9/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:09.864277 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ae650-74d0-4691-b844-b7d9db6d43cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd59db1469bf4ef080e4928972f4fe42, user_id=37dd3e6697d448ad8c00b915e097a1e9, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:09.864887 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb4b25-e435-4e78-b596-8f0c5f794f29 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:09.865179 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb4b25-e435-4e78-b596-8f0c5f794f29 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:09.865461 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb4b25-e435-4e78-b596-8f0c5f794f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:09.866957 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ae650-74d0-4691-b844-b7d9db6d43cc admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:09.879877 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1359/2710] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:12:09 2021] PUT /identity/v3/projects/bd59db1469bf4ef080e4928972f4fe42/users/37dd3e6697d448ad8c00b915e097a1e9/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:12:09.883646 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ae650-74d0-4691-b844-b7d9db6d43cc admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:09.888756 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-96fb4b25-e435-4e78-b596-8f0c5f794f29 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:09.890011 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-96fb4b25-e435-4e78-b596-8f0c5f794f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:09.944073 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ae650-74d0-4691-b844-b7d9db6d43cc admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:09.947462 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1352/2711] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:12:09.950847 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e170a7-1750-4e84-a4f1-5fbde8ef05f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:09.951583 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e170a7-1750-4e84-a4f1-5fbde8ef05f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:09.951878 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e170a7-1750-4e84-a4f1-5fbde8ef05f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:09.952128 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb4b25-e435-4e78-b596-8f0c5f794f29 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:09.952220 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e170a7-1750-4e84-a4f1-5fbde8ef05f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:09.952894 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e170a7-1750-4e84-a4f1-5fbde8ef05f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:09.954508 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e170a7-1750-4e84-a4f1-5fbde8ef05f3 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:09.961102 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb4b25-e435-4e78-b596-8f0c5f794f29 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:09.965822 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1360/2712] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:09 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:12:09.970265 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bb8c7-a15e-49b4-93a2-6f718812c078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:09.970971 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e170a7-1750-4e84-a4f1-5fbde8ef05f3 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:09.971080 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bb8c7-a15e-49b4-93a2-6f718812c078 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:09.971208 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bb8c7-a15e-49b4-93a2-6f718812c078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:09.971488 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bb8c7-a15e-49b4-93a2-6f718812c078 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:09.972227 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45bb8c7-a15e-49b4-93a2-6f718812c078 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 02:12:09.972536 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45bb8c7-a15e-49b4-93a2-6f718812c078 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:09.974486 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45bb8c7-a15e-49b4-93a2-6f718812c078 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:09.981355 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e170a7-1750-4e84-a4f1-5fbde8ef05f3 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:09.986130 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58864711-b096-4223-b7fb-3dceb1e99dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:09.987001 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58864711-b096-4223-b7fb-3dceb1e99dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:09.987286 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58864711-b096-4223-b7fb-3dceb1e99dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:09.987565 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58864711-b096-4223-b7fb-3dceb1e99dcd admin admin] PATH_INFO: `/v3/projects/bd59db1469bf4ef080e4928972f4fe42/users/37dd3e6697d448ad8c00b915e097a1e9/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:09.987889 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1353/2713] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 02:12:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 02:12:09.989722 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58864711-b096-4223-b7fb-3dceb1e99dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd59db1469bf4ef080e4928972f4fe42, user_id=37dd3e6697d448ad8c00b915e097a1e9, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:09.992036 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bb8c7-a15e-49b4-93a2-6f718812c078 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:09.992338 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58864711-b096-4223-b7fb-3dceb1e99dcd admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:10.001357 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bb8c7-a15e-49b4-93a2-6f718812c078 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:10.002945 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1361/2714] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:12:09 2021] PUT /identity/v3/projects/bd59db1469bf4ef080e4928972f4fe42/users/37dd3e6697d448ad8c00b915e097a1e9/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:12:10.014365 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9c05c-d8a9-4fb5-b79b-2d1e905b2d2b None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:10.014659 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9c05c-d8a9-4fb5-b79b-2d1e905b2d2b None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:10.014944 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9c05c-d8a9-4fb5-b79b-2d1e905b2d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:10.040753 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-a8d9c05c-d8a9-4fb5-b79b-2d1e905b2d2b None None] MFA Rules not processed for user `37dd3e6697d448ad8c00b915e097a1e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:10.042051 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-a8d9c05c-d8a9-4fb5-b79b-2d1e905b2d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:10.056434 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ebc6d-f19b-48b2-b094-6d40b5dca6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:10.057094 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ebc6d-f19b-48b2-b094-6d40b5dca6db admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:10.057374 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ebc6d-f19b-48b2-b094-6d40b5dca6db admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:10.057682 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ebc6d-f19b-48b2-b094-6d40b5dca6db admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:10.058384 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ebc6d-f19b-48b2-b094-6d40b5dca6db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:10.060271 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ebc6d-f19b-48b2-b094-6d40b5dca6db admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:10.087101 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1354/2715] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:12:09 2021] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:12:10.091761 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ebc6d-f19b-48b2-b094-6d40b5dca6db admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:10.110089 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1362/2716] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:10 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:12:10.120194 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9c05c-d8a9-4fb5-b79b-2d1e905b2d2b None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:10.121576 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-a8d9c05c-d8a9-4fb5-b79b-2d1e905b2d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:10.153092 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ebc6d-f19b-48b2-b094-6d40b5dca6db admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:10.157833 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e0a3c-7a50-4784-b46c-ec8f47ffabda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:10.158495 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e0a3c-7a50-4784-b46c-ec8f47ffabda admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:10.158783 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e0a3c-7a50-4784-b46c-ec8f47ffabda admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:10.159064 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e0a3c-7a50-4784-b46c-ec8f47ffabda admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:10.159761 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e0a3c-7a50-4784-b46c-ec8f47ffabda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:10.161681 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e0a3c-7a50-4784-b46c-ec8f47ffabda admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:10.175788 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9c05c-d8a9-4fb5-b79b-2d1e905b2d2b None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:10.181382 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1355/2717] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:12:10 2021] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:12:10.186062 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e0a3c-7a50-4784-b46c-ec8f47ffabda admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:10.195555 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e0a3c-7a50-4784-b46c-ec8f47ffabda admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:10.201044 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6492b-06d0-4b78-a78f-d76924c25536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:10.201711 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6492b-06d0-4b78-a78f-d76924c25536 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:10.202005 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6492b-06d0-4b78-a78f-d76924c25536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:10.202290 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6492b-06d0-4b78-a78f-d76924c25536 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:10.203018 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6492b-06d0-4b78-a78f-d76924c25536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:10.204586 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6492b-06d0-4b78-a78f-d76924c25536 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:10.214237 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1356/2718] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:10 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:12:10.217941 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6492b-06d0-4b78-a78f-d76924c25536 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:10.224066 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fa136-361c-41bb-84a9-e1a87e990611 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:10.224830 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fa136-361c-41bb-84a9-e1a87e990611 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:10.225138 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fa136-361c-41bb-84a9-e1a87e990611 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:10.225407 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fa136-361c-41bb-84a9-e1a87e990611 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:10.227560 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6492b-06d0-4b78-a78f-d76924c25536 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:10.232180 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab993b4-a754-40dd-a723-26a7199d56bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:10.232833 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab993b4-a754-40dd-a723-26a7199d56bf admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:10.233119 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab993b4-a754-40dd-a723-26a7199d56bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:10.233402 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab993b4-a754-40dd-a723-26a7199d56bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:10.234158 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab993b4-a754-40dd-a723-26a7199d56bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:10.235862 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab993b4-a754-40dd-a723-26a7199d56bf admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:10.246144 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1357/2719] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:10 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:12:10.249976 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab993b4-a754-40dd-a723-26a7199d56bf admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:10.259194 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab993b4-a754-40dd-a723-26a7199d56bf admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:10.264402 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e7189-702b-4246-8051-8ea813d36e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:10.265243 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e7189-702b-4246-8051-8ea813d36e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:10.265562 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e7189-702b-4246-8051-8ea813d36e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:10.265850 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e7189-702b-4246-8051-8ea813d36e40 admin admin] PATH_INFO: `/v3/projects/5d35afc4f2a5405ea168b5823fbc735c/users/7026072ac27a4ef69c6785e2358e9259/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:10.280185 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e7189-702b-4246-8051-8ea813d36e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d35afc4f2a5405ea168b5823fbc735c, user_id=7026072ac27a4ef69c6785e2358e9259, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:10.282844 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e7189-702b-4246-8051-8ea813d36e40 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:10.284332 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fa136-361c-41bb-84a9-e1a87e990611 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:10.285945 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fa136-361c-41bb-84a9-e1a87e990611 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:10.295180 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1358/2720] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:12:10 2021] PUT /identity/v3/projects/5d35afc4f2a5405ea168b5823fbc735c/users/7026072ac27a4ef69c6785e2358e9259/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:10.295575 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1363/2721] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:12:10 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 02:12:10.305296 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e064f-5916-4ad9-ae51-55a62fb0b2ce None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:10.305815 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e064f-5916-4ad9-ae51-55a62fb0b2ce None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:10.306100 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e064f-5916-4ad9-ae51-55a62fb0b2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:10.333462 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-3a9e064f-5916-4ad9-ae51-55a62fb0b2ce None None] MFA Rules not processed for user `7026072ac27a4ef69c6785e2358e9259`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:10.334690 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3a9e064f-5916-4ad9-ae51-55a62fb0b2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:10.400805 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1359/2722] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:10 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:12:10.402610 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fa136-361c-41bb-84a9-e1a87e990611 service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:10.413247 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fa136-361c-41bb-84a9-e1a87e990611 service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:10.471561 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01406854-bf43-4e90-8fd3-5452b48214fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:10.472229 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01406854-bf43-4e90-8fd3-5452b48214fc admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:10.472516 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01406854-bf43-4e90-8fd3-5452b48214fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:10.472799 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01406854-bf43-4e90-8fd3-5452b48214fc admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:10.473535 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01406854-bf43-4e90-8fd3-5452b48214fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:10.475412 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01406854-bf43-4e90-8fd3-5452b48214fc admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:10.502219 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1364/2723] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:12:10 2021] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:12:10.506438 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e064f-5916-4ad9-ae51-55a62fb0b2ce None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:10.517446 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e064f-5916-4ad9-ae51-55a62fb0b2ce None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:10.576192 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b059b4-1c7f-4a02-ab58-4a2c9d5da543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:10.576987 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b059b4-1c7f-4a02-ab58-4a2c9d5da543 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:10.577305 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b059b4-1c7f-4a02-ab58-4a2c9d5da543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:10.577652 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b059b4-1c7f-4a02-ab58-4a2c9d5da543 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:10.578382 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b059b4-1c7f-4a02-ab58-4a2c9d5da543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:10.580289 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b059b4-1c7f-4a02-ab58-4a2c9d5da543 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:10.600319 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1360/2724] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:12:10 2021] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:12:10.604839 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01406854-bf43-4e90-8fd3-5452b48214fc admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:10.615786 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01406854-bf43-4e90-8fd3-5452b48214fc admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:10.621670 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c864a4-0e9e-4196-8baf-499244c628c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:10.622334 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c864a4-0e9e-4196-8baf-499244c628c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:10.622625 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c864a4-0e9e-4196-8baf-499244c628c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:10.622906 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c864a4-0e9e-4196-8baf-499244c628c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:10.623660 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c864a4-0e9e-4196-8baf-499244c628c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:10.625226 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c864a4-0e9e-4196-8baf-499244c628c8 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:10.634589 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b059b4-1c7f-4a02-ab58-4a2c9d5da543 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:10.641811 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1365/2725] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:10 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:12:10.645223 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c864a4-0e9e-4196-8baf-499244c628c8 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:10.645678 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b059b4-1c7f-4a02-ab58-4a2c9d5da543 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:10.650440 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836b5c7-e1e9-47fe-8b06-cf6855c52f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:10.651378 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836b5c7-e1e9-47fe-8b06-cf6855c52f4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:10.651666 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836b5c7-e1e9-47fe-8b06-cf6855c52f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:10.651948 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836b5c7-e1e9-47fe-8b06-cf6855c52f4a admin admin] PATH_INFO: `/v3/users/1482627426674b5eb43cdeaf94e09bcc` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:10.653192 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836b5c7-e1e9-47fe-8b06-cf6855c52f4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1482627426674b5eb43cdeaf94e09bcc)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:10.655155 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836b5c7-e1e9-47fe-8b06-cf6855c52f4a admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:10.655256 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c864a4-0e9e-4196-8baf-499244c628c8 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:10.659849 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13bde0-9e51-4b74-860f-7a1f71c9a545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:10.660699 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13bde0-9e51-4b74-860f-7a1f71c9a545 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:10.660983 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13bde0-9e51-4b74-860f-7a1f71c9a545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:10.661258 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13bde0-9e51-4b74-860f-7a1f71c9a545 admin admin] PATH_INFO: `/v3/projects/c356a4fd1d1f4adc88edc9576ea5e9e6/users/df63d39e56b342779f968a2fd3b84341/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:10.676553 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13bde0-9e51-4b74-860f-7a1f71c9a545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c356a4fd1d1f4adc88edc9576ea5e9e6, user_id=df63d39e56b342779f968a2fd3b84341, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:10.679189 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13bde0-9e51-4b74-860f-7a1f71c9a545 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:10.692663 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1366/2726] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:12:10 2021] PUT /identity/v3/projects/c356a4fd1d1f4adc88edc9576ea5e9e6/users/df63d39e56b342779f968a2fd3b84341/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:10.696571 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13bde0-9e51-4b74-860f-7a1f71c9a545 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:10.701091 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-c836b5c7-e1e9-47fe-8b06-cf6855c52f4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1482627426674b5eb43cdeaf94e09bcc'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:10.707679 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-c836b5c7-e1e9-47fe-8b06-cf6855c52f4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1482627426674b5eb43cdeaf94e09bcc'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:10.708346 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-c836b5c7-e1e9-47fe-8b06-cf6855c52f4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1482627426674b5eb43cdeaf94e09bcc'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:10.719790 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-c836b5c7-e1e9-47fe-8b06-cf6855c52f4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1482627426674b5eb43cdeaf94e09bcc'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:10.727001 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-c836b5c7-e1e9-47fe-8b06-cf6855c52f4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1482627426674b5eb43cdeaf94e09bcc'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:10.733332 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1361/2727] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:12:10 2021] DELETE /identity/v3/users/1482627426674b5eb43cdeaf94e09bcc => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:10.737844 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88004ef1-034b-4b7f-b1d3-e49fff9333fb None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:10.738133 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88004ef1-034b-4b7f-b1d3-e49fff9333fb None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:10.738411 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88004ef1-034b-4b7f-b1d3-e49fff9333fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:10.755651 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-88004ef1-034b-4b7f-b1d3-e49fff9333fb None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:10.756151 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13bde0-9e51-4b74-860f-7a1f71c9a545 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:10.756863 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-88004ef1-034b-4b7f-b1d3-e49fff9333fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:10.810663 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da9d38-4a32-4eb0-830c-5fe3d36fdb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:10.811555 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da9d38-4a32-4eb0-830c-5fe3d36fdb31 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:10.811851 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da9d38-4a32-4eb0-830c-5fe3d36fdb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:10.812162 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da9d38-4a32-4eb0-830c-5fe3d36fdb31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:10.812898 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da9d38-4a32-4eb0-830c-5fe3d36fdb31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:10.814216 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1362/2728] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:12:10.814524 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da9d38-4a32-4eb0-830c-5fe3d36fdb31 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:10.824156 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88004ef1-034b-4b7f-b1d3-e49fff9333fb None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:10.824374 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1367/2729] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:10 2021] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:12:10.825556 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-88004ef1-034b-4b7f-b1d3-e49fff9333fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:10.828124 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da9d38-4a32-4eb0-830c-5fe3d36fdb31 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:10.829766 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-c9da9d38-4a32-4eb0-830c-5fe3d36fdb31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:10.842059 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da9d38-4a32-4eb0-830c-5fe3d36fdb31 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:10.846988 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10e373-e6d6-4221-af05-e361aea98693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:10.847857 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10e373-e6d6-4221-af05-e361aea98693 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:10.848223 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10e373-e6d6-4221-af05-e361aea98693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:10.848509 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10e373-e6d6-4221-af05-e361aea98693 admin admin] PATH_INFO: `/v3/projects/c356a4fd1d1f4adc88edc9576ea5e9e6/users/df63d39e56b342779f968a2fd3b84341/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:10.850517 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f10e373-e6d6-4221-af05-e361aea98693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c356a4fd1d1f4adc88edc9576ea5e9e6, user_id=df63d39e56b342779f968a2fd3b84341, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:10.853113 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f10e373-e6d6-4221-af05-e361aea98693 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:10.864312 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1368/2730] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:12:10 2021] PUT /identity/v3/projects/c356a4fd1d1f4adc88edc9576ea5e9e6/users/df63d39e56b342779f968a2fd3b84341/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:10.875755 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd173dd-1434-4923-aa8e-ec0ce521b412 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:10.876128 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd173dd-1434-4923-aa8e-ec0ce521b412 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:10.876420 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd173dd-1434-4923-aa8e-ec0ce521b412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:10.881953 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88004ef1-034b-4b7f-b1d3-e49fff9333fb None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:10.904339 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-fbd173dd-1434-4923-aa8e-ec0ce521b412 None None] MFA Rules not processed for user `df63d39e56b342779f968a2fd3b84341`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:10.905595 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-fbd173dd-1434-4923-aa8e-ec0ce521b412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:10.929221 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dae981-adba-4e50-9278-2ac325452868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:10.929981 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dae981-adba-4e50-9278-2ac325452868 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:10.930262 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dae981-adba-4e50-9278-2ac325452868 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:10.930536 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dae981-adba-4e50-9278-2ac325452868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:10.974365 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1369/2731] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:10 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:12:10.986256 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd173dd-1434-4923-aa8e-ec0ce521b412 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:10.987697 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-fbd173dd-1434-4923-aa8e-ec0ce521b412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:10.990084 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dae981-adba-4e50-9278-2ac325452868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:10.991709 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dae981-adba-4e50-9278-2ac325452868 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:11.001557 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1363/2732] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:12:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:12:11.042392 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd173dd-1434-4923-aa8e-ec0ce521b412 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:11.046078 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fdde6-2eab-4ee0-a71a-f9a1067b3884 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:11.046721 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fdde6-2eab-4ee0-a71a-f9a1067b3884 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:11.047004 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fdde6-2eab-4ee0-a71a-f9a1067b3884 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:11.047281 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fdde6-2eab-4ee0-a71a-f9a1067b3884 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:11.056388 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2fdde6-2eab-4ee0-a71a-f9a1067b3884 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:11.057880 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2fdde6-2eab-4ee0-a71a-f9a1067b3884 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:11.068665 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1370/2733] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:12:10 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 02:12:11.137231 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dae981-adba-4e50-9278-2ac325452868 service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:11.147300 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dae981-adba-4e50-9278-2ac325452868 service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:11.152380 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00cef9-4f9e-48fb-972b-da801aa211ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:11.153066 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00cef9-4f9e-48fb-972b-da801aa211ec service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:11.153356 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00cef9-4f9e-48fb-972b-da801aa211ec service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:11.153668 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00cef9-4f9e-48fb-972b-da801aa211ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:11.155449 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-bb00cef9-4f9e-48fb-972b-da801aa211ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:11.215091 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb00cef9-4f9e-48fb-972b-da801aa211ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:11.216515 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb00cef9-4f9e-48fb-972b-da801aa211ec service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:11.225952 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1364/2734] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:12:11 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:12:11.271274 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fdde6-2eab-4ee0-a71a-f9a1067b3884 service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:11.272783 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-da2fdde6-2eab-4ee0-a71a-f9a1067b3884 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:11.289173 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fdde6-2eab-4ee0-a71a-f9a1067b3884 service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:11.294270 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b2a24-3f05-4499-bec5-54424a0821f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:11.295125 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b2a24-3f05-4499-bec5-54424a0821f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:11.295407 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b2a24-3f05-4499-bec5-54424a0821f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:11.295944 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b2a24-3f05-4499-bec5-54424a0821f6 admin admin] PATH_INFO: `/v3/projects/b5e97494829b405789c06401f828de21` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:11.297166 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b2a24-3f05-4499-bec5-54424a0821f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5e97494829b405789c06401f828de21)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:11.299106 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b2a24-3f05-4499-bec5-54424a0821f6 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:11.350708 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-f14b2a24-3f05-4499-bec5-54424a0821f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5e97494829b405789c06401f828de21', 'request_id': 'req-f14b2a24-3f05-4499-bec5-54424a0821f6'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:11.356061 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-f14b2a24-3f05-4499-bec5-54424a0821f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5e97494829b405789c06401f828de21', 'request_id': 'req-f14b2a24-3f05-4499-bec5-54424a0821f6'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:11.364009 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-f14b2a24-3f05-4499-bec5-54424a0821f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5e97494829b405789c06401f828de21', 'request_id': 'req-f14b2a24-3f05-4499-bec5-54424a0821f6'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:11.374981 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-f14b2a24-3f05-4499-bec5-54424a0821f6 admin admin] The token cache is being invalidate because project b5e97494829b405789c06401f828de21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:12:11.375383 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-f14b2a24-3f05-4499-bec5-54424a0821f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:11.376108 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-f14b2a24-3f05-4499-bec5-54424a0821f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:11.377672 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1371/2735] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:12:11 2021] DELETE /identity/v3/projects/b5e97494829b405789c06401f828de21 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:12:11.381566 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00cef9-4f9e-48fb-972b-da801aa211ec service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:11.394159 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00cef9-4f9e-48fb-972b-da801aa211ec service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:11.451969 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a50499-6fa8-4c6d-b51c-debb9702819b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:11.452834 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a50499-6fa8-4c6d-b51c-debb9702819b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:11.453115 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a50499-6fa8-4c6d-b51c-debb9702819b admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:11.453419 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a50499-6fa8-4c6d-b51c-debb9702819b admin admin] PATH_INFO: `/v3/users/37dd3e6697d448ad8c00b915e097a1e9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:11.455118 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a50499-6fa8-4c6d-b51c-debb9702819b admin admin] RBAC: Authorizing `identity:delete_user(user_id=37dd3e6697d448ad8c00b915e097a1e9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:11.460306 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a50499-6fa8-4c6d-b51c-debb9702819b admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:11.476331 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b2a24-3f05-4499-bec5-54424a0821f6 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:11.477771 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-f14b2a24-3f05-4499-bec5-54424a0821f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:11.491752 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b2a24-3f05-4499-bec5-54424a0821f6 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:11.496411 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55380212-15ff-4906-82cc-8bb4d2689d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:11.497273 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55380212-15ff-4906-82cc-8bb4d2689d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:11.497618 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55380212-15ff-4906-82cc-8bb4d2689d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:11.497908 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55380212-15ff-4906-82cc-8bb4d2689d35 admin admin] PATH_INFO: `/v3/users/7026072ac27a4ef69c6785e2358e9259` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:11.499221 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55380212-15ff-4906-82cc-8bb4d2689d35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7026072ac27a4ef69c6785e2358e9259)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:11.501292 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55380212-15ff-4906-82cc-8bb4d2689d35 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:11.503709 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-a7a50499-6fa8-4c6d-b51c-debb9702819b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37dd3e6697d448ad8c00b915e097a1e9'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:11.510785 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-a7a50499-6fa8-4c6d-b51c-debb9702819b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37dd3e6697d448ad8c00b915e097a1e9'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:11.511472 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-a7a50499-6fa8-4c6d-b51c-debb9702819b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37dd3e6697d448ad8c00b915e097a1e9'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:11.522697 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-a7a50499-6fa8-4c6d-b51c-debb9702819b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37dd3e6697d448ad8c00b915e097a1e9'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:11.530943 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-a7a50499-6fa8-4c6d-b51c-debb9702819b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37dd3e6697d448ad8c00b915e097a1e9'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:11.537520 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1365/2736] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:12:11 2021] DELETE /identity/v3/users/37dd3e6697d448ad8c00b915e097a1e9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:11.550488 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-55380212-15ff-4906-82cc-8bb4d2689d35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7026072ac27a4ef69c6785e2358e9259'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:11.558386 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-55380212-15ff-4906-82cc-8bb4d2689d35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7026072ac27a4ef69c6785e2358e9259'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:11.565568 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-55380212-15ff-4906-82cc-8bb4d2689d35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7026072ac27a4ef69c6785e2358e9259'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:11.566337 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-55380212-15ff-4906-82cc-8bb4d2689d35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7026072ac27a4ef69c6785e2358e9259'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:11.579170 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-55380212-15ff-4906-82cc-8bb4d2689d35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7026072ac27a4ef69c6785e2358e9259'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:11.585312 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1372/2737] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:12:11 2021] DELETE /identity/v3/users/7026072ac27a4ef69c6785e2358e9259 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:11.590991 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092bb42-d2d4-469d-ab0e-ebe4c0ff22a2 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:11.591267 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092bb42-d2d4-469d-ab0e-ebe4c0ff22a2 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:11.591546 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092bb42-d2d4-469d-ab0e-ebe4c0ff22a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:11.610134 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-2092bb42-d2d4-469d-ab0e-ebe4c0ff22a2 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:11.611406 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-2092bb42-d2d4-469d-ab0e-ebe4c0ff22a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:11.669260 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1366/2738] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:12:11.679692 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55380212-15ff-4906-82cc-8bb4d2689d35 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:11.681101 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-55380212-15ff-4906-82cc-8bb4d2689d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:11.738159 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55380212-15ff-4906-82cc-8bb4d2689d35 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:11.741875 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09079e-fbe8-4f43-8dcd-5012f20afa21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:11.742525 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09079e-fbe8-4f43-8dcd-5012f20afa21 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:11.742814 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09079e-fbe8-4f43-8dcd-5012f20afa21 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:11.743096 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09079e-fbe8-4f43-8dcd-5012f20afa21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:11.752258 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09079e-fbe8-4f43-8dcd-5012f20afa21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:11.753600 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09079e-fbe8-4f43-8dcd-5012f20afa21 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:11.763838 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1373/2739] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:12:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:12:11.809539 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092bb42-d2d4-469d-ab0e-ebe4c0ff22a2 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:11.810750 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-2092bb42-d2d4-469d-ab0e-ebe4c0ff22a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:11.830849 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092bb42-d2d4-469d-ab0e-ebe4c0ff22a2 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:11.842880 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab83e2-a985-4cff-9b0b-21078f38e29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:11.843801 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab83e2-a985-4cff-9b0b-21078f38e29e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:11.844083 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab83e2-a985-4cff-9b0b-21078f38e29e admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:11.844354 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab83e2-a985-4cff-9b0b-21078f38e29e admin admin] PATH_INFO: `/v3/projects/bd59db1469bf4ef080e4928972f4fe42` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:11.845582 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab83e2-a985-4cff-9b0b-21078f38e29e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd59db1469bf4ef080e4928972f4fe42)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:11.847479 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab83e2-a985-4cff-9b0b-21078f38e29e admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:11.894673 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d3ab83e2-a985-4cff-9b0b-21078f38e29e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd59db1469bf4ef080e4928972f4fe42', 'request_id': 'req-d3ab83e2-a985-4cff-9b0b-21078f38e29e'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:11.902926 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d3ab83e2-a985-4cff-9b0b-21078f38e29e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd59db1469bf4ef080e4928972f4fe42', 'request_id': 'req-d3ab83e2-a985-4cff-9b0b-21078f38e29e'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:11.909305 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d3ab83e2-a985-4cff-9b0b-21078f38e29e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd59db1469bf4ef080e4928972f4fe42', 'request_id': 'req-d3ab83e2-a985-4cff-9b0b-21078f38e29e'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:11.921418 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d3ab83e2-a985-4cff-9b0b-21078f38e29e admin admin] The token cache is being invalidate because project bd59db1469bf4ef080e4928972f4fe42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:12:11.921740 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d3ab83e2-a985-4cff-9b0b-21078f38e29e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:11.922391 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d3ab83e2-a985-4cff-9b0b-21078f38e29e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:11.923948 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1367/2740] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:12:11 2021] DELETE /identity/v3/projects/bd59db1469bf4ef080e4928972f4fe42 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:12:11.929992 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a87c8-8279-41bb-b30c-35a476cb2288 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:11.930287 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a87c8-8279-41bb-b30c-35a476cb2288 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:11.930592 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a87c8-8279-41bb-b30c-35a476cb2288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:11.948190 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-5f2a87c8-8279-41bb-b30c-35a476cb2288 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:11.949379 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-5f2a87c8-8279-41bb-b30c-35a476cb2288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:12.010895 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1374/2741] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:12:12.019573 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a0c32-8c12-4dcd-9093-b1f906d1f695 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:12.019863 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a0c32-8c12-4dcd-9093-b1f906d1f695 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:12.020274 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a0c32-8c12-4dcd-9093-b1f906d1f695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:12.035458 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a87c8-8279-41bb-b30c-35a476cb2288 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:12.036854 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-5f2a87c8-8279-41bb-b30c-35a476cb2288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:12.040421 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-237a0c32-8c12-4dcd-9093-b1f906d1f695 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:12.041664 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-237a0c32-8c12-4dcd-9093-b1f906d1f695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:12.048836 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a87c8-8279-41bb-b30c-35a476cb2288 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:12.054161 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748635b4-88c0-4935-9450-e59e5084d31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:12.055026 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748635b4-88c0-4935-9450-e59e5084d31c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:12.055317 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748635b4-88c0-4935-9450-e59e5084d31c admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:12.055942 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748635b4-88c0-4935-9450-e59e5084d31c admin admin] PATH_INFO: `/v3/projects/5d35afc4f2a5405ea168b5823fbc735c` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:12.056851 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748635b4-88c0-4935-9450-e59e5084d31c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d35afc4f2a5405ea168b5823fbc735c)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:12.058817 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748635b4-88c0-4935-9450-e59e5084d31c admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:12.059449 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1368/2742] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:12:12.064541 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a0c32-8c12-4dcd-9093-b1f906d1f695 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:12.075252 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a0c32-8c12-4dcd-9093-b1f906d1f695 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:12.079998 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d02eb0-6505-4315-8592-a298f650f079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:12.080647 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d02eb0-6505-4315-8592-a298f650f079 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:12.080929 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d02eb0-6505-4315-8592-a298f650f079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:12.081202 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d02eb0-6505-4315-8592-a298f650f079 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:12.081962 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d02eb0-6505-4315-8592-a298f650f079 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 02:12:12.082478 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d02eb0-6505-4315-8592-a298f650f079 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:12.083840 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d02eb0-6505-4315-8592-a298f650f079 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:12.096791 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1369/2743] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 02:12:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 02:12:12.101111 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d02eb0-6505-4315-8592-a298f650f079 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:12.105298 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-748635b4-88c0-4935-9450-e59e5084d31c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d35afc4f2a5405ea168b5823fbc735c', 'request_id': 'req-748635b4-88c0-4935-9450-e59e5084d31c'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:12.110460 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-748635b4-88c0-4935-9450-e59e5084d31c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d35afc4f2a5405ea168b5823fbc735c', 'request_id': 'req-748635b4-88c0-4935-9450-e59e5084d31c'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:12.110607 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d02eb0-6505-4315-8592-a298f650f079 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:12.117622 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-748635b4-88c0-4935-9450-e59e5084d31c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d35afc4f2a5405ea168b5823fbc735c', 'request_id': 'req-748635b4-88c0-4935-9450-e59e5084d31c'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:12.128827 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-748635b4-88c0-4935-9450-e59e5084d31c admin admin] The token cache is being invalidate because project 5d35afc4f2a5405ea168b5823fbc735c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:12:12.129113 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-748635b4-88c0-4935-9450-e59e5084d31c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:12.129778 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-748635b4-88c0-4935-9450-e59e5084d31c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:12.131439 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1375/2744] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:12:12 2021] DELETE /identity/v3/projects/5d35afc4f2a5405ea168b5823fbc735c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:12.135762 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748635b4-88c0-4935-9450-e59e5084d31c admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:12.137032 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-748635b4-88c0-4935-9450-e59e5084d31c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:12.166580 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8eca1-da42-4615-8a04-69dfddbb26a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:12.167239 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8eca1-da42-4615-8a04-69dfddbb26a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:12.167526 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8eca1-da42-4615-8a04-69dfddbb26a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:12.167806 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8eca1-da42-4615-8a04-69dfddbb26a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:12.168512 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8eca1-da42-4615-8a04-69dfddbb26a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:12.170574 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8eca1-da42-4615-8a04-69dfddbb26a0 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:12.196359 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1370/2745] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:12:12 2021] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:12:12.200398 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748635b4-88c0-4935-9450-e59e5084d31c admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:12.200553 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8eca1-da42-4615-8a04-69dfddbb26a0 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:12.202151 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-64c8eca1-da42-4615-8a04-69dfddbb26a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:12.256570 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd595a-ac3e-4af6-a24e-426f799e4ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:12.257429 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd595a-ac3e-4af6-a24e-426f799e4ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:12.257743 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd595a-ac3e-4af6-a24e-426f799e4ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:12.258019 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd595a-ac3e-4af6-a24e-426f799e4ffa admin admin] PATH_INFO: `/v3/users/df63d39e56b342779f968a2fd3b84341` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:12.259214 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd595a-ac3e-4af6-a24e-426f799e4ffa admin admin] RBAC: Authorizing `identity:delete_user(user_id=df63d39e56b342779f968a2fd3b84341)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:12.261716 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd595a-ac3e-4af6-a24e-426f799e4ffa admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:12.263137 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8eca1-da42-4615-8a04-69dfddbb26a0 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:12.267969 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc860a-92d6-4e15-93a1-4325127faa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:12.268631 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc860a-92d6-4e15-93a1-4325127faa32 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:12.268924 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc860a-92d6-4e15-93a1-4325127faa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:12.269206 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc860a-92d6-4e15-93a1-4325127faa32 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:12.269947 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc860a-92d6-4e15-93a1-4325127faa32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:12.271842 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc860a-92d6-4e15-93a1-4325127faa32 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:12.295688 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1371/2746] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:12:12 2021] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:12:12.296791 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc860a-92d6-4e15-93a1-4325127faa32 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:12.306253 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc860a-92d6-4e15-93a1-4325127faa32 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:12.306648 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6fbd595a-ac3e-4af6-a24e-426f799e4ffa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df63d39e56b342779f968a2fd3b84341'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:12.310852 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0605f26-b16a-4bed-a9e6-502dbfa99895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:12.311542 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0605f26-b16a-4bed-a9e6-502dbfa99895 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:12.311835 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0605f26-b16a-4bed-a9e6-502dbfa99895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:12.312234 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0605f26-b16a-4bed-a9e6-502dbfa99895 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:12.313168 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0605f26-b16a-4bed-a9e6-502dbfa99895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:12.314842 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0605f26-b16a-4bed-a9e6-502dbfa99895 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:12.314968 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6fbd595a-ac3e-4af6-a24e-426f799e4ffa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df63d39e56b342779f968a2fd3b84341'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:12.321630 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6fbd595a-ac3e-4af6-a24e-426f799e4ffa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df63d39e56b342779f968a2fd3b84341'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:12.322278 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6fbd595a-ac3e-4af6-a24e-426f799e4ffa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df63d39e56b342779f968a2fd3b84341'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:12.325277 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1372/2747] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:12 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:12:12.329193 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0605f26-b16a-4bed-a9e6-502dbfa99895 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:12.330784 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-a0605f26-b16a-4bed-a9e6-502dbfa99895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:12.335752 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6fbd595a-ac3e-4af6-a24e-426f799e4ffa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df63d39e56b342779f968a2fd3b84341'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:12.342919 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1376/2748] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:12:12 2021] DELETE /identity/v3/users/df63d39e56b342779f968a2fd3b84341 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:12:12.344119 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0605f26-b16a-4bed-a9e6-502dbfa99895 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:12.404916 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b21687-1d8d-4d12-a91d-fdff8a8ea3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:12.405624 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b21687-1d8d-4d12-a91d-fdff8a8ea3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:12.405913 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b21687-1d8d-4d12-a91d-fdff8a8ea3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:12.406192 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b21687-1d8d-4d12-a91d-fdff8a8ea3c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:12.407227 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b21687-1d8d-4d12-a91d-fdff8a8ea3c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:12.409100 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b21687-1d8d-4d12-a91d-fdff8a8ea3c2 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:12.423155 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1373/2749] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:12 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:12:12.427694 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd595a-ac3e-4af6-a24e-426f799e4ffa admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:12.438714 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd595a-ac3e-4af6-a24e-426f799e4ffa admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:12.444159 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6108ba0-43d3-443c-aa04-33e11a0cb113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:12.445733 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6108ba0-43d3-443c-aa04-33e11a0cb113 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:12.446228 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6108ba0-43d3-443c-aa04-33e11a0cb113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:12.446802 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6108ba0-43d3-443c-aa04-33e11a0cb113 admin admin] PATH_INFO: `/v3/projects/003c30062f2e46d59cfa3955860fb2ca/users/123978d9e10b46aba3ad3a380ff039e7/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:12.463742 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6108ba0-43d3-443c-aa04-33e11a0cb113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=003c30062f2e46d59cfa3955860fb2ca, user_id=123978d9e10b46aba3ad3a380ff039e7, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:12.466507 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6108ba0-43d3-443c-aa04-33e11a0cb113 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:12.482995 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1377/2750] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:12:12 2021] PUT /identity/v3/projects/003c30062f2e46d59cfa3955860fb2ca/users/123978d9e10b46aba3ad3a380ff039e7/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:12:12.496701 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b1c58-1eee-4f33-a8a8-41fa5a45a4a0 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:12.496996 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b1c58-1eee-4f33-a8a8-41fa5a45a4a0 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:12.497276 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b1c58-1eee-4f33-a8a8-41fa5a45a4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:12.530613 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-4e6b1c58-1eee-4f33-a8a8-41fa5a45a4a0 None None] MFA Rules not processed for user `123978d9e10b46aba3ad3a380ff039e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:12.531842 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4e6b1c58-1eee-4f33-a8a8-41fa5a45a4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:12.595607 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1374/2751] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:12 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:12:12.600301 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6108ba0-43d3-443c-aa04-33e11a0cb113 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:12.622961 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b1c58-1eee-4f33-a8a8-41fa5a45a4a0 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:12.624379 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4e6b1c58-1eee-4f33-a8a8-41fa5a45a4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:12.674513 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6108ba0-43d3-443c-aa04-33e11a0cb113 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:12.679325 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257171c-606f-42db-87d2-25d7b0b2454d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:12.679968 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257171c-606f-42db-87d2-25d7b0b2454d admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:12.680487 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257171c-606f-42db-87d2-25d7b0b2454d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:12.680590 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257171c-606f-42db-87d2-25d7b0b2454d admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:12.681222 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257171c-606f-42db-87d2-25d7b0b2454d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:12.683702 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257171c-606f-42db-87d2-25d7b0b2454d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:12.692478 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b1c58-1eee-4f33-a8a8-41fa5a45a4a0 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:12.697035 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7934e05-d2ed-46ed-8030-6eb0d8c6a81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:12.698515 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7934e05-d2ed-46ed-8030-6eb0d8c6a81c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:12.698823 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7934e05-d2ed-46ed-8030-6eb0d8c6a81c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:12.699338 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7934e05-d2ed-46ed-8030-6eb0d8c6a81c admin admin] PATH_INFO: `/v3/projects/c356a4fd1d1f4adc88edc9576ea5e9e6` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:12.700853 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7934e05-d2ed-46ed-8030-6eb0d8c6a81c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c356a4fd1d1f4adc88edc9576ea5e9e6)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:12.702935 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7934e05-d2ed-46ed-8030-6eb0d8c6a81c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:12.709259 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1378/2752] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:12:12 2021] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:12:12.712917 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257171c-606f-42db-87d2-25d7b0b2454d admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:12.751397 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d7934e05-d2ed-46ed-8030-6eb0d8c6a81c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c356a4fd1d1f4adc88edc9576ea5e9e6', 'request_id': 'req-d7934e05-d2ed-46ed-8030-6eb0d8c6a81c'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:12.756828 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d7934e05-d2ed-46ed-8030-6eb0d8c6a81c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c356a4fd1d1f4adc88edc9576ea5e9e6', 'request_id': 'req-d7934e05-d2ed-46ed-8030-6eb0d8c6a81c'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:12.764130 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d7934e05-d2ed-46ed-8030-6eb0d8c6a81c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c356a4fd1d1f4adc88edc9576ea5e9e6', 'request_id': 'req-d7934e05-d2ed-46ed-8030-6eb0d8c6a81c'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:12.773339 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257171c-606f-42db-87d2-25d7b0b2454d admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:12.774932 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d7934e05-d2ed-46ed-8030-6eb0d8c6a81c admin admin] The token cache is being invalidate because project c356a4fd1d1f4adc88edc9576ea5e9e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:12:12.775233 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d7934e05-d2ed-46ed-8030-6eb0d8c6a81c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:12.775924 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d7934e05-d2ed-46ed-8030-6eb0d8c6a81c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:12.777470 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1375/2753] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:12:12 2021] DELETE /identity/v3/projects/c356a4fd1d1f4adc88edc9576ea5e9e6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:12.783158 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae7edf-9534-41f7-be1c-1b57b4625ee3 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:12.783649 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae7edf-9534-41f7-be1c-1b57b4625ee3 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:12.783819 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae7edf-9534-41f7-be1c-1b57b4625ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:12.803468 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-81ae7edf-9534-41f7-be1c-1b57b4625ee3 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:12.804700 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-81ae7edf-9534-41f7-be1c-1b57b4625ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:12.832937 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82191c6c-a727-4c2c-834e-9fba9641a6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:12.833745 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82191c6c-a727-4c2c-834e-9fba9641a6a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:12.833944 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82191c6c-a727-4c2c-834e-9fba9641a6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:12.834219 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82191c6c-a727-4c2c-834e-9fba9641a6a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:12.834924 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82191c6c-a727-4c2c-834e-9fba9641a6a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:12.836834 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82191c6c-a727-4c2c-834e-9fba9641a6a4 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:12.858266 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1379/2754] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:12:12 2021] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:12:12.862570 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82191c6c-a727-4c2c-834e-9fba9641a6a4 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:12.865294 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-82191c6c-a727-4c2c-834e-9fba9641a6a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:12.880482 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1376/2755] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:12:12.888477 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489490d6-9837-44a7-aa8d-5065ec09146c None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:12.888856 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489490d6-9837-44a7-aa8d-5065ec09146c None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:12.889205 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489490d6-9837-44a7-aa8d-5065ec09146c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:12.889854 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82191c6c-a727-4c2c-834e-9fba9641a6a4 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:12.901297 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58116005-e2fd-4a8a-9686-29602da93339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:12.901636 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58116005-e2fd-4a8a-9686-29602da93339 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:12.901730 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58116005-e2fd-4a8a-9686-29602da93339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:12.902107 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58116005-e2fd-4a8a-9686-29602da93339 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:12.903636 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58116005-e2fd-4a8a-9686-29602da93339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:12.905518 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58116005-e2fd-4a8a-9686-29602da93339 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:12.910730 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-489490d6-9837-44a7-aa8d-5065ec09146c None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:12.912042 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-489490d6-9837-44a7-aa8d-5065ec09146c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:12.916802 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1380/2756] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:12 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:12:12.920748 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58116005-e2fd-4a8a-9686-29602da93339 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:12.921460 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1377/2757] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:12:12.925667 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489490d6-9837-44a7-aa8d-5065ec09146c None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:12.931553 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58116005-e2fd-4a8a-9686-29602da93339 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:12.935562 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489490d6-9837-44a7-aa8d-5065ec09146c None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:12.939638 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b1d6f-ab00-4312-a9a3-4ef21fb7da40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:12.940490 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b1d6f-ab00-4312-a9a3-4ef21fb7da40 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:12.940606 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d00159-5cb8-497b-8f01-e85a22a6942b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:12.940780 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b1d6f-ab00-4312-a9a3-4ef21fb7da40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:12.941065 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b1d6f-ab00-4312-a9a3-4ef21fb7da40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:12.941163 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d00159-5cb8-497b-8f01-e85a22a6942b admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:12.941443 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d00159-5cb8-497b-8f01-e85a22a6942b admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:12.941776 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d00159-5cb8-497b-8f01-e85a22a6942b admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:12.941871 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b1d6f-ab00-4312-a9a3-4ef21fb7da40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:12.942572 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d00159-5cb8-497b-8f01-e85a22a6942b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 02:12:12.943006 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d00159-5cb8-497b-8f01-e85a22a6942b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:12.943485 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b1d6f-ab00-4312-a9a3-4ef21fb7da40 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:12.944766 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d00159-5cb8-497b-8f01-e85a22a6942b admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:12.954688 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1381/2758] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:12 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:12:12.960025 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b1d6f-ab00-4312-a9a3-4ef21fb7da40 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:12.961517 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1378/2759] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 02:12:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 02:12:12.965291 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d00159-5cb8-497b-8f01-e85a22a6942b admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:12.971134 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b1d6f-ab00-4312-a9a3-4ef21fb7da40 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:12.975914 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d00159-5cb8-497b-8f01-e85a22a6942b admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:12.976666 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af69ea-42d4-405e-9d8b-66212db8492e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:12.977751 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af69ea-42d4-405e-9d8b-66212db8492e admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:12.978206 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af69ea-42d4-405e-9d8b-66212db8492e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:12.978650 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af69ea-42d4-405e-9d8b-66212db8492e admin admin] PATH_INFO: `/v3/projects/5e77a26351af45b38d38ed0e64c65d27/users/cad32e05b4c04eccbeda0d837f27674f/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:12.982231 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ca580-ee5b-48eb-8cfd-b781bce4904c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:12.982879 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ca580-ee5b-48eb-8cfd-b781bce4904c admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:12.983167 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ca580-ee5b-48eb-8cfd-b781bce4904c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:12.983448 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ca580-ee5b-48eb-8cfd-b781bce4904c admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:12.984182 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ca580-ee5b-48eb-8cfd-b781bce4904c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:12.986144 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ca580-ee5b-48eb-8cfd-b781bce4904c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:12.994352 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af69ea-42d4-405e-9d8b-66212db8492e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e77a26351af45b38d38ed0e64c65d27, user_id=cad32e05b4c04eccbeda0d837f27674f, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:12.997938 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af69ea-42d4-405e-9d8b-66212db8492e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:13.013174 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1382/2760] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:12:12 2021] PUT /identity/v3/projects/5e77a26351af45b38d38ed0e64c65d27/users/cad32e05b4c04eccbeda0d837f27674f/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:12:13.017080 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af69ea-42d4-405e-9d8b-66212db8492e admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:13.021439 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1379/2761] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:12:12 2021] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:12:13.022903 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeac6cd-ff17-4cc0-a34b-e46e13bb2be0 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:13.023198 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeac6cd-ff17-4cc0-a34b-e46e13bb2be0 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:13.023479 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeac6cd-ff17-4cc0-a34b-e46e13bb2be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:13.050297 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-fdeac6cd-ff17-4cc0-a34b-e46e13bb2be0 None None] MFA Rules not processed for user `cad32e05b4c04eccbeda0d837f27674f`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:13.051483 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-fdeac6cd-ff17-4cc0-a34b-e46e13bb2be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:13.082225 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af69ea-42d4-405e-9d8b-66212db8492e admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:13.117024 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1380/2762] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:13 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:12:13.121846 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeac6cd-ff17-4cc0-a34b-e46e13bb2be0 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:13.147193 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e7c61-8860-46f2-a41e-e5600a8eae57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:13.148143 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e7c61-8860-46f2-a41e-e5600a8eae57 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:13.148585 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e7c61-8860-46f2-a41e-e5600a8eae57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:13.148868 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e7c61-8860-46f2-a41e-e5600a8eae57 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:13.149615 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e7c61-8860-46f2-a41e-e5600a8eae57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:13.151538 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e7c61-8860-46f2-a41e-e5600a8eae57 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:13.171915 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1383/2763] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:12:13 2021] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:12:13.176199 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e7c61-8860-46f2-a41e-e5600a8eae57 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:13.184511 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeac6cd-ff17-4cc0-a34b-e46e13bb2be0 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:13.185865 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e7c61-8860-46f2-a41e-e5600a8eae57 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:13.189224 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a4015-dedb-4cf0-8f03-6576120ae17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:13.189907 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a4015-dedb-4cf0-8f03-6576120ae17e admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:13.190191 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a4015-dedb-4cf0-8f03-6576120ae17e admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:13.190465 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a4015-dedb-4cf0-8f03-6576120ae17e admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:13.190573 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbda2c-a25c-49a8-b080-007c25f13d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:13.191168 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a4015-dedb-4cf0-8f03-6576120ae17e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:13.191288 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbda2c-a25c-49a8-b080-007c25f13d3b admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:13.191475 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbda2c-a25c-49a8-b080-007c25f13d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:13.191753 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbda2c-a25c-49a8-b080-007c25f13d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:13.192477 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbda2c-a25c-49a8-b080-007c25f13d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:13.193031 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a4015-dedb-4cf0-8f03-6576120ae17e admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:13.194182 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbda2c-a25c-49a8-b080-007c25f13d3b admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:13.204637 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1384/2764] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:13 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:12:13.208401 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbda2c-a25c-49a8-b080-007c25f13d3b admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:13.218791 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1381/2765] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:12:13 2021] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:12:13.219010 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbda2c-a25c-49a8-b080-007c25f13d3b admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:13.222533 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a4015-dedb-4cf0-8f03-6576120ae17e admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:13.276820 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71f7e2-6a1f-49f9-9fb2-044dbdc683f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:13.277942 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71f7e2-6a1f-49f9-9fb2-044dbdc683f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:13.277942 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71f7e2-6a1f-49f9-9fb2-044dbdc683f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:13.278151 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71f7e2-6a1f-49f9-9fb2-044dbdc683f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:13.278749 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71f7e2-6a1f-49f9-9fb2-044dbdc683f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:13.280329 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71f7e2-6a1f-49f9-9fb2-044dbdc683f3 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:13.281191 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a4015-dedb-4cf0-8f03-6576120ae17e admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:13.285865 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fa36b-ad79-4d77-af85-334fae577685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:13.286517 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fa36b-ad79-4d77-af85-334fae577685 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:13.286804 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fa36b-ad79-4d77-af85-334fae577685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:13.287080 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fa36b-ad79-4d77-af85-334fae577685 admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:13.287772 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fa36b-ad79-4d77-af85-334fae577685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:13.289713 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fa36b-ad79-4d77-af85-334fae577685 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:13.290193 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1385/2766] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:13 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:12:13.294081 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71f7e2-6a1f-49f9-9fb2-044dbdc683f3 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:13.304656 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71f7e2-6a1f-49f9-9fb2-044dbdc683f3 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:13.309926 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff1e44-1395-4343-a425-f8a739c21f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:13.313554 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1382/2767] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:12:13 2021] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:12:13.313676 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff1e44-1395-4343-a425-f8a739c21f5e admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:13.313676 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff1e44-1395-4343-a425-f8a739c21f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:13.313676 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff1e44-1395-4343-a425-f8a739c21f5e admin admin] PATH_INFO: `/v3/projects/6eeb4ba3eaff4883ae238c00f62513b7/users/f4cee610e30247778dd229efa464dd5d/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:13.314858 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fa36b-ad79-4d77-af85-334fae577685 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:13.324879 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fa36b-ad79-4d77-af85-334fae577685 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:13.326730 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff1e44-1395-4343-a425-f8a739c21f5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eeb4ba3eaff4883ae238c00f62513b7, user_id=f4cee610e30247778dd229efa464dd5d, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:13.329339 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff1e44-1395-4343-a425-f8a739c21f5e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:13.329700 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd39641-3d61-4464-b0fa-2303533ee718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:13.330497 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd39641-3d61-4464-b0fa-2303533ee718 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:13.330785 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd39641-3d61-4464-b0fa-2303533ee718 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:13.331072 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd39641-3d61-4464-b0fa-2303533ee718 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:13.331809 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd39641-3d61-4464-b0fa-2303533ee718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:13.333560 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd39641-3d61-4464-b0fa-2303533ee718 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:13.341924 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1386/2768] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:12:13 2021] PUT /identity/v3/projects/6eeb4ba3eaff4883ae238c00f62513b7/users/f4cee610e30247778dd229efa464dd5d/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:13.346990 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1383/2769] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:13 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:12:13.348368 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff1e44-1395-4343-a425-f8a739c21f5e admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:13.351851 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce0833-98f0-4d9a-8960-b7d4b66ed50c None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:13.352150 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce0833-98f0-4d9a-8960-b7d4b66ed50c None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:13.352438 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce0833-98f0-4d9a-8960-b7d4b66ed50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:13.378501 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-c7ce0833-98f0-4d9a-8960-b7d4b66ed50c None None] MFA Rules not processed for user `f4cee610e30247778dd229efa464dd5d`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:13.379705 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-c7ce0833-98f0-4d9a-8960-b7d4b66ed50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:13.409243 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff1e44-1395-4343-a425-f8a739c21f5e admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:13.414037 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8beef1-e710-4ac5-b3d4-6f932a9716b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:13.414951 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8beef1-e710-4ac5-b3d4-6f932a9716b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:13.415247 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8beef1-e710-4ac5-b3d4-6f932a9716b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:13.415528 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8beef1-e710-4ac5-b3d4-6f932a9716b6 admin admin] PATH_INFO: `/v3/projects/14b6b6994847443c9030562505a66502/users/f8f4b35bc7504a8985dbb77740e1301a/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:13.429637 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8beef1-e710-4ac5-b3d4-6f932a9716b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14b6b6994847443c9030562505a66502, user_id=f8f4b35bc7504a8985dbb77740e1301a, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:13.432815 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8beef1-e710-4ac5-b3d4-6f932a9716b6 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:13.446256 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1384/2770] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:13 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:12:13.446722 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1387/2771] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:12:13 2021] PUT /identity/v3/projects/14b6b6994847443c9030562505a66502/users/f8f4b35bc7504a8985dbb77740e1301a/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:13.451087 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce0833-98f0-4d9a-8960-b7d4b66ed50c None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:13.456551 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8beef1-e710-4ac5-b3d4-6f932a9716b6 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:13.458261 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-fa8beef1-e710-4ac5-b3d4-6f932a9716b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:13.461248 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce0833-98f0-4d9a-8960-b7d4b66ed50c None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:13.513162 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8beef1-e710-4ac5-b3d4-6f932a9716b6 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:13.514731 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85052c1d-e8ea-4531-aeee-c4febe876b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:13.515416 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85052c1d-e8ea-4531-aeee-c4febe876b73 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:13.515833 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85052c1d-e8ea-4531-aeee-c4febe876b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:13.516111 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85052c1d-e8ea-4531-aeee-c4febe876b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:13.516843 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85052c1d-e8ea-4531-aeee-c4febe876b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:13.516932 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a514d-d4ec-4a52-99b2-cbd8827b6049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:13.517497 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a514d-d4ec-4a52-99b2-cbd8827b6049 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:13.517846 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a514d-d4ec-4a52-99b2-cbd8827b6049 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:13.518128 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a514d-d4ec-4a52-99b2-cbd8827b6049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:13.518471 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85052c1d-e8ea-4531-aeee-c4febe876b73 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:13.531086 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1385/2772] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:13 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:12:13.532236 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85052c1d-e8ea-4531-aeee-c4febe876b73 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:13.542213 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85052c1d-e8ea-4531-aeee-c4febe876b73 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:13.546993 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7839b5f-5b02-4b5d-9b93-436bc0ba99be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:13.547854 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7839b5f-5b02-4b5d-9b93-436bc0ba99be admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:13.548178 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7839b5f-5b02-4b5d-9b93-436bc0ba99be admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:13.548472 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7839b5f-5b02-4b5d-9b93-436bc0ba99be admin admin] PATH_INFO: `/v3/projects/14b6b6994847443c9030562505a66502/users/f8f4b35bc7504a8985dbb77740e1301a/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:13.550708 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7839b5f-5b02-4b5d-9b93-436bc0ba99be admin admin] RBAC: Authorizing `identity:create_grant(project_id=14b6b6994847443c9030562505a66502, user_id=f8f4b35bc7504a8985dbb77740e1301a, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:13.553326 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7839b5f-5b02-4b5d-9b93-436bc0ba99be admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:13.563958 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1386/2773] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:12:13 2021] PUT /identity/v3/projects/14b6b6994847443c9030562505a66502/users/f8f4b35bc7504a8985dbb77740e1301a/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:13.573583 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a514d-d4ec-4a52-99b2-cbd8827b6049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:13.573931 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87907bf-cb7f-4819-be01-ed5c69947208 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:13.574367 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87907bf-cb7f-4819-be01-ed5c69947208 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:13.574704 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87907bf-cb7f-4819-be01-ed5c69947208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:13.575177 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a514d-d4ec-4a52-99b2-cbd8827b6049 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:13.584070 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1388/2774] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:12:13 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 02:12:13.600457 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-a87907bf-cb7f-4819-be01-ed5c69947208 None None] MFA Rules not processed for user `f8f4b35bc7504a8985dbb77740e1301a`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:13.601702 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-a87907bf-cb7f-4819-be01-ed5c69947208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:13.667956 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1387/2775] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:13 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:12:13.678070 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a514d-d4ec-4a52-99b2-cbd8827b6049 service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:13.679488 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-665a514d-d4ec-4a52-99b2-cbd8827b6049 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:13.690995 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a514d-d4ec-4a52-99b2-cbd8827b6049 service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:13.740514 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2391a3-cfd0-424b-952f-54c29af21474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:13.741166 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2391a3-cfd0-424b-952f-54c29af21474 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:13.741455 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2391a3-cfd0-424b-952f-54c29af21474 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:13.741768 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2391a3-cfd0-424b-952f-54c29af21474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:13.743603 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-9c2391a3-cfd0-424b-952f-54c29af21474 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:13.811212 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2391a3-cfd0-424b-952f-54c29af21474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:13.811212 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2391a3-cfd0-424b-952f-54c29af21474 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:13.817127 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1389/2776] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:12:13 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:12:15.273099 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87907bf-cb7f-4819-be01-ed5c69947208 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:15.282435 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87907bf-cb7f-4819-be01-ed5c69947208 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:15.285996 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d077b7-fd88-4262-9e24-a497feeb43fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:15.286626 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d077b7-fd88-4262-9e24-a497feeb43fd service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:15.286908 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d077b7-fd88-4262-9e24-a497feeb43fd service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:15.287182 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d077b7-fd88-4262-9e24-a497feeb43fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:15.342089 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d077b7-fd88-4262-9e24-a497feeb43fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:15.343522 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d077b7-fd88-4262-9e24-a497feeb43fd service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:15.352270 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1388/2777] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:12:15 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 02:12:16.524933 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2391a3-cfd0-424b-952f-54c29af21474 service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:16.533252 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2391a3-cfd0-424b-952f-54c29af21474 service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:16.536922 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce215e16-463a-4458-b04d-6611eec3c000 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:16.537586 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce215e16-463a-4458-b04d-6611eec3c000 service cinder] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:16.537880 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce215e16-463a-4458-b04d-6611eec3c000 service cinder] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:16.538212 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce215e16-463a-4458-b04d-6611eec3c000 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:16.547610 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce215e16-463a-4458-b04d-6611eec3c000 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:16.549019 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce215e16-463a-4458-b04d-6611eec3c000 service cinder] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:16.559305 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1390/2778] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:12:16 2021] GET /identity/v3/auth/tokens => generated 3462 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:12:18.513176 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d077b7-fd88-4262-9e24-a497feeb43fd service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:18.514586 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-58d077b7-fd88-4262-9e24-a497feeb43fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:18.592721 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d077b7-fd88-4262-9e24-a497feeb43fd service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:18.598254 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db58f4-64d2-47e0-ae3c-6c7889b4fdff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff82e315d8c42e49556ab67fbf53b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:18.598896 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db58f4-64d2-47e0-ae3c-6c7889b4fdff service placement] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:18.599192 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db58f4-64d2-47e0-ae3c-6c7889b4fdff service placement] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:18.599457 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db58f4-64d2-47e0-ae3c-6c7889b4fdff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:18.601212 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-b5db58f4-64d2-47e0-ae3c-6c7889b4fdff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:18.612926 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db58f4-64d2-47e0-ae3c-6c7889b4fdff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:18.614505 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db58f4-64d2-47e0-ae3c-6c7889b4fdff service placement] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:18.624042 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1389/2779] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:12:18 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:12:21.377730 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce215e16-463a-4458-b04d-6611eec3c000 service cinder] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:21.436902 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce215e16-463a-4458-b04d-6611eec3c000 service cinder] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:21.441438 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777cc3f-5202-4f25-85c2-d051cba51eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:21.442323 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777cc3f-5202-4f25-85c2-d051cba51eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:21.442610 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777cc3f-5202-4f25-85c2-d051cba51eef admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:21.442891 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777cc3f-5202-4f25-85c2-d051cba51eef admin admin] PATH_INFO: `/v3/users/123978d9e10b46aba3ad3a380ff039e7` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:21.444097 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777cc3f-5202-4f25-85c2-d051cba51eef admin admin] RBAC: Authorizing `identity:delete_user(user_id=123978d9e10b46aba3ad3a380ff039e7)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:21.446026 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777cc3f-5202-4f25-85c2-d051cba51eef admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:21.489572 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-7777cc3f-5202-4f25-85c2-d051cba51eef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '123978d9e10b46aba3ad3a380ff039e7'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:21.495864 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-7777cc3f-5202-4f25-85c2-d051cba51eef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '123978d9e10b46aba3ad3a380ff039e7'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:21.502758 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-7777cc3f-5202-4f25-85c2-d051cba51eef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '123978d9e10b46aba3ad3a380ff039e7'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:21.503380 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-7777cc3f-5202-4f25-85c2-d051cba51eef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '123978d9e10b46aba3ad3a380ff039e7'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:21.514453 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-7777cc3f-5202-4f25-85c2-d051cba51eef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '123978d9e10b46aba3ad3a380ff039e7'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:21.520002 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1391/2780] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:12:21 2021] DELETE /identity/v3/users/123978d9e10b46aba3ad3a380ff039e7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:12:21.524589 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceffd16-df3b-40bf-93f5-94013a9f4310 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:21.525031 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceffd16-df3b-40bf-93f5-94013a9f4310 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:21.525162 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceffd16-df3b-40bf-93f5-94013a9f4310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:21.543496 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-3ceffd16-df3b-40bf-93f5-94013a9f4310 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:21.544694 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3ceffd16-df3b-40bf-93f5-94013a9f4310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:21.600771 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1390/2781] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:12:21.611334 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777cc3f-5202-4f25-85c2-d051cba51eef admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:21.612720 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-7777cc3f-5202-4f25-85c2-d051cba51eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:21.668452 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777cc3f-5202-4f25-85c2-d051cba51eef admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:21.678464 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbcb53-6cfa-4d2d-bcdf-e1b648eb9ed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:21.679115 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbcb53-6cfa-4d2d-bcdf-e1b648eb9ed1 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:21.679401 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbcb53-6cfa-4d2d-bcdf-e1b648eb9ed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:21.679707 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbcb53-6cfa-4d2d-bcdf-e1b648eb9ed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:21.688965 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbcb53-6cfa-4d2d-bcdf-e1b648eb9ed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:21.690418 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbcb53-6cfa-4d2d-bcdf-e1b648eb9ed1 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:21.700239 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1392/2782] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:12:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 02:12:21.867812 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceffd16-df3b-40bf-93f5-94013a9f4310 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:21.869272 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3ceffd16-df3b-40bf-93f5-94013a9f4310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:21.881409 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceffd16-df3b-40bf-93f5-94013a9f4310 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:21.886055 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a07a0-e1b6-45c0-b630-4a7f52b776b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:21.887432 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a07a0-e1b6-45c0-b630-4a7f52b776b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:21.887706 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a07a0-e1b6-45c0-b630-4a7f52b776b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:21.887985 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a07a0-e1b6-45c0-b630-4a7f52b776b2 admin admin] PATH_INFO: `/v3/users/f4cee610e30247778dd229efa464dd5d` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:21.889197 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a07a0-e1b6-45c0-b630-4a7f52b776b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4cee610e30247778dd229efa464dd5d)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:21.891132 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a07a0-e1b6-45c0-b630-4a7f52b776b2 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:21.936871 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-762a07a0-e1b6-45c0-b630-4a7f52b776b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4cee610e30247778dd229efa464dd5d'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:21.943617 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-762a07a0-e1b6-45c0-b630-4a7f52b776b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4cee610e30247778dd229efa464dd5d'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:21.944288 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-762a07a0-e1b6-45c0-b630-4a7f52b776b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4cee610e30247778dd229efa464dd5d'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:21.957832 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-762a07a0-e1b6-45c0-b630-4a7f52b776b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4cee610e30247778dd229efa464dd5d'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:21.969356 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-762a07a0-e1b6-45c0-b630-4a7f52b776b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4cee610e30247778dd229efa464dd5d'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:21.971055 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbcb53-6cfa-4d2d-bcdf-e1b648eb9ed1 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:21.972150 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-d4cbcb53-6cfa-4d2d-bcdf-e1b648eb9ed1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:21.980188 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1391/2783] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:12:21 2021] DELETE /identity/v3/users/f4cee610e30247778dd229efa464dd5d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:12:21.984348 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3411f-496a-4b2c-bd2b-d25b8f578c34 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:21.984641 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3411f-496a-4b2c-bd2b-d25b8f578c34 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:21.984929 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3411f-496a-4b2c-bd2b-d25b8f578c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:21.988212 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbcb53-6cfa-4d2d-bcdf-e1b648eb9ed1 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:22.003755 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-65a3411f-496a-4b2c-bd2b-d25b8f578c34 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:22.004949 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-65a3411f-496a-4b2c-bd2b-d25b8f578c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:22.045431 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc307b-9eac-478c-aae2-8f8be2afe9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:22.046321 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc307b-9eac-478c-aae2-8f8be2afe9ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:22.046608 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc307b-9eac-478c-aae2-8f8be2afe9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:22.046895 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc307b-9eac-478c-aae2-8f8be2afe9ed admin admin] PATH_INFO: `/v3/projects/003c30062f2e46d59cfa3955860fb2ca` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:22.048102 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc307b-9eac-478c-aae2-8f8be2afe9ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=003c30062f2e46d59cfa3955860fb2ca)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:22.050266 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc307b-9eac-478c-aae2-8f8be2afe9ed admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:22.062024 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1392/2784] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:12:22.071733 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3411f-496a-4b2c-bd2b-d25b8f578c34 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:22.073097 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-65a3411f-496a-4b2c-bd2b-d25b8f578c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:22.095899 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-64cc307b-9eac-478c-aae2-8f8be2afe9ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '003c30062f2e46d59cfa3955860fb2ca', 'request_id': 'req-64cc307b-9eac-478c-aae2-8f8be2afe9ed'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:22.101113 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-64cc307b-9eac-478c-aae2-8f8be2afe9ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '003c30062f2e46d59cfa3955860fb2ca', 'request_id': 'req-64cc307b-9eac-478c-aae2-8f8be2afe9ed'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:22.107985 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-64cc307b-9eac-478c-aae2-8f8be2afe9ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '003c30062f2e46d59cfa3955860fb2ca', 'request_id': 'req-64cc307b-9eac-478c-aae2-8f8be2afe9ed'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:22.118462 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-64cc307b-9eac-478c-aae2-8f8be2afe9ed admin admin] The token cache is being invalidate because project 003c30062f2e46d59cfa3955860fb2ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:12:22.118753 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-64cc307b-9eac-478c-aae2-8f8be2afe9ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:22.119389 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-64cc307b-9eac-478c-aae2-8f8be2afe9ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:22.121713 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1393/2785] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:12:21 2021] DELETE /identity/v3/projects/003c30062f2e46d59cfa3955860fb2ca => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:12:22.125281 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc307b-9eac-478c-aae2-8f8be2afe9ed admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:22.126583 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-64cc307b-9eac-478c-aae2-8f8be2afe9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:22.128500 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3411f-496a-4b2c-bd2b-d25b8f578c34 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:22.174567 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b2d36-2a6b-49f6-b8dd-6dd0c27ab86a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:22.175494 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b2d36-2a6b-49f6-b8dd-6dd0c27ab86a service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:22.175785 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b2d36-2a6b-49f6-b8dd-6dd0c27ab86a service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:22.176068 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b2d36-2a6b-49f6-b8dd-6dd0c27ab86a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:22.177934 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-e56b2d36-2a6b-49f6-b8dd-6dd0c27ab86a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:22.188646 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc307b-9eac-478c-aae2-8f8be2afe9ed admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:22.190145 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b2d36-2a6b-49f6-b8dd-6dd0c27ab86a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:22.191563 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b2d36-2a6b-49f6-b8dd-6dd0c27ab86a service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:22.193351 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d202299-c65d-4e3d-af1e-4ba6bbf6ec0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:22.194241 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d202299-c65d-4e3d-af1e-4ba6bbf6ec0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:22.194525 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d202299-c65d-4e3d-af1e-4ba6bbf6ec0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:22.194798 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d202299-c65d-4e3d-af1e-4ba6bbf6ec0d admin admin] PATH_INFO: `/v3/users/cad32e05b4c04eccbeda0d837f27674f` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:22.196002 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d202299-c65d-4e3d-af1e-4ba6bbf6ec0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cad32e05b4c04eccbeda0d837f27674f)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:22.197935 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d202299-c65d-4e3d-af1e-4ba6bbf6ec0d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:22.202191 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1393/2786] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:12:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 02:12:22.242461 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6d202299-c65d-4e3d-af1e-4ba6bbf6ec0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cad32e05b4c04eccbeda0d837f27674f'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:22.251058 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6d202299-c65d-4e3d-af1e-4ba6bbf6ec0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cad32e05b4c04eccbeda0d837f27674f'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:22.258444 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6d202299-c65d-4e3d-af1e-4ba6bbf6ec0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cad32e05b4c04eccbeda0d837f27674f'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:22.259296 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6d202299-c65d-4e3d-af1e-4ba6bbf6ec0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cad32e05b4c04eccbeda0d837f27674f'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:22.272514 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6d202299-c65d-4e3d-af1e-4ba6bbf6ec0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cad32e05b4c04eccbeda0d837f27674f'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:22.278597 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1394/2787] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:12:22 2021] DELETE /identity/v3/users/cad32e05b4c04eccbeda0d837f27674f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:22.538637 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b2d36-2a6b-49f6-b8dd-6dd0c27ab86a service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:22.540101 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-e56b2d36-2a6b-49f6-b8dd-6dd0c27ab86a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:22.553072 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b2d36-2a6b-49f6-b8dd-6dd0c27ab86a service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:22.615450 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e23b6a-a69a-4e74-bee8-6bf5939b4969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:22.616243 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e23b6a-a69a-4e74-bee8-6bf5939b4969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:22.616531 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e23b6a-a69a-4e74-bee8-6bf5939b4969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:22.617358 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e23b6a-a69a-4e74-bee8-6bf5939b4969 admin admin] PATH_INFO: `/v3/projects/6eeb4ba3eaff4883ae238c00f62513b7` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:22.618285 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e23b6a-a69a-4e74-bee8-6bf5939b4969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eeb4ba3eaff4883ae238c00f62513b7)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:22.620399 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e23b6a-a69a-4e74-bee8-6bf5939b4969 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:22.624861 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d202299-c65d-4e3d-af1e-4ba6bbf6ec0d admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:22.626292 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-6d202299-c65d-4e3d-af1e-4ba6bbf6ec0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:22.641375 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d202299-c65d-4e3d-af1e-4ba6bbf6ec0d admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:22.651282 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7061b0-4547-4d16-9690-675615378b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:22.652336 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7061b0-4547-4d16-9690-675615378b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:22.652784 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7061b0-4547-4d16-9690-675615378b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:22.653161 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7061b0-4547-4d16-9690-675615378b05 admin admin] PATH_INFO: `/v3/projects/5e77a26351af45b38d38ed0e64c65d27` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:22.659557 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7061b0-4547-4d16-9690-675615378b05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e77a26351af45b38d38ed0e64c65d27)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:22.661892 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7061b0-4547-4d16-9690-675615378b05 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:22.669358 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-67e23b6a-a69a-4e74-bee8-6bf5939b4969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eeb4ba3eaff4883ae238c00f62513b7', 'request_id': 'req-67e23b6a-a69a-4e74-bee8-6bf5939b4969'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:22.674920 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-67e23b6a-a69a-4e74-bee8-6bf5939b4969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eeb4ba3eaff4883ae238c00f62513b7', 'request_id': 'req-67e23b6a-a69a-4e74-bee8-6bf5939b4969'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:22.683928 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-67e23b6a-a69a-4e74-bee8-6bf5939b4969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eeb4ba3eaff4883ae238c00f62513b7', 'request_id': 'req-67e23b6a-a69a-4e74-bee8-6bf5939b4969'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:22.694776 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-67e23b6a-a69a-4e74-bee8-6bf5939b4969 admin admin] The token cache is being invalidate because project 6eeb4ba3eaff4883ae238c00f62513b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:12:22.695067 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-67e23b6a-a69a-4e74-bee8-6bf5939b4969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:22.695698 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-67e23b6a-a69a-4e74-bee8-6bf5939b4969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:22.697223 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1394/2788] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:12:22 2021] DELETE /identity/v3/projects/6eeb4ba3eaff4883ae238c00f62513b7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:22.704566 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613e3db-70d0-438a-b18e-51345f7c487e None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:22.704855 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613e3db-70d0-438a-b18e-51345f7c487e None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:22.705137 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613e3db-70d0-438a-b18e-51345f7c487e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:22.711253 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6d7061b0-4547-4d16-9690-675615378b05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e77a26351af45b38d38ed0e64c65d27', 'request_id': 'req-6d7061b0-4547-4d16-9690-675615378b05'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:22.716646 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6d7061b0-4547-4d16-9690-675615378b05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e77a26351af45b38d38ed0e64c65d27', 'request_id': 'req-6d7061b0-4547-4d16-9690-675615378b05'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:22.722713 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-3613e3db-70d0-438a-b18e-51345f7c487e None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:22.723931 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3613e3db-70d0-438a-b18e-51345f7c487e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:22.724066 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6d7061b0-4547-4d16-9690-675615378b05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e77a26351af45b38d38ed0e64c65d27', 'request_id': 'req-6d7061b0-4547-4d16-9690-675615378b05'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:22.735920 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6d7061b0-4547-4d16-9690-675615378b05 admin admin] The token cache is being invalidate because project 5e77a26351af45b38d38ed0e64c65d27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:12:22.736209 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6d7061b0-4547-4d16-9690-675615378b05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:22.736839 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6d7061b0-4547-4d16-9690-675615378b05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:22.738416 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1395/2789] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:12:22 2021] DELETE /identity/v3/projects/5e77a26351af45b38d38ed0e64c65d27 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:22.742287 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7061b0-4547-4d16-9690-675615378b05 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:22.743623 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-6d7061b0-4547-4d16-9690-675615378b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:22.787877 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1395/2790] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:12:22.795623 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d6497-e31f-4fd2-8791-1db754dbad7d None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:22.795912 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d6497-e31f-4fd2-8791-1db754dbad7d None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:22.796193 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d6497-e31f-4fd2-8791-1db754dbad7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:22.806350 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7061b0-4547-4d16-9690-675615378b05 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:22.811700 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669faa9-3873-45bf-8247-8a3696b7c626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:22.812564 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669faa9-3873-45bf-8247-8a3696b7c626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:22.812851 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669faa9-3873-45bf-8247-8a3696b7c626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:22.813133 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669faa9-3873-45bf-8247-8a3696b7c626 admin admin] PATH_INFO: `/v3/users/f8f4b35bc7504a8985dbb77740e1301a` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:22.814118 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-a36d6497-e31f-4fd2-8791-1db754dbad7d None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:22.814383 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669faa9-3873-45bf-8247-8a3696b7c626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8f4b35bc7504a8985dbb77740e1301a)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:22.815294 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-a36d6497-e31f-4fd2-8791-1db754dbad7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:22.816284 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669faa9-3873-45bf-8247-8a3696b7c626 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:22.823071 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1396/2791] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:12:22.827290 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d6497-e31f-4fd2-8791-1db754dbad7d None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:22.836020 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d6497-e31f-4fd2-8791-1db754dbad7d None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:22.841834 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f945a-e214-4da9-9a19-eaa5a74da4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:22.842540 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f945a-e214-4da9-9a19-eaa5a74da4cf admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:22.842869 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f945a-e214-4da9-9a19-eaa5a74da4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:22.843186 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f945a-e214-4da9-9a19-eaa5a74da4cf admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:22.843961 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f945a-e214-4da9-9a19-eaa5a74da4cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 02:12:22.844275 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f945a-e214-4da9-9a19-eaa5a74da4cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:22.846076 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f945a-e214-4da9-9a19-eaa5a74da4cf admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:22.861452 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1397/2792] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 02:12:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 02:12:22.862388 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f945a-e214-4da9-9a19-eaa5a74da4cf admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:22.864875 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-0669faa9-3873-45bf-8247-8a3696b7c626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8f4b35bc7504a8985dbb77740e1301a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:22.871645 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f945a-e214-4da9-9a19-eaa5a74da4cf admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:22.872166 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-0669faa9-3873-45bf-8247-8a3696b7c626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8f4b35bc7504a8985dbb77740e1301a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:22.876319 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3dea1-7f7b-4586-a184-07b7f74f8a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:22.876934 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3dea1-7f7b-4586-a184-07b7f74f8a4d admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:22.877223 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3dea1-7f7b-4586-a184-07b7f74f8a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:22.877560 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3dea1-7f7b-4586-a184-07b7f74f8a4d admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:22.878224 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da3dea1-7f7b-4586-a184-07b7f74f8a4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:22.879383 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-0669faa9-3873-45bf-8247-8a3696b7c626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8f4b35bc7504a8985dbb77740e1301a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:22.880045 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-0669faa9-3873-45bf-8247-8a3696b7c626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8f4b35bc7504a8985dbb77740e1301a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:22.880143 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da3dea1-7f7b-4586-a184-07b7f74f8a4d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:22.891572 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-0669faa9-3873-45bf-8247-8a3696b7c626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8f4b35bc7504a8985dbb77740e1301a'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:22.897974 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1396/2793] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:12:22 2021] DELETE /identity/v3/users/f8f4b35bc7504a8985dbb77740e1301a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:22.908105 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1398/2794] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:12:22 2021] POST /identity/v3/projects => generated 363 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:12:22.909614 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669faa9-3873-45bf-8247-8a3696b7c626 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:22.910978 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-0669faa9-3873-45bf-8247-8a3696b7c626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:22.979636 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669faa9-3873-45bf-8247-8a3696b7c626 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:23.035257 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a50d12-1647-4751-84c4-edee02f49913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:23.035937 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a50d12-1647-4751-84c4-edee02f49913 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:23.036225 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a50d12-1647-4751-84c4-edee02f49913 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:23.036506 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a50d12-1647-4751-84c4-edee02f49913 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:23.037214 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a50d12-1647-4751-84c4-edee02f49913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:23.040031 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a50d12-1647-4751-84c4-edee02f49913 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:23.061526 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1397/2795] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:12:22 2021] POST /identity/v3/users => generated 282 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:12:23.064681 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3dea1-7f7b-4586-a184-07b7f74f8a4d admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:23.074888 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3dea1-7f7b-4586-a184-07b7f74f8a4d admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:23.079977 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759a0b5-1103-495b-8ea3-623a7b5d6142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:23.080649 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759a0b5-1103-495b-8ea3-623a7b5d6142 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:23.080932 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759a0b5-1103-495b-8ea3-623a7b5d6142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:23.081211 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759a0b5-1103-495b-8ea3-623a7b5d6142 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:23.081978 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759a0b5-1103-495b-8ea3-623a7b5d6142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:23.083562 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759a0b5-1103-495b-8ea3-623a7b5d6142 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:23.094149 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1399/2796] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:23 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:12:23.098084 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a50d12-1647-4751-84c4-edee02f49913 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:23.108588 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a50d12-1647-4751-84c4-edee02f49913 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:23.113391 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbeb293-1581-41c8-8a81-6cca86ca6d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:23.114239 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbeb293-1581-41c8-8a81-6cca86ca6d97 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:23.114606 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbeb293-1581-41c8-8a81-6cca86ca6d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:23.114945 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbeb293-1581-41c8-8a81-6cca86ca6d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:23.115819 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbeb293-1581-41c8-8a81-6cca86ca6d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:23.117446 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbeb293-1581-41c8-8a81-6cca86ca6d97 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:23.127654 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1398/2797] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:23 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:12:23.131612 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759a0b5-1103-495b-8ea3-623a7b5d6142 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:23.141893 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759a0b5-1103-495b-8ea3-623a7b5d6142 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:23.146581 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0369b-86fe-453b-b794-d24e2041dc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:23.147461 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0369b-86fe-453b-b794-d24e2041dc68 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:23.147745 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0369b-86fe-453b-b794-d24e2041dc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:23.148028 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0369b-86fe-453b-b794-d24e2041dc68 admin admin] PATH_INFO: `/v3/projects/98022a92c14f416fbb3ccde048512a6d/users/24be7acc1ea34bb7b10d7a8b109aac44/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:23.164020 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0369b-86fe-453b-b794-d24e2041dc68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98022a92c14f416fbb3ccde048512a6d, user_id=24be7acc1ea34bb7b10d7a8b109aac44, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:23.166934 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0369b-86fe-453b-b794-d24e2041dc68 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:23.171596 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbeb293-1581-41c8-8a81-6cca86ca6d97 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:23.174429 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-2dbeb293-1581-41c8-8a81-6cca86ca6d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:23.187012 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1400/2798] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:12:23 2021] PUT /identity/v3/projects/98022a92c14f416fbb3ccde048512a6d/users/24be7acc1ea34bb7b10d7a8b109aac44/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:12:23.190622 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbeb293-1581-41c8-8a81-6cca86ca6d97 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:23.196526 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c2245-b746-490b-875a-d66e361c19a8 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:23.196928 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c2245-b746-490b-875a-d66e361c19a8 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:23.197366 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c2245-b746-490b-875a-d66e361c19a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:23.226067 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-1a9c2245-b746-490b-875a-d66e361c19a8 None None] MFA Rules not processed for user `24be7acc1ea34bb7b10d7a8b109aac44`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:23.227372 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-1a9c2245-b746-490b-875a-d66e361c19a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:23.248604 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25add67b-49ad-4bf4-a555-1d04a4293c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:23.249460 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25add67b-49ad-4bf4-a555-1d04a4293c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:23.249772 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25add67b-49ad-4bf4-a555-1d04a4293c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:23.250047 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25add67b-49ad-4bf4-a555-1d04a4293c8d admin admin] PATH_INFO: `/v3/projects/14b6b6994847443c9030562505a66502` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:23.251234 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25add67b-49ad-4bf4-a555-1d04a4293c8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=14b6b6994847443c9030562505a66502)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:23.253096 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25add67b-49ad-4bf4-a555-1d04a4293c8d admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:23.290338 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1401/2799] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:23 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:12:23.298568 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-25add67b-49ad-4bf4-a555-1d04a4293c8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14b6b6994847443c9030562505a66502', 'request_id': 'req-25add67b-49ad-4bf4-a555-1d04a4293c8d'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:23.300712 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c2245-b746-490b-875a-d66e361c19a8 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:23.302227 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-1a9c2245-b746-490b-875a-d66e361c19a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:23.304323 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-25add67b-49ad-4bf4-a555-1d04a4293c8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14b6b6994847443c9030562505a66502', 'request_id': 'req-25add67b-49ad-4bf4-a555-1d04a4293c8d'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:23.311877 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-25add67b-49ad-4bf4-a555-1d04a4293c8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14b6b6994847443c9030562505a66502', 'request_id': 'req-25add67b-49ad-4bf4-a555-1d04a4293c8d'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:23.322991 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-25add67b-49ad-4bf4-a555-1d04a4293c8d admin admin] The token cache is being invalidate because project 14b6b6994847443c9030562505a66502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:12:23.323294 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-25add67b-49ad-4bf4-a555-1d04a4293c8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:23.324466 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-25add67b-49ad-4bf4-a555-1d04a4293c8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:12:23.326352 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1399/2800] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:12:23 2021] DELETE /identity/v3/projects/14b6b6994847443c9030562505a66502 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:23.334688 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb241f86-a03b-46ea-b383-431359f0de50 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:23.334985 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb241f86-a03b-46ea-b383-431359f0de50 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:23.335306 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb241f86-a03b-46ea-b383-431359f0de50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:23.353358 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-eb241f86-a03b-46ea-b383-431359f0de50 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:23.354605 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-eb241f86-a03b-46ea-b383-431359f0de50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:23.358629 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c2245-b746-490b-875a-d66e361c19a8 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:23.406541 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae3e1d-f381-4c32-8329-fca3bbcc0880 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:23.407113 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae3e1d-f381-4c32-8329-fca3bbcc0880 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:23.407428 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae3e1d-f381-4c32-8329-fca3bbcc0880 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:23.407710 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae3e1d-f381-4c32-8329-fca3bbcc0880 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:23.409547 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-a5ae3e1d-f381-4c32-8329-fca3bbcc0880 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:23.413046 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1400/2801] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:12:23.422359 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfbf9c-c705-4c61-bc15-6d31de9d0245 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:23.422657 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfbf9c-c705-4c61-bc15-6d31de9d0245 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:23.422938 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfbf9c-c705-4c61-bc15-6d31de9d0245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:23.440389 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-28bfbf9c-c705-4c61-bc15-6d31de9d0245 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:23.441732 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-28bfbf9c-c705-4c61-bc15-6d31de9d0245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:23.450040 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1401/2802] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:12:23.454058 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfbf9c-c705-4c61-bc15-6d31de9d0245 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:23.462558 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfbf9c-c705-4c61-bc15-6d31de9d0245 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:23.467615 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddeb98c-7263-41bc-841a-fef11d4c296e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:23.467814 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae3e1d-f381-4c32-8329-fca3bbcc0880 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:23.468244 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddeb98c-7263-41bc-841a-fef11d4c296e admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:23.468530 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddeb98c-7263-41bc-841a-fef11d4c296e admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:23.468811 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddeb98c-7263-41bc-841a-fef11d4c296e admin admin] PATH_INFO: `/v3/domains` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:23.469279 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae3e1d-f381-4c32-8329-fca3bbcc0880 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:23.469564 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddeb98c-7263-41bc-841a-fef11d4c296e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79472) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 02:12:23.469877 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddeb98c-7263-41bc-841a-fef11d4c296e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:23.471429 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddeb98c-7263-41bc-841a-fef11d4c296e admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:23.478013 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1402/2803] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:12:23 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 02:12:23.485534 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1402/2804] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 02:12:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 02:12:23.486896 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae3e1d-f381-4c32-8329-fca3bbcc0880 service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:23.497071 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae3e1d-f381-4c32-8329-fca3bbcc0880 service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:23.502000 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209af7bf-15b2-4e50-9e58-83fdf52cd346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:23.502680 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209af7bf-15b2-4e50-9e58-83fdf52cd346 admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:23.502967 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209af7bf-15b2-4e50-9e58-83fdf52cd346 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:23.503275 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209af7bf-15b2-4e50-9e58-83fdf52cd346 admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:23.503977 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209af7bf-15b2-4e50-9e58-83fdf52cd346 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:23.505940 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209af7bf-15b2-4e50-9e58-83fdf52cd346 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:23.534354 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1403/2805] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:12:23 2021] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:12:23.535799 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddeb98c-7263-41bc-841a-fef11d4c296e admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:23.545853 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddeb98c-7263-41bc-841a-fef11d4c296e admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:23.602091 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bff5b9-7bb4-4ed9-b8a5-4b480ba0c777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:23.602821 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bff5b9-7bb4-4ed9-b8a5-4b480ba0c777 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:23.603184 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bff5b9-7bb4-4ed9-b8a5-4b480ba0c777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:23.603497 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bff5b9-7bb4-4ed9-b8a5-4b480ba0c777 admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:23.604226 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bff5b9-7bb4-4ed9-b8a5-4b480ba0c777 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:23.606367 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bff5b9-7bb4-4ed9-b8a5-4b480ba0c777 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:23.627215 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1403/2806] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:12:23 2021] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:12:23.631324 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209af7bf-15b2-4e50-9e58-83fdf52cd346 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:23.642908 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209af7bf-15b2-4e50-9e58-83fdf52cd346 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:23.647807 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548dece-fd25-4d06-b190-84400e3938ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:23.648474 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548dece-fd25-4d06-b190-84400e3938ab admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:23.648766 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548dece-fd25-4d06-b190-84400e3938ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:23.649051 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548dece-fd25-4d06-b190-84400e3938ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:23.649848 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548dece-fd25-4d06-b190-84400e3938ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:23.651456 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548dece-fd25-4d06-b190-84400e3938ab admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:23.662116 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1404/2807] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:23 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:12:23.666165 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bff5b9-7bb4-4ed9-b8a5-4b480ba0c777 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:23.677073 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bff5b9-7bb4-4ed9-b8a5-4b480ba0c777 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:23.682047 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2a293-b721-4a40-84fd-e26262f2a762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:23.682710 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2a293-b721-4a40-84fd-e26262f2a762 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:23.683001 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2a293-b721-4a40-84fd-e26262f2a762 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:23.683829 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2a293-b721-4a40-84fd-e26262f2a762 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:23.684590 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2a293-b721-4a40-84fd-e26262f2a762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:23.686393 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2a293-b721-4a40-84fd-e26262f2a762 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:23.696498 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1404/2808] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:23 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:12:23.705651 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548dece-fd25-4d06-b190-84400e3938ab admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:23.711920 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548dece-fd25-4d06-b190-84400e3938ab admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:23.717354 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea0e3e-717a-4844-9af6-bcbaa74448e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:23.718276 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea0e3e-717a-4844-9af6-bcbaa74448e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:23.718566 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea0e3e-717a-4844-9af6-bcbaa74448e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:23.718848 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea0e3e-717a-4844-9af6-bcbaa74448e3 admin admin] PATH_INFO: `/v3/projects/7324ce1980534488848df032fdeb2421/users/b8ecd2ce5b714801b32b8f03633fd867/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:23.735415 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea0e3e-717a-4844-9af6-bcbaa74448e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7324ce1980534488848df032fdeb2421, user_id=b8ecd2ce5b714801b32b8f03633fd867, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:23.738185 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea0e3e-717a-4844-9af6-bcbaa74448e3 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:23.757288 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1405/2809] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:12:23 2021] PUT /identity/v3/projects/7324ce1980534488848df032fdeb2421/users/b8ecd2ce5b714801b32b8f03633fd867/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:12:23.758756 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef632f-0096-4ea8-a02f-f4acbc58354c None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:23.759123 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef632f-0096-4ea8-a02f-f4acbc58354c None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:23.759416 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef632f-0096-4ea8-a02f-f4acbc58354c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:23.778380 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-66ef632f-0096-4ea8-a02f-f4acbc58354c None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:23.779590 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-66ef632f-0096-4ea8-a02f-f4acbc58354c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:23.841606 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1405/2810] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:12:23.851717 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea0e3e-717a-4844-9af6-bcbaa74448e3 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:23.853428 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-24ea0e3e-717a-4844-9af6-bcbaa74448e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:23.908641 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea0e3e-717a-4844-9af6-bcbaa74448e3 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:23.912385 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4300a34-96ed-4b0d-8359-e3af0dd5632d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:23.912972 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4300a34-96ed-4b0d-8359-e3af0dd5632d service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:23.913258 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4300a34-96ed-4b0d-8359-e3af0dd5632d service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:23.913571 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4300a34-96ed-4b0d-8359-e3af0dd5632d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:23.922371 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4300a34-96ed-4b0d-8359-e3af0dd5632d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:23.923783 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4300a34-96ed-4b0d-8359-e3af0dd5632d service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:23.933730 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1406/2811] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:12:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:12:28.042134 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03c928-5a6e-44ad-96e9-b4547e2cde89 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:28.042623 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03c928-5a6e-44ad-96e9-b4547e2cde89 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:28.042853 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03c928-5a6e-44ad-96e9-b4547e2cde89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:28.077942 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-fd03c928-5a6e-44ad-96e9-b4547e2cde89 None None] MFA Rules not processed for user `b8ecd2ce5b714801b32b8f03633fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:28.080922 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-fd03c928-5a6e-44ad-96e9-b4547e2cde89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:28.162855 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1406/2812] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:28 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:12:28.167300 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4300a34-96ed-4b0d-8359-e3af0dd5632d service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:28.177636 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4300a34-96ed-4b0d-8359-e3af0dd5632d service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:28.182365 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a93ad-b892-4c56-9d74-cd25a2e18fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:28.184132 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a93ad-b892-4c56-9d74-cd25a2e18fbb admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:28.184429 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a93ad-b892-4c56-9d74-cd25a2e18fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:28.184806 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a93ad-b892-4c56-9d74-cd25a2e18fbb admin admin] PATH_INFO: `/v3/projects` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:28.185800 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a93ad-b892-4c56-9d74-cd25a2e18fbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:28.187708 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a93ad-b892-4c56-9d74-cd25a2e18fbb admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:28.216294 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1407/2813] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:12:28 2021] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:12:28.220370 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03c928-5a6e-44ad-96e9-b4547e2cde89 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:28.232006 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03c928-5a6e-44ad-96e9-b4547e2cde89 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:28.294359 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889aceb5-d932-49b1-a6de-89945539952c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:28.295283 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889aceb5-d932-49b1-a6de-89945539952c admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:28.295666 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889aceb5-d932-49b1-a6de-89945539952c admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:28.296039 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889aceb5-d932-49b1-a6de-89945539952c admin admin] PATH_INFO: `/v3/users` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:28.296855 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889aceb5-d932-49b1-a6de-89945539952c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:28.299585 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889aceb5-d932-49b1-a6de-89945539952c admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:28.326154 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1407/2814] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:12:28 2021] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:12:28.327336 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a93ad-b892-4c56-9d74-cd25a2e18fbb admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:28.340578 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a93ad-b892-4c56-9d74-cd25a2e18fbb admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:28.345475 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618c94a-65d6-453e-b217-3fe5fc972228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:28.346269 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618c94a-65d6-453e-b217-3fe5fc972228 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:28.346660 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618c94a-65d6-453e-b217-3fe5fc972228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:28.347034 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618c94a-65d6-453e-b217-3fe5fc972228 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:28.347870 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618c94a-65d6-453e-b217-3fe5fc972228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:28.349670 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618c94a-65d6-453e-b217-3fe5fc972228 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:28.360566 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1408/2815] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:28 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:12:28.364587 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889aceb5-d932-49b1-a6de-89945539952c admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:28.375027 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889aceb5-d932-49b1-a6de-89945539952c admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:28.379635 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5d836-e1d1-4b05-8e2b-dc00d049d871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:28.380535 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5d836-e1d1-4b05-8e2b-dc00d049d871 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:28.380817 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5d836-e1d1-4b05-8e2b-dc00d049d871 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:28.381092 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5d836-e1d1-4b05-8e2b-dc00d049d871 admin admin] PATH_INFO: `/v3/projects/bfc1c0cc50204563bfc73acd0b51ffd9/users/cf82e7e3969c423a8e13f9fc90f2e459/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:28.396378 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5d836-e1d1-4b05-8e2b-dc00d049d871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfc1c0cc50204563bfc73acd0b51ffd9, user_id=cf82e7e3969c423a8e13f9fc90f2e459, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:28.399072 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5d836-e1d1-4b05-8e2b-dc00d049d871 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:28.412102 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1408/2816] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:12:28 2021] PUT /identity/v3/projects/bfc1c0cc50204563bfc73acd0b51ffd9/users/cf82e7e3969c423a8e13f9fc90f2e459/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:12:28.416164 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618c94a-65d6-453e-b217-3fe5fc972228 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:28.426272 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618c94a-65d6-453e-b217-3fe5fc972228 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:28.479455 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04cefe-4efd-4fb3-b33d-bbd5e5a8e3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:28.480643 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04cefe-4efd-4fb3-b33d-bbd5e5a8e3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:28.480931 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04cefe-4efd-4fb3-b33d-bbd5e5a8e3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:28.481209 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04cefe-4efd-4fb3-b33d-bbd5e5a8e3a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:28.481981 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04cefe-4efd-4fb3-b33d-bbd5e5a8e3a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:28.483557 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04cefe-4efd-4fb3-b33d-bbd5e5a8e3a7 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:28.493154 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1409/2817] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:12:28 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:12:28.497968 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5d836-e1d1-4b05-8e2b-dc00d049d871 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:28.508471 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5d836-e1d1-4b05-8e2b-dc00d049d871 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:28.513289 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345ffc1-9c1e-4170-97b7-1701f513101a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:28.514232 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345ffc1-9c1e-4170-97b7-1701f513101a admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:28.514513 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345ffc1-9c1e-4170-97b7-1701f513101a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:28.514789 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345ffc1-9c1e-4170-97b7-1701f513101a admin admin] PATH_INFO: `/v3/projects/bfc1c0cc50204563bfc73acd0b51ffd9/users/cf82e7e3969c423a8e13f9fc90f2e459/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:28.516777 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345ffc1-9c1e-4170-97b7-1701f513101a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfc1c0cc50204563bfc73acd0b51ffd9, user_id=cf82e7e3969c423a8e13f9fc90f2e459, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:28.519547 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345ffc1-9c1e-4170-97b7-1701f513101a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:28.529905 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1409/2818] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:12:28 2021] PUT /identity/v3/projects/bfc1c0cc50204563bfc73acd0b51ffd9/users/cf82e7e3969c423a8e13f9fc90f2e459/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:12:33.139850 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138e98b-7c0f-4c29-94eb-5d6aa683f72e None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:33.140343 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138e98b-7c0f-4c29-94eb-5d6aa683f72e None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:33.140571 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138e98b-7c0f-4c29-94eb-5d6aa683f72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:33.168556 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-4138e98b-7c0f-4c29-94eb-5d6aa683f72e None None] MFA Rules not processed for user `cf82e7e3969c423a8e13f9fc90f2e459`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:12:33.169818 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-4138e98b-7c0f-4c29-94eb-5d6aa683f72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:33.246342 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1410/2819] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:12:33 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:12:33.259959 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345ffc1-9c1e-4170-97b7-1701f513101a admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:12:33.263177 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-7345ffc1-9c1e-4170-97b7-1701f513101a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:12:33.338159 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345ffc1-9c1e-4170-97b7-1701f513101a admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:12:33.343666 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcc795-ed02-4f4e-8fc8-83160ac79fd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:12:33.344307 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcc795-ed02-4f4e-8fc8-83160ac79fd1 service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:12:33.344595 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcc795-ed02-4f4e-8fc8-83160ac79fd1 service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:12:33.344876 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcc795-ed02-4f4e-8fc8-83160ac79fd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:12:33.402084 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcc795-ed02-4f4e-8fc8-83160ac79fd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:12:33.403758 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcc795-ed02-4f4e-8fc8-83160ac79fd1 service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:12:33.413598 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1410/2820] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:12:33 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:13:01.260360 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b2ebc-f77c-4968-8096-bdec32a22e96 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:01.260875 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b2ebc-f77c-4968-8096-bdec32a22e96 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:01.260966 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b2ebc-f77c-4968-8096-bdec32a22e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:01.278922 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-f90b2ebc-f77c-4968-8096-bdec32a22e96 None None] MFA Rules not processed for user `b8ecd2ce5b714801b32b8f03633fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:13:01.280151 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-f90b2ebc-f77c-4968-8096-bdec32a22e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:13:01.287082 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1411/2821] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:13:01 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:13:01.579016 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcc795-ed02-4f4e-8fc8-83160ac79fd1 service nova] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:13:01.630914 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcc795-ed02-4f4e-8fc8-83160ac79fd1 service nova] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:13:01.634577 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77082c-b502-4cba-8b9c-0e78aba2214c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:13:01.635196 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77082c-b502-4cba-8b9c-0e78aba2214c service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:01.635481 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77082c-b502-4cba-8b9c-0e78aba2214c service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:01.635759 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77082c-b502-4cba-8b9c-0e78aba2214c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:01.637525 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-9e77082c-b502-4cba-8b9c-0e78aba2214c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:13:01.647260 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77082c-b502-4cba-8b9c-0e78aba2214c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:13:01.648688 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77082c-b502-4cba-8b9c-0e78aba2214c service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:13:01.657297 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1411/2822] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:13:01 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:13:02.339953 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b2ebc-f77c-4968-8096-bdec32a22e96 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:13:02.341407 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-f90b2ebc-f77c-4968-8096-bdec32a22e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:13:02.408430 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b2ebc-f77c-4968-8096-bdec32a22e96 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:13:02.413408 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510d5fb-587c-4a07-bef0-eb60c06bb01e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff82e315d8c42e49556ab67fbf53b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:13:02.414029 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510d5fb-587c-4a07-bef0-eb60c06bb01e service placement] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:02.414308 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510d5fb-587c-4a07-bef0-eb60c06bb01e service placement] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:02.414584 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510d5fb-587c-4a07-bef0-eb60c06bb01e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:02.416307 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-c510d5fb-587c-4a07-bef0-eb60c06bb01e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:13:02.427834 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510d5fb-587c-4a07-bef0-eb60c06bb01e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:13:02.429377 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510d5fb-587c-4a07-bef0-eb60c06bb01e service placement] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:13:02.439486 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1412/2823] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:13:02 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:13:04.903641 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77082c-b502-4cba-8b9c-0e78aba2214c service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:13:04.905833 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-9e77082c-b502-4cba-8b9c-0e78aba2214c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:13:04.932986 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77082c-b502-4cba-8b9c-0e78aba2214c service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:13:04.939706 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0689a24-6366-4e7d-8d1d-f9072dd40749 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:13:04.940965 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0689a24-6366-4e7d-8d1d-f9072dd40749 service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:04.941459 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0689a24-6366-4e7d-8d1d-f9072dd40749 service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:04.941834 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0689a24-6366-4e7d-8d1d-f9072dd40749 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:04.943797 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-a0689a24-6366-4e7d-8d1d-f9072dd40749 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:13:04.958758 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0689a24-6366-4e7d-8d1d-f9072dd40749 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:13:04.960500 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0689a24-6366-4e7d-8d1d-f9072dd40749 service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:13:04.972289 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1412/2824] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:13:04 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:13:09.129986 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510d5fb-587c-4a07-bef0-eb60c06bb01e service placement] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:13:09.131407 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-c510d5fb-587c-4a07-bef0-eb60c06bb01e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:13:09.199449 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510d5fb-587c-4a07-bef0-eb60c06bb01e service placement] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:13:09.204051 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1fc07-289d-423c-aeef-de92f29a6a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:13:09.204940 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1fc07-289d-423c-aeef-de92f29a6a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:09.205223 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1fc07-289d-423c-aeef-de92f29a6a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:09.205524 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1fc07-289d-423c-aeef-de92f29a6a35 admin admin] PATH_INFO: `/v3/users/24be7acc1ea34bb7b10d7a8b109aac44` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:09.206729 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1fc07-289d-423c-aeef-de92f29a6a35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24be7acc1ea34bb7b10d7a8b109aac44)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:13:09.208996 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1fc07-289d-423c-aeef-de92f29a6a35 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:13:09.256157 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-dfd1fc07-289d-423c-aeef-de92f29a6a35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24be7acc1ea34bb7b10d7a8b109aac44'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:13:09.263850 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-dfd1fc07-289d-423c-aeef-de92f29a6a35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24be7acc1ea34bb7b10d7a8b109aac44'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:13:09.264535 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-dfd1fc07-289d-423c-aeef-de92f29a6a35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24be7acc1ea34bb7b10d7a8b109aac44'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:13:09.275716 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-dfd1fc07-289d-423c-aeef-de92f29a6a35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24be7acc1ea34bb7b10d7a8b109aac44'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:13:09.283340 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-dfd1fc07-289d-423c-aeef-de92f29a6a35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24be7acc1ea34bb7b10d7a8b109aac44'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:13:09.289578 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1413/2825] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:13:09 2021] DELETE /identity/v3/users/24be7acc1ea34bb7b10d7a8b109aac44 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:13:09.294095 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f05be-c075-4562-bec3-89f2a0721b89 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:09.294563 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f05be-c075-4562-bec3-89f2a0721b89 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:09.294685 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f05be-c075-4562-bec3-89f2a0721b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:09.312930 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-6c4f05be-c075-4562-bec3-89f2a0721b89 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:13:09.314164 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-6c4f05be-c075-4562-bec3-89f2a0721b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:13:09.374844 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1413/2826] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:13:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:13:09.384833 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1fc07-289d-423c-aeef-de92f29a6a35 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:13:09.386255 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-dfd1fc07-289d-423c-aeef-de92f29a6a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:13:09.447484 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1fc07-289d-423c-aeef-de92f29a6a35 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:13:09.451343 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34943a-d0c6-4482-b24f-ba9bdd25cfb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:13:09.452883 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34943a-d0c6-4482-b24f-ba9bdd25cfb9 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:09.453176 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34943a-d0c6-4482-b24f-ba9bdd25cfb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:09.453455 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34943a-d0c6-4482-b24f-ba9bdd25cfb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:09.462720 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34943a-d0c6-4482-b24f-ba9bdd25cfb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:13:09.464223 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34943a-d0c6-4482-b24f-ba9bdd25cfb9 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:13:09.474236 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1414/2827] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:13:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 02:13:09.737023 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f05be-c075-4562-bec3-89f2a0721b89 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:13:09.738583 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-6c4f05be-c075-4562-bec3-89f2a0721b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:13:09.750758 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f05be-c075-4562-bec3-89f2a0721b89 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:13:09.755562 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05defcb0-46a5-4795-923c-1983278f9840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:13:09.756498 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05defcb0-46a5-4795-923c-1983278f9840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:09.756877 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05defcb0-46a5-4795-923c-1983278f9840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:09.757258 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05defcb0-46a5-4795-923c-1983278f9840 admin admin] PATH_INFO: `/v3/projects/98022a92c14f416fbb3ccde048512a6d` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:09.758560 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05defcb0-46a5-4795-923c-1983278f9840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98022a92c14f416fbb3ccde048512a6d)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:13:09.760528 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05defcb0-46a5-4795-923c-1983278f9840 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:13:09.806970 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-05defcb0-46a5-4795-923c-1983278f9840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98022a92c14f416fbb3ccde048512a6d', 'request_id': 'req-05defcb0-46a5-4795-923c-1983278f9840'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:13:09.812669 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-05defcb0-46a5-4795-923c-1983278f9840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98022a92c14f416fbb3ccde048512a6d', 'request_id': 'req-05defcb0-46a5-4795-923c-1983278f9840'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:13:09.819475 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-05defcb0-46a5-4795-923c-1983278f9840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98022a92c14f416fbb3ccde048512a6d', 'request_id': 'req-05defcb0-46a5-4795-923c-1983278f9840'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:13:09.830842 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-05defcb0-46a5-4795-923c-1983278f9840 admin admin] The token cache is being invalidate because project 98022a92c14f416fbb3ccde048512a6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:13:09.831126 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-05defcb0-46a5-4795-923c-1983278f9840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:13:09.831744 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-05defcb0-46a5-4795-923c-1983278f9840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:13:09.833256 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1414/2828] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:13:09 2021] DELETE /identity/v3/projects/98022a92c14f416fbb3ccde048512a6d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:13:09.839034 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6fc14-d592-4cbc-8aa7-6a0ea75774dd None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:09.839319 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6fc14-d592-4cbc-8aa7-6a0ea75774dd None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:09.839642 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6fc14-d592-4cbc-8aa7-6a0ea75774dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:09.857642 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-30d6fc14-d592-4cbc-8aa7-6a0ea75774dd None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:13:09.858817 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-30d6fc14-d592-4cbc-8aa7-6a0ea75774dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:13:09.914060 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1415/2829] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:13:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:13:09.922921 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e18e9-41a7-44f9-8a2b-582974920207 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:09.923217 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e18e9-41a7-44f9-8a2b-582974920207 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:09.923503 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e18e9-41a7-44f9-8a2b-582974920207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:09.941776 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-0f8e18e9-41a7-44f9-8a2b-582974920207 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:13:09.942958 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-0f8e18e9-41a7-44f9-8a2b-582974920207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:13:09.950760 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1415/2830] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:13:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:13:09.955371 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6fc14-d592-4cbc-8aa7-6a0ea75774dd None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:13:09.964895 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6fc14-d592-4cbc-8aa7-6a0ea75774dd None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:13:09.970414 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da07a6-5e6a-4ff8-a3ad-7ba609577f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:13:09.971013 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da07a6-5e6a-4ff8-a3ad-7ba609577f56 admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:09.971294 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da07a6-5e6a-4ff8-a3ad-7ba609577f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:09.971576 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da07a6-5e6a-4ff8-a3ad-7ba609577f56 admin admin] PATH_INFO: `/v3/domains` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:09.972307 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da07a6-5e6a-4ff8-a3ad-7ba609577f56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79473) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 02:13:09.972613 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da07a6-5e6a-4ff8-a3ad-7ba609577f56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:13:09.974241 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da07a6-5e6a-4ff8-a3ad-7ba609577f56 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:13:09.986586 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1416/2831] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Oct 27 02:13:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 02:13:09.991108 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e18e9-41a7-44f9-8a2b-582974920207 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:13:10.000461 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e18e9-41a7-44f9-8a2b-582974920207 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:13:10.005211 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df784589-cf9c-44d4-8ddf-a87bc50ac1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:13:10.005935 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df784589-cf9c-44d4-8ddf-a87bc50ac1a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:10.006296 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df784589-cf9c-44d4-8ddf-a87bc50ac1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:10.006573 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df784589-cf9c-44d4-8ddf-a87bc50ac1a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:10.007312 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df784589-cf9c-44d4-8ddf-a87bc50ac1a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:13:10.009343 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df784589-cf9c-44d4-8ddf-a87bc50ac1a3 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:13:10.036793 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1416/2832] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:13:09 2021] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:13:10.039109 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da07a6-5e6a-4ff8-a3ad-7ba609577f56 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:13:10.048840 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da07a6-5e6a-4ff8-a3ad-7ba609577f56 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:13:10.102315 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f618f3-552c-4890-b880-69caae1edabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:13:10.102907 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f618f3-552c-4890-b880-69caae1edabc admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:10.103190 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f618f3-552c-4890-b880-69caae1edabc admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:10.103464 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f618f3-552c-4890-b880-69caae1edabc admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:10.104164 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f618f3-552c-4890-b880-69caae1edabc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:13:10.106077 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f618f3-552c-4890-b880-69caae1edabc admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:13:10.124821 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1417/2833] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:13:10 2021] POST /identity/v3/users => generated 287 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:13:10.128785 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df784589-cf9c-44d4-8ddf-a87bc50ac1a3 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:13:10.139647 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df784589-cf9c-44d4-8ddf-a87bc50ac1a3 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:13:10.144292 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995a1ee-71f7-42f8-bfd4-f18b41e57b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:13:10.144943 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995a1ee-71f7-42f8-bfd4-f18b41e57b71 admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:10.145229 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995a1ee-71f7-42f8-bfd4-f18b41e57b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:10.145545 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995a1ee-71f7-42f8-bfd4-f18b41e57b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:10.146313 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995a1ee-71f7-42f8-bfd4-f18b41e57b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:13:10.147890 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995a1ee-71f7-42f8-bfd4-f18b41e57b71 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:13:10.159132 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1417/2834] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:13:10 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 02:13:10.162848 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f618f3-552c-4890-b880-69caae1edabc admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:13:10.172512 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f618f3-552c-4890-b880-69caae1edabc admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:13:10.177285 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09849204-d9dc-49f6-ba64-e587963f423f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:13:10.177957 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09849204-d9dc-49f6-ba64-e587963f423f admin admin] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:10.178240 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09849204-d9dc-49f6-ba64-e587963f423f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:10.178513 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09849204-d9dc-49f6-ba64-e587963f423f admin admin] PATH_INFO: `/v3/roles` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:10.179238 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09849204-d9dc-49f6-ba64-e587963f423f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:13:10.180790 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09849204-d9dc-49f6-ba64-e587963f423f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:13:10.191036 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1418/2835] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:13:10 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:13:10.194669 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995a1ee-71f7-42f8-bfd4-f18b41e57b71 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:13:10.204807 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995a1ee-71f7-42f8-bfd4-f18b41e57b71 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:13:10.209570 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90fe8d-0626-4aae-afb1-6625399dff58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:13:10.210430 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90fe8d-0626-4aae-afb1-6625399dff58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:10.210711 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90fe8d-0626-4aae-afb1-6625399dff58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:10.210987 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90fe8d-0626-4aae-afb1-6625399dff58 admin admin] PATH_INFO: `/v3/projects/ef5284555cf449a3af709e3701ac4a40/users/a7802534937b4464906e1daeadb89120/roles/540999ece4154e6ba219007ddda3f8f9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:10.224780 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90fe8d-0626-4aae-afb1-6625399dff58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5284555cf449a3af709e3701ac4a40, user_id=a7802534937b4464906e1daeadb89120, role_id=540999ece4154e6ba219007ddda3f8f9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:13:10.227445 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90fe8d-0626-4aae-afb1-6625399dff58 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:13:10.240117 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1418/2836] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:13:10 2021] PUT /identity/v3/projects/ef5284555cf449a3af709e3701ac4a40/users/a7802534937b4464906e1daeadb89120/roles/540999ece4154e6ba219007ddda3f8f9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:13:10.245043 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b875987-1fe3-4a4a-b6b8-14a19f11ccc9 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:10.245337 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b875987-1fe3-4a4a-b6b8-14a19f11ccc9 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:10.245651 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b875987-1fe3-4a4a-b6b8-14a19f11ccc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:10.263243 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-6b875987-1fe3-4a4a-b6b8-14a19f11ccc9 None None] MFA Rules not processed for user `d48900f443894ac798508f952478760c`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:13:10.265051 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-6b875987-1fe3-4a4a-b6b8-14a19f11ccc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:13:10.320084 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1419/2837] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:13:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:13:10.330337 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90fe8d-0626-4aae-afb1-6625399dff58 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:13:10.332099 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-3f90fe8d-0626-4aae-afb1-6625399dff58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:13:10.386537 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90fe8d-0626-4aae-afb1-6625399dff58 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:13:10.390210 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315a7f2-6ee7-416a-972c-fbea204a45b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:13:10.390844 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315a7f2-6ee7-416a-972c-fbea204a45b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:10.391127 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315a7f2-6ee7-416a-972c-fbea204a45b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:10.391405 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315a7f2-6ee7-416a-972c-fbea204a45b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:10.400081 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315a7f2-6ee7-416a-972c-fbea204a45b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:13:10.401504 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315a7f2-6ee7-416a-972c-fbea204a45b6 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:13:10.410569 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1419/2838] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:13:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 02:13:14.366098 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7135d1-32d0-41a9-99f2-9125f94c9e24 None None] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:14.367121 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7135d1-32d0-41a9-99f2-9125f94c9e24 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:14.367610 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7135d1-32d0-41a9-99f2-9125f94c9e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:14.402938 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.auth.core [None req-7f7135d1-32d0-41a9-99f2-9125f94c9e24 None None] MFA Rules not processed for user `a7802534937b4464906e1daeadb89120`. Rule list: `[]` (Enabled: `True`). {{(pid=79473) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:13:14.404368 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-7f7135d1-32d0-41a9-99f2-9125f94c9e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:13:14.478149 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1420/2839] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:13:14 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:13:14.479392 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315a7f2-6ee7-416a-972c-fbea204a45b6 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:13:14.490774 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315a7f2-6ee7-416a-972c-fbea204a45b6 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:13:14.501405 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38766bae-c83d-42f3-bfb8-3b1ba7486cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:13:14.502127 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38766bae-c83d-42f3-bfb8-3b1ba7486cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:14.502417 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38766bae-c83d-42f3-bfb8-3b1ba7486cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:14.502696 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38766bae-c83d-42f3-bfb8-3b1ba7486cd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:14.503414 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38766bae-c83d-42f3-bfb8-3b1ba7486cd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:13:14.505306 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38766bae-c83d-42f3-bfb8-3b1ba7486cd3 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:13:14.535036 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1420/2840] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Oct 27 02:13:14 2021] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 02:13:14.539501 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7135d1-32d0-41a9-99f2-9125f94c9e24 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:13:14.551932 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7135d1-32d0-41a9-99f2-9125f94c9e24 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:13:14.612245 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84baf266-cd48-4d8c-bdca-94d785a3b70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:13:14.613048 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84baf266-cd48-4d8c-bdca-94d785a3b70c admin admin] REQUEST_METHOD: `POST` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:14.613399 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84baf266-cd48-4d8c-bdca-94d785a3b70c admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:14.613778 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84baf266-cd48-4d8c-bdca-94d785a3b70c admin admin] PATH_INFO: `/v3/users` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:14.614568 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84baf266-cd48-4d8c-bdca-94d785a3b70c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:13:14.616657 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84baf266-cd48-4d8c-bdca-94d785a3b70c admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:13:14.636878 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1421/2841] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Oct 27 02:13:14 2021] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 02:13:14.640769 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38766bae-c83d-42f3-bfb8-3b1ba7486cd3 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:13:14.651469 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38766bae-c83d-42f3-bfb8-3b1ba7486cd3 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:13:14.656649 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efef46f-834f-4e60-9b5f-4ec714c8065a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:13:14.657312 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efef46f-834f-4e60-9b5f-4ec714c8065a admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:14.657632 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efef46f-834f-4e60-9b5f-4ec714c8065a admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:14.657943 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efef46f-834f-4e60-9b5f-4ec714c8065a admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:14.658712 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efef46f-834f-4e60-9b5f-4ec714c8065a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:13:14.660284 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efef46f-834f-4e60-9b5f-4ec714c8065a admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:13:14.671340 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1421/2842] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:13:14 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:13:14.675700 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84baf266-cd48-4d8c-bdca-94d785a3b70c admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:13:14.685508 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84baf266-cd48-4d8c-bdca-94d785a3b70c admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:13:14.690139 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a61627-21a5-4ddb-8b6e-5f58cbe31165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:13:14.691009 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a61627-21a5-4ddb-8b6e-5f58cbe31165 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:14.691292 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a61627-21a5-4ddb-8b6e-5f58cbe31165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:14.691567 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a61627-21a5-4ddb-8b6e-5f58cbe31165 admin admin] PATH_INFO: `/v3/projects/83a6eb78653247929663b1f4b48db13a/users/6b86630292b84e2882577161135bb324/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:14.708625 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a61627-21a5-4ddb-8b6e-5f58cbe31165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a6eb78653247929663b1f4b48db13a, user_id=6b86630292b84e2882577161135bb324, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:13:14.711300 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a61627-21a5-4ddb-8b6e-5f58cbe31165 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:13:14.724350 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1422/2843] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:13:14 2021] PUT /identity/v3/projects/83a6eb78653247929663b1f4b48db13a/users/6b86630292b84e2882577161135bb324/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:13:14.728204 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efef46f-834f-4e60-9b5f-4ec714c8065a admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:13:14.738773 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efef46f-834f-4e60-9b5f-4ec714c8065a admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:13:14.791459 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a0dd0-ff3d-47cb-a173-ce7a157f1cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:13:14.792124 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a0dd0-ff3d-47cb-a173-ce7a157f1cba admin admin] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:14.792407 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a0dd0-ff3d-47cb-a173-ce7a157f1cba admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:14.792684 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a0dd0-ff3d-47cb-a173-ce7a157f1cba admin admin] PATH_INFO: `/v3/roles` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:14.793405 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a0dd0-ff3d-47cb-a173-ce7a157f1cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:13:14.795601 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a0dd0-ff3d-47cb-a173-ce7a157f1cba admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:13:14.805170 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1422/2844] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Oct 27 02:13:14 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 02:13:14.809368 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a61627-21a5-4ddb-8b6e-5f58cbe31165 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:13:14.819806 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a61627-21a5-4ddb-8b6e-5f58cbe31165 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:13:14.824641 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63723c7a-7dc6-4f79-bd98-d3a7b5795579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:13:14.825568 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63723c7a-7dc6-4f79-bd98-d3a7b5795579 admin admin] REQUEST_METHOD: `PUT` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:14.825853 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63723c7a-7dc6-4f79-bd98-d3a7b5795579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:14.826629 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63723c7a-7dc6-4f79-bd98-d3a7b5795579 admin admin] PATH_INFO: `/v3/projects/83a6eb78653247929663b1f4b48db13a/users/6b86630292b84e2882577161135bb324/roles/df3a437e6ea14518a9c1b9a348e18c99` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:14.828655 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63723c7a-7dc6-4f79-bd98-d3a7b5795579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a6eb78653247929663b1f4b48db13a, user_id=6b86630292b84e2882577161135bb324, role_id=df3a437e6ea14518a9c1b9a348e18c99)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:13:14.831345 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63723c7a-7dc6-4f79-bd98-d3a7b5795579 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:13:14.842777 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1423/2845] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Oct 27 02:13:14 2021] PUT /identity/v3/projects/83a6eb78653247929663b1f4b48db13a/users/6b86630292b84e2882577161135bb324/roles/df3a437e6ea14518a9c1b9a348e18c99 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:13:16.978416 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a0dd0-ff3d-47cb-a173-ce7a157f1cba admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:13:16.980403 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-a51a0dd0-ff3d-47cb-a173-ce7a157f1cba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:13:17.073979 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a0dd0-ff3d-47cb-a173-ce7a157f1cba admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:13:17.189249 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb6663-c444-494f-9d20-ccf103c1e890 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:13:17.189959 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb6663-c444-494f-9d20-ccf103c1e890 service nova] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:17.190304 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb6663-c444-494f-9d20-ccf103c1e890 service nova] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:17.190591 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb6663-c444-494f-9d20-ccf103c1e890 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:17.194292 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-37eb6663-c444-494f-9d20-ccf103c1e890 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:13:17.211095 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb6663-c444-494f-9d20-ccf103c1e890 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:13:17.212935 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb6663-c444-494f-9d20-ccf103c1e890 service nova] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:13:17.228951 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1423/2846] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:13:16 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:13:19.586158 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63723c7a-7dc6-4f79-bd98-d3a7b5795579 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:13:19.681042 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63723c7a-7dc6-4f79-bd98-d3a7b5795579 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:13:19.691301 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a91f8b-55f9-4b8c-95e9-fb9f3c24ab09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:13:19.692175 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a91f8b-55f9-4b8c-95e9-fb9f3c24ab09 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:19.692730 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a91f8b-55f9-4b8c-95e9-fb9f3c24ab09 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:19.694187 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a91f8b-55f9-4b8c-95e9-fb9f3c24ab09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:19.704240 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-57a91f8b-55f9-4b8c-95e9-fb9f3c24ab09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:13:19.722534 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157b3cd-ce36-4a51-816d-98c519d6d8df None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:19.723053 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157b3cd-ce36-4a51-816d-98c519d6d8df None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:19.723155 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157b3cd-ce36-4a51-816d-98c519d6d8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:19.773893 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-9157b3cd-ce36-4a51-816d-98c519d6d8df None None] MFA Rules not processed for user `6b86630292b84e2882577161135bb324`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:13:19.775693 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-9157b3cd-ce36-4a51-816d-98c519d6d8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:13:19.820039 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a91f8b-55f9-4b8c-95e9-fb9f3c24ab09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:13:19.821671 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a91f8b-55f9-4b8c-95e9-fb9f3c24ab09 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:13:19.843711 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1424/2847] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:13:19 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:13:19.936847 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1424/2848] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:13:19 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:13:19.937512 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a91f8b-55f9-4b8c-95e9-fb9f3c24ab09 service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:13:19.954724 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a91f8b-55f9-4b8c-95e9-fb9f3c24ab09 service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:13:19.972499 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb11e4-4faf-433f-a313-59bb4671c6d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:13:19.973182 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb11e4-4faf-433f-a313-59bb4671c6d7 service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:19.973475 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb11e4-4faf-433f-a313-59bb4671c6d7 service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:19.973773 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb11e4-4faf-433f-a313-59bb4671c6d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:20.104541 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb11e4-4faf-433f-a313-59bb4671c6d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:13:20.106695 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb11e4-4faf-433f-a313-59bb4671c6d7 service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:13:20.132682 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1425/2849] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:13:19 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 02:13:21.582490 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85b53a-cd4e-4f08-a668-6be25542b0b6 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:21.583019 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85b53a-cd4e-4f08-a668-6be25542b0b6 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:21.583420 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85b53a-cd4e-4f08-a668-6be25542b0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:21.603422 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-eb85b53a-cd4e-4f08-a668-6be25542b0b6 None None] MFA Rules not processed for user `a7802534937b4464906e1daeadb89120`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:13:21.604901 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-eb85b53a-cd4e-4f08-a668-6be25542b0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:13:21.617840 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1425/2850] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:13:21 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:13:22.167176 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb11e4-4faf-433f-a313-59bb4671c6d7 service nova] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:13:22.178203 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb11e4-4faf-433f-a313-59bb4671c6d7 service nova] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:13:22.182101 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b908b49-2688-481f-948f-22357e2fc5ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:13:22.182813 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b908b49-2688-481f-948f-22357e2fc5ad service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:22.183171 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b908b49-2688-481f-948f-22357e2fc5ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:22.183518 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b908b49-2688-481f-948f-22357e2fc5ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:22.185801 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-2b908b49-2688-481f-948f-22357e2fc5ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:13:22.196045 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b908b49-2688-481f-948f-22357e2fc5ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:13:22.197830 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b908b49-2688-481f-948f-22357e2fc5ad service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:13:22.208204 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1426/2851] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:13:22 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:13:42.244824 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85b53a-cd4e-4f08-a668-6be25542b0b6 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:13:42.255045 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85b53a-cd4e-4f08-a668-6be25542b0b6 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:13:42.258625 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99068f2-f43f-45c1-a11a-1f986cd3511d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:13:42.259287 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99068f2-f43f-45c1-a11a-1f986cd3511d service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:42.259573 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99068f2-f43f-45c1-a11a-1f986cd3511d service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:42.259851 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99068f2-f43f-45c1-a11a-1f986cd3511d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:42.261629 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-d99068f2-f43f-45c1-a11a-1f986cd3511d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:13:42.270881 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99068f2-f43f-45c1-a11a-1f986cd3511d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:13:42.272276 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99068f2-f43f-45c1-a11a-1f986cd3511d service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:13:42.280056 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1426/2852] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:13:42 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:13:59.205397 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b908b49-2688-481f-948f-22357e2fc5ad service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:13:59.213847 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b908b49-2688-481f-948f-22357e2fc5ad service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:13:59.217627 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf7306-5b48-448f-8fa9-3388f81548fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:13:59.218255 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf7306-5b48-448f-8fa9-3388f81548fb service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:13:59.218537 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf7306-5b48-448f-8fa9-3388f81548fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:13:59.218815 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf7306-5b48-448f-8fa9-3388f81548fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:13:59.227375 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf7306-5b48-448f-8fa9-3388f81548fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:13:59.228779 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf7306-5b48-448f-8fa9-3388f81548fb service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:13:59.238424 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1427/2853] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:13:59 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:15:31.927669 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152b791-fc33-45c7-9126-160f5eb14483 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:15:31.928174 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152b791-fc33-45c7-9126-160f5eb14483 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:15:31.928271 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152b791-fc33-45c7-9126-160f5eb14483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:15:31.945656 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-8152b791-fc33-45c7-9126-160f5eb14483 None None] MFA Rules not processed for user `b8ecd2ce5b714801b32b8f03633fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:15:31.946834 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-8152b791-fc33-45c7-9126-160f5eb14483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:15:31.998927 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1427/2854] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:15:31 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:16:20.204518 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629f037-66a7-46ae-a486-bbef2d4c5bb6 None None] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:16:20.205391 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629f037-66a7-46ae-a486-bbef2d4c5bb6 None None] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:16:20.205391 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629f037-66a7-46ae-a486-bbef2d4c5bb6 None None] PATH_INFO: `/` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:16:20.206978 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1428/2855] 10.222.0.25 () {54 vars in 921 bytes} [Wed Oct 27 02:16:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 02:16:20.213209 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b6a8f-35e7-45cf-88e3-0daaa1f11446 None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:16:20.213955 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b6a8f-35e7-45cf-88e3-0daaa1f11446 None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:16:20.213955 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b6a8f-35e7-45cf-88e3-0daaa1f11446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:16:20.271531 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-766b6a8f-35e7-45cf-88e3-0daaa1f11446 None None] MFA Rules not processed for user `bff692322c68420186f2918d380ece98`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:16:20.272739 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-766b6a8f-35e7-45cf-88e3-0daaa1f11446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:16:20.280154 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1428/2856] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Oct 27 02:16:20 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 02:16:20.296141 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629f037-66a7-46ae-a486-bbef2d4c5bb6 None None] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:16:20.297870 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-6629f037-66a7-46ae-a486-bbef2d4c5bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:16:20.311017 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629f037-66a7-46ae-a486-bbef2d4c5bb6 None None] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:16:20.314605 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3131c10-56fc-4216-9f3e-470ce3b13e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:16:20.315253 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3131c10-56fc-4216-9f3e-470ce3b13e43 service neutron] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:16:20.315534 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3131c10-56fc-4216-9f3e-470ce3b13e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:16:20.315810 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3131c10-56fc-4216-9f3e-470ce3b13e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:16:20.323229 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3131c10-56fc-4216-9f3e-470ce3b13e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:16:20.325143 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3131c10-56fc-4216-9f3e-470ce3b13e43 service neutron] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:16:20.336391 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1429/2857] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:16:20 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:17:21.682211 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b6a8f-35e7-45cf-88e3-0daaa1f11446 None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:17:21.683623 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-766b6a8f-35e7-45cf-88e3-0daaa1f11446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:17:21.786330 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b6a8f-35e7-45cf-88e3-0daaa1f11446 None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:17:21.791255 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d5432-108a-4cff-bba6-ae0654daf98b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff82e315d8c42e49556ab67fbf53b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:17:21.791887 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d5432-108a-4cff-bba6-ae0654daf98b service placement] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:17:21.792198 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d5432-108a-4cff-bba6-ae0654daf98b service placement] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:17:21.792472 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d5432-108a-4cff-bba6-ae0654daf98b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:17:21.794247 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-b94d5432-108a-4cff-bba6-ae0654daf98b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:17:21.805384 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d5432-108a-4cff-bba6-ae0654daf98b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:17:21.806983 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d5432-108a-4cff-bba6-ae0654daf98b service placement] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:17:21.816978 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1429/2858] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:17:21 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:17:33.276491 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3131c10-56fc-4216-9f3e-470ce3b13e43 service neutron] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:17:33.277940 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-b3131c10-56fc-4216-9f3e-470ce3b13e43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:17:33.340921 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3131c10-56fc-4216-9f3e-470ce3b13e43 service neutron] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:17:33.344587 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909af67-bf26-4fa0-a437-1fc469630ec0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:17:33.345223 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909af67-bf26-4fa0-a437-1fc469630ec0 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:17:33.345535 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909af67-bf26-4fa0-a437-1fc469630ec0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:17:33.345821 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909af67-bf26-4fa0-a437-1fc469630ec0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:17:33.347558 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-9909af67-bf26-4fa0-a437-1fc469630ec0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:17:33.357983 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909af67-bf26-4fa0-a437-1fc469630ec0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:17:33.359396 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909af67-bf26-4fa0-a437-1fc469630ec0 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:17:33.367920 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1430/2859] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:17:33 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:17:41.174027 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a02485-47a3-4939-8fd2-6d7e463b0ffd None None] REQUEST_METHOD: `POST` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:17:41.174497 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a02485-47a3-4939-8fd2-6d7e463b0ffd None None] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:17:41.174596 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a02485-47a3-4939-8fd2-6d7e463b0ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:17:41.191285 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.auth.core [None req-d0a02485-47a3-4939-8fd2-6d7e463b0ffd None None] MFA Rules not processed for user `b8ecd2ce5b714801b32b8f03633fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=79472) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 02:17:41.192479 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-d0a02485-47a3-4939-8fd2-6d7e463b0ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:17:41.199774 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1430/2860] 10.222.0.25 () {58 vars in 957 bytes} [Wed Oct 27 02:17:41 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 02:17:41.234063 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909af67-bf26-4fa0-a437-1fc469630ec0 service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:17:41.235439 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-9909af67-bf26-4fa0-a437-1fc469630ec0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:17:41.246071 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909af67-bf26-4fa0-a437-1fc469630ec0 service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:17:41.249679 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d5bfa-d24f-4b29-83f0-734188f9ea06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1819142aab4743fbb9e056ba61e3d474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:17:41.250304 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d5bfa-d24f-4b29-83f0-734188f9ea06 service cinder] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:17:41.250585 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d5bfa-d24f-4b29-83f0-734188f9ea06 service cinder] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:17:41.250854 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d5bfa-d24f-4b29-83f0-734188f9ea06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:17:41.252537 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-211d5bfa-d24f-4b29-83f0-734188f9ea06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:17:41.265636 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d5bfa-d24f-4b29-83f0-734188f9ea06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:17:41.267027 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d5bfa-d24f-4b29-83f0-734188f9ea06 service cinder] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:17:41.278112 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1431/2861] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:17:41 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:17:41.967558 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a02485-47a3-4939-8fd2-6d7e463b0ffd None None] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:17:41.977216 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a02485-47a3-4939-8fd2-6d7e463b0ffd None None] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:17:41.981312 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5079e8-5864-41b8-86a1-0b8dcb98013d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:17:41.981986 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5079e8-5864-41b8-86a1-0b8dcb98013d service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:17:41.982269 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5079e8-5864-41b8-86a1-0b8dcb98013d service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:17:41.982545 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5079e8-5864-41b8-86a1-0b8dcb98013d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:17:41.984270 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-ff5079e8-5864-41b8-86a1-0b8dcb98013d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:17:41.998232 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5079e8-5864-41b8-86a1-0b8dcb98013d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:17:41.999661 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5079e8-5864-41b8-86a1-0b8dcb98013d service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:17:42.011341 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1431/2862] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:17:41 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:17:55.718201 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d5bfa-d24f-4b29-83f0-734188f9ea06 service cinder] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:17:55.719764 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-211d5bfa-d24f-4b29-83f0-734188f9ea06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:17:55.745310 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d5bfa-d24f-4b29-83f0-734188f9ea06 service cinder] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:17:55.751488 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943cecf-b73b-4540-be34-662904036b5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:17:55.751984 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943cecf-b73b-4540-be34-662904036b5b service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:17:55.752271 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943cecf-b73b-4540-be34-662904036b5b service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:17:55.753091 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943cecf-b73b-4540-be34-662904036b5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:17:55.754549 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-7943cecf-b73b-4540-be34-662904036b5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:17:55.767306 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943cecf-b73b-4540-be34-662904036b5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:17:55.768911 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943cecf-b73b-4540-be34-662904036b5b service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:17:55.780823 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1432/2863] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:17:55 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 02:18:06.085630 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5079e8-5864-41b8-86a1-0b8dcb98013d service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:18:06.170110 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5079e8-5864-41b8-86a1-0b8dcb98013d service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:18:06.174971 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca9436-9c55-48e0-bae3-f2bd6ef893b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:18:06.175830 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca9436-9c55-48e0-bae3-f2bd6ef893b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:18:06.176118 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca9436-9c55-48e0-bae3-f2bd6ef893b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:18:06.176396 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca9436-9c55-48e0-bae3-f2bd6ef893b4 admin admin] PATH_INFO: `/v3/users/a7802534937b4464906e1daeadb89120` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:18:06.177617 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca9436-9c55-48e0-bae3-f2bd6ef893b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7802534937b4464906e1daeadb89120)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:18:06.179516 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca9436-9c55-48e0-bae3-f2bd6ef893b4 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:18:06.225617 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-c6ca9436-9c55-48e0-bae3-f2bd6ef893b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7802534937b4464906e1daeadb89120'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:18:06.232809 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-c6ca9436-9c55-48e0-bae3-f2bd6ef893b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7802534937b4464906e1daeadb89120'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:18:06.239474 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-c6ca9436-9c55-48e0-bae3-f2bd6ef893b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7802534937b4464906e1daeadb89120'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:18:06.240101 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-c6ca9436-9c55-48e0-bae3-f2bd6ef893b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7802534937b4464906e1daeadb89120'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:18:06.251845 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-c6ca9436-9c55-48e0-bae3-f2bd6ef893b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7802534937b4464906e1daeadb89120'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:18:06.257697 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1432/2864] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:18:06 2021] DELETE /identity/v3/users/a7802534937b4464906e1daeadb89120 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:18:06.427839 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943cecf-b73b-4540-be34-662904036b5b service nova] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:18:06.441136 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943cecf-b73b-4540-be34-662904036b5b service nova] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:18:06.494595 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36aa15-a623-4fe7-9e5a-328323fc89cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:18:06.496065 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36aa15-a623-4fe7-9e5a-328323fc89cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:18:06.496348 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36aa15-a623-4fe7-9e5a-328323fc89cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:18:06.496626 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36aa15-a623-4fe7-9e5a-328323fc89cf admin admin] PATH_INFO: `/v3/projects/ef5284555cf449a3af709e3701ac4a40` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:18:06.497853 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36aa15-a623-4fe7-9e5a-328323fc89cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef5284555cf449a3af709e3701ac4a40)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:18:06.499748 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36aa15-a623-4fe7-9e5a-328323fc89cf admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:18:06.543860 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-ce36aa15-a623-4fe7-9e5a-328323fc89cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef5284555cf449a3af709e3701ac4a40', 'request_id': 'req-ce36aa15-a623-4fe7-9e5a-328323fc89cf'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:18:06.549382 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-ce36aa15-a623-4fe7-9e5a-328323fc89cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef5284555cf449a3af709e3701ac4a40', 'request_id': 'req-ce36aa15-a623-4fe7-9e5a-328323fc89cf'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:18:06.556388 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-ce36aa15-a623-4fe7-9e5a-328323fc89cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef5284555cf449a3af709e3701ac4a40', 'request_id': 'req-ce36aa15-a623-4fe7-9e5a-328323fc89cf'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:18:06.578515 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-ce36aa15-a623-4fe7-9e5a-328323fc89cf admin admin] The token cache is being invalidate because project ef5284555cf449a3af709e3701ac4a40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:18:06.578801 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-ce36aa15-a623-4fe7-9e5a-328323fc89cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:18:06.579422 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-ce36aa15-a623-4fe7-9e5a-328323fc89cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:18:06.580920 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1433/2865] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:18:06 2021] DELETE /identity/v3/projects/ef5284555cf449a3af709e3701ac4a40 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:18:06.584847 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca9436-9c55-48e0-bae3-f2bd6ef893b4 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:18:06.586370 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-c6ca9436-9c55-48e0-bae3-f2bd6ef893b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:18:06.598999 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca9436-9c55-48e0-bae3-f2bd6ef893b4 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:18:06.652935 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92caa28c-7b32-44b1-ba05-842ce73541dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:18:06.653825 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92caa28c-7b32-44b1-ba05-842ce73541dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:18:06.654107 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92caa28c-7b32-44b1-ba05-842ce73541dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:18:06.654385 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92caa28c-7b32-44b1-ba05-842ce73541dd admin admin] PATH_INFO: `/v3/users/6b86630292b84e2882577161135bb324` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:18:06.655566 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92caa28c-7b32-44b1-ba05-842ce73541dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b86630292b84e2882577161135bb324)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:18:06.657458 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92caa28c-7b32-44b1-ba05-842ce73541dd admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:18:06.701211 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-92caa28c-7b32-44b1-ba05-842ce73541dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b86630292b84e2882577161135bb324'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:18:06.708006 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-92caa28c-7b32-44b1-ba05-842ce73541dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b86630292b84e2882577161135bb324'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:18:06.714899 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-92caa28c-7b32-44b1-ba05-842ce73541dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b86630292b84e2882577161135bb324'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:18:06.715516 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-92caa28c-7b32-44b1-ba05-842ce73541dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b86630292b84e2882577161135bb324'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:18:06.726674 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-92caa28c-7b32-44b1-ba05-842ce73541dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b86630292b84e2882577161135bb324'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:18:06.732836 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1433/2866] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:18:06 2021] DELETE /identity/v3/users/6b86630292b84e2882577161135bb324 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:18:06.895408 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36aa15-a623-4fe7-9e5a-328323fc89cf admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:18:06.896838 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-ce36aa15-a623-4fe7-9e5a-328323fc89cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:18:06.920870 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36aa15-a623-4fe7-9e5a-328323fc89cf admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:18:06.974709 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5af13c-5cdc-44c7-9f94-d8fa14609e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:18:06.975572 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5af13c-5cdc-44c7-9f94-d8fa14609e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:18:06.975862 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5af13c-5cdc-44c7-9f94-d8fa14609e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:18:06.976144 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5af13c-5cdc-44c7-9f94-d8fa14609e3d admin admin] PATH_INFO: `/v3/projects/83a6eb78653247929663b1f4b48db13a` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:18:06.977371 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5af13c-5cdc-44c7-9f94-d8fa14609e3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=83a6eb78653247929663b1f4b48db13a)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:18:06.979876 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5af13c-5cdc-44c7-9f94-d8fa14609e3d admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:18:07.024575 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-cb5af13c-5cdc-44c7-9f94-d8fa14609e3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83a6eb78653247929663b1f4b48db13a', 'request_id': 'req-cb5af13c-5cdc-44c7-9f94-d8fa14609e3d'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:18:07.030461 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-cb5af13c-5cdc-44c7-9f94-d8fa14609e3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83a6eb78653247929663b1f4b48db13a', 'request_id': 'req-cb5af13c-5cdc-44c7-9f94-d8fa14609e3d'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:18:07.037353 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-cb5af13c-5cdc-44c7-9f94-d8fa14609e3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83a6eb78653247929663b1f4b48db13a', 'request_id': 'req-cb5af13c-5cdc-44c7-9f94-d8fa14609e3d'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:18:07.048756 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-cb5af13c-5cdc-44c7-9f94-d8fa14609e3d admin admin] The token cache is being invalidate because project 83a6eb78653247929663b1f4b48db13a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79473) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:18:07.049045 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-cb5af13c-5cdc-44c7-9f94-d8fa14609e3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:18:07.049696 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-cb5af13c-5cdc-44c7-9f94-d8fa14609e3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:18:07.051218 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1434/2867] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:18:06 2021] DELETE /identity/v3/projects/83a6eb78653247929663b1f4b48db13a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:18:30.352681 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92caa28c-7b32-44b1-ba05-842ce73541dd admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:18:30.354134 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-92caa28c-7b32-44b1-ba05-842ce73541dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:18:30.436383 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92caa28c-7b32-44b1-ba05-842ce73541dd admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:18:30.481584 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf6dd5-e713-456e-9d5d-e56a6fd3ced4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:18:30.482225 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf6dd5-e713-456e-9d5d-e56a6fd3ced4 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:18:30.482508 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf6dd5-e713-456e-9d5d-e56a6fd3ced4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:18:30.482783 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf6dd5-e713-456e-9d5d-e56a6fd3ced4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:18:30.484540 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-acbf6dd5-e713-456e-9d5d-e56a6fd3ced4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:18:30.493390 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf6dd5-e713-456e-9d5d-e56a6fd3ced4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:18:30.494817 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf6dd5-e713-456e-9d5d-e56a6fd3ced4 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:18:30.503149 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1434/2868] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:18:30 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:19:38.208785 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5af13c-5cdc-44c7-9f94-d8fa14609e3d admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:19:38.211129 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-cb5af13c-5cdc-44c7-9f94-d8fa14609e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:19:38.288374 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5af13c-5cdc-44c7-9f94-d8fa14609e3d admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:19:38.295358 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a90b1-de22-4fca-b87f-cc2a8af1cf51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2f8304b85b64dc4ac58523897306660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:19:38.296006 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a90b1-de22-4fca-b87f-cc2a8af1cf51 service nova] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:19:38.296417 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a90b1-de22-4fca-b87f-cc2a8af1cf51 service nova] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:19:38.296707 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a90b1-de22-4fca-b87f-cc2a8af1cf51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:19:38.299011 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3a4a90b1-de22-4fca-b87f-cc2a8af1cf51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:19:38.314877 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a90b1-de22-4fca-b87f-cc2a8af1cf51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:19:38.316973 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a90b1-de22-4fca-b87f-cc2a8af1cf51 service nova] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:19:38.334167 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1435/2869] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:19:38 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:19:50.495536 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf6dd5-e713-456e-9d5d-e56a6fd3ced4 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:19:50.497024 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-acbf6dd5-e713-456e-9d5d-e56a6fd3ced4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:19:50.507371 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf6dd5-e713-456e-9d5d-e56a6fd3ced4 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:19:50.511057 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c994cb8-251d-4a8f-bea4-70aa2844d707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bff692322c68420186f2918d380ece98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:19:50.511687 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c994cb8-251d-4a8f-bea4-70aa2844d707 service neutron] REQUEST_METHOD: `GET` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:19:50.511973 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c994cb8-251d-4a8f-bea4-70aa2844d707 service neutron] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:19:50.512253 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c994cb8-251d-4a8f-bea4-70aa2844d707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:19:50.514028 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-8c994cb8-251d-4a8f-bea4-70aa2844d707 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:19:50.575016 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c994cb8-251d-4a8f-bea4-70aa2844d707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:19:50.576359 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c994cb8-251d-4a8f-bea4-70aa2844d707 service neutron] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:19:50.585705 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1435/2870] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:19:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 02:19:56.805108 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a90b1-de22-4fca-b87f-cc2a8af1cf51 service nova] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:19:56.806669 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-3a4a90b1-de22-4fca-b87f-cc2a8af1cf51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:19:56.824803 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a90b1-de22-4fca-b87f-cc2a8af1cf51 service nova] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:19:56.829612 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3836f-cbbe-4701-9e66-fd1b3cd1d666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:19:56.830487 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3836f-cbbe-4701-9e66-fd1b3cd1d666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:19:56.830772 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3836f-cbbe-4701-9e66-fd1b3cd1d666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:19:56.831051 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3836f-cbbe-4701-9e66-fd1b3cd1d666 admin admin] PATH_INFO: `/v3/users/b8ecd2ce5b714801b32b8f03633fd867` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:19:56.832252 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3836f-cbbe-4701-9e66-fd1b3cd1d666 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8ecd2ce5b714801b32b8f03633fd867)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:19:56.834317 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3836f-cbbe-4701-9e66-fd1b3cd1d666 admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:19:56.879766 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-2ff3836f-cbbe-4701-9e66-fd1b3cd1d666 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8ecd2ce5b714801b32b8f03633fd867'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:19:56.886710 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-2ff3836f-cbbe-4701-9e66-fd1b3cd1d666 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8ecd2ce5b714801b32b8f03633fd867'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:19:56.887368 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-2ff3836f-cbbe-4701-9e66-fd1b3cd1d666 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8ecd2ce5b714801b32b8f03633fd867'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:19:56.898418 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-2ff3836f-cbbe-4701-9e66-fd1b3cd1d666 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8ecd2ce5b714801b32b8f03633fd867'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:19:56.906098 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-2ff3836f-cbbe-4701-9e66-fd1b3cd1d666 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8ecd2ce5b714801b32b8f03633fd867'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:19:56.912019 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1436/2871] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:19:56 2021] DELETE /identity/v3/users/b8ecd2ce5b714801b32b8f03633fd867 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:19:57.084353 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c994cb8-251d-4a8f-bea4-70aa2844d707 service neutron] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:19:57.094269 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c994cb8-251d-4a8f-bea4-70aa2844d707 service neutron] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:19:57.149726 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b128b7-2cc6-4b4c-ac07-d2a91d7d1393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:19:57.150517 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b128b7-2cc6-4b4c-ac07-d2a91d7d1393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:19:57.150807 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b128b7-2cc6-4b4c-ac07-d2a91d7d1393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:19:57.151088 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b128b7-2cc6-4b4c-ac07-d2a91d7d1393 admin admin] PATH_INFO: `/v3/projects/7324ce1980534488848df032fdeb2421` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:19:57.152279 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b128b7-2cc6-4b4c-ac07-d2a91d7d1393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7324ce1980534488848df032fdeb2421)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:19:57.154211 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b128b7-2cc6-4b4c-ac07-d2a91d7d1393 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:19:57.199392 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-82b128b7-2cc6-4b4c-ac07-d2a91d7d1393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7324ce1980534488848df032fdeb2421', 'request_id': 'req-82b128b7-2cc6-4b4c-ac07-d2a91d7d1393'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:19:57.204617 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-82b128b7-2cc6-4b4c-ac07-d2a91d7d1393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7324ce1980534488848df032fdeb2421', 'request_id': 'req-82b128b7-2cc6-4b4c-ac07-d2a91d7d1393'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:19:57.210897 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-82b128b7-2cc6-4b4c-ac07-d2a91d7d1393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7324ce1980534488848df032fdeb2421', 'request_id': 'req-82b128b7-2cc6-4b4c-ac07-d2a91d7d1393'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:19:57.221354 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-82b128b7-2cc6-4b4c-ac07-d2a91d7d1393 admin admin] The token cache is being invalidate because project 7324ce1980534488848df032fdeb2421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:19:57.221675 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-82b128b7-2cc6-4b4c-ac07-d2a91d7d1393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:19:57.222295 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-82b128b7-2cc6-4b4c-ac07-d2a91d7d1393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:19:57.223794 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1436/2872] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:19:57 2021] DELETE /identity/v3/projects/7324ce1980534488848df032fdeb2421 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:19:57.227734 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3836f-cbbe-4701-9e66-fd1b3cd1d666 admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:19:57.229210 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-2ff3836f-cbbe-4701-9e66-fd1b3cd1d666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:19:57.242102 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3836f-cbbe-4701-9e66-fd1b3cd1d666 admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:19:57.295480 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6bb54-8e03-4bb3-8af6-64b6003da46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:19:57.296344 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6bb54-8e03-4bb3-8af6-64b6003da46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:19:57.296631 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6bb54-8e03-4bb3-8af6-64b6003da46f admin admin] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:19:57.296889 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6bb54-8e03-4bb3-8af6-64b6003da46f admin admin] PATH_INFO: `/v3/users/cf82e7e3969c423a8e13f9fc90f2e459` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:19:57.298355 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6bb54-8e03-4bb3-8af6-64b6003da46f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf82e7e3969c423a8e13f9fc90f2e459)` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:19:57.300290 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6bb54-8e03-4bb3-8af6-64b6003da46f admin admin] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:19:57.343986 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d4a6bb54-8e03-4bb3-8af6-64b6003da46f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf82e7e3969c423a8e13f9fc90f2e459'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:19:57.350480 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d4a6bb54-8e03-4bb3-8af6-64b6003da46f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf82e7e3969c423a8e13f9fc90f2e459'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:19:57.351161 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d4a6bb54-8e03-4bb3-8af6-64b6003da46f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf82e7e3969c423a8e13f9fc90f2e459'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:19:57.362974 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d4a6bb54-8e03-4bb3-8af6-64b6003da46f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf82e7e3969c423a8e13f9fc90f2e459'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:19:57.370353 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.notifications [None req-d4a6bb54-8e03-4bb3-8af6-64b6003da46f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf82e7e3969c423a8e13f9fc90f2e459'} {{(pid=79473) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:19:57.376107 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1437/2873] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Oct 27 02:19:57 2021] DELETE /identity/v3/users/cf82e7e3969c423a8e13f9fc90f2e459 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 02:19:57.545167 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b128b7-2cc6-4b4c-ac07-d2a91d7d1393 admin admin] Authenticating user token {{(pid=79472) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:19:57.546610 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.fernet_utils [None req-82b128b7-2cc6-4b4c-ac07-d2a91d7d1393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79472) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:19:57.561607 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b128b7-2cc6-4b4c-ac07-d2a91d7d1393 admin admin] Validating token access rules against request {{(pid=79472) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:19:57.617785 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941da6b-5940-494a-a694-ff898bef5422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48900f443894ac798508f952478760c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38379d318e5c49acaf4683887f433419', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79472) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:19:57.619252 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941da6b-5940-494a-a694-ff898bef5422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:19:57.619539 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941da6b-5940-494a-a694-ff898bef5422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:19:57.619819 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941da6b-5940-494a-a694-ff898bef5422 admin admin] PATH_INFO: `/v3/projects/bfc1c0cc50204563bfc73acd0b51ffd9` {{(pid=79472) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:19:57.621046 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941da6b-5940-494a-a694-ff898bef5422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfc1c0cc50204563bfc73acd0b51ffd9)` {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:19:57.622977 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941da6b-5940-494a-a694-ff898bef5422 admin admin] RBAC: Authorization granted {{(pid=79472) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:19:57.666721 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6941da6b-5940-494a-a694-ff898bef5422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfc1c0cc50204563bfc73acd0b51ffd9', 'request_id': 'req-6941da6b-5940-494a-a694-ff898bef5422'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:19:57.672382 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6941da6b-5940-494a-a694-ff898bef5422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfc1c0cc50204563bfc73acd0b51ffd9', 'request_id': 'req-6941da6b-5940-494a-a694-ff898bef5422'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:19:57.679223 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6941da6b-5940-494a-a694-ff898bef5422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfc1c0cc50204563bfc73acd0b51ffd9', 'request_id': 'req-6941da6b-5940-494a-a694-ff898bef5422'} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:19:57.690950 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6941da6b-5940-494a-a694-ff898bef5422 admin admin] The token cache is being invalidate because project bfc1c0cc50204563bfc73acd0b51ffd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79472) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 02:19:57.691237 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6941da6b-5940-494a-a694-ff898bef5422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:19:57.691879 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: DEBUG keystone.notifications [None req-6941da6b-5940-494a-a694-ff898bef5422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79472) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 02:19:57.693377 dv-cinder-815461-3-iscsi devstack@keystone.service[79472]: [pid: 79472|app: 0|req: 1437/2874] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Oct 27 02:19:57 2021] DELETE /identity/v3/projects/bfc1c0cc50204563bfc73acd0b51ffd9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 02:22:26.626744 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6bb54-8e03-4bb3-8af6-64b6003da46f admin admin] Authenticating user token {{(pid=79473) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 02:22:26.628179 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-d4a6bb54-8e03-4bb3-8af6-64b6003da46f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:22:26.709817 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6bb54-8e03-4bb3-8af6-64b6003da46f admin admin] Validating token access rules against request {{(pid=79473) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 02:22:26.764720 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea6c94-b9c3-404c-8b0d-c9cef867f296 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ff82e315d8c42e49556ab67fbf53b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b95c6a455e74d9487ae73f44a9ba0e6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79473) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 02:22:26.765360 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea6c94-b9c3-404c-8b0d-c9cef867f296 service placement] REQUEST_METHOD: `GET` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 02:22:26.765676 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea6c94-b9c3-404c-8b0d-c9cef867f296 service placement] SCRIPT_NAME: `/identity` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 02:22:26.765953 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea6c94-b9c3-404c-8b0d-c9cef867f296 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79473) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 02:22:26.767689 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.fernet_utils [None req-07ea6c94-b9c3-404c-8b0d-c9cef867f296 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79473) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 02:22:26.778407 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea6c94-b9c3-404c-8b0d-c9cef867f296 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 02:22:26.779970 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea6c94-b9c3-404c-8b0d-c9cef867f296 service placement] RBAC: Authorization granted {{(pid=79473) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 02:22:26.790011 dv-cinder-815461-3-iscsi devstack@keystone.service[79473]: [pid: 79473|app: 0|req: 1438/2875] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Oct 27 02:22:26 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)